Just to elaborate on the "fast-facts"/post-it-note point I made: it seems there's actually a lot of "facts" ("conclusions") stored in a readily available manor in my brain. All the references/data that lead to these conclusions are stored in some deeper "archive" section though, and aren't readily available.
I guess you could compare them as if they are API's to different LLM's, and my "consciousness" is the web-browser. So it's like;
- `fast_facts.llm` is a micro model with good breadth and fast response times, but it has little depth. So it's API can be fetch'd without worrying about it blocking the main-thread/browser.
- `all_data.llm` is a full size model, but it's slow to respond, and "costs" more to run. So in the browser, it is only lazily-loaded (ie, not always used), and it has to be called async style because you have to wait for the results to slowly "stream in".
And stream they do, because back to my example conversation where someone asks "how are they arrogant?" — whilst I likely wouldn't immediately remember any examples (unless they happened very recently), at that point the request to `all_data.llm` would have been sent, and so after some umm's and ahh's, I might have an answer. Or I might just say "I can't remember off the top of my head, but also ..." start talking about something else, and then after 30 seconds I will drop the classic "but actually, i just remembered, ...".
I guess you could compare them as if they are API's to different LLM's, and my "consciousness" is the web-browser. So it's like;
And stream they do, because back to my example conversation where someone asks "how are they arrogant?" — whilst I likely wouldn't immediately remember any examples (unless they happened very recently), at that point the request to `all_data.llm` would have been sent, and so after some umm's and ahh's, I might have an answer. Or I might just say "I can't remember off the top of my head, but also ..." start talking about something else, and then after 30 seconds I will drop the classic "but actually, i just remembered, ...".