The context window is limited to 64k or 128k. If you’re using this with a coding agent, there’s going to be a lot of compactions. I found that I had a subagent whose compacted context plus prompts and such was over the window and it errored out in opencode.
As we have more powerful AI plus agents that can run on your phone, keeping everything as a pile of markdown plus some compute on top makes a lot of sense
May I point out that in "Crudam si edes, in acetum intinguito", that "edes" is more likely to be the future of edere/esse "to eat"? (Just guessing by context.)
For this project, where you have 120GB of customer data, and thirty requests a second for ~8k objects (0.25MB/s object reads), you’d seem to be able to 100x the throughput vertically scaling on one machine with a file system and an SSD and never thinking about object storage. Would love to see why the complexity
(Author here) that's more or less what I have right now – one machine with a file system and an SSD. S3 API on top is there to give multiple web servers shared access to the same storage. I could have used something else instead of S3 – say, NFS – but there was a feature request for S3 [1] and S3 has a big ecosystem around it already.
reply