If the future is AI, then a future where every compute has to pass through one o...

tonyhart7 · 2025-09-10T03:58:07 1757476687

but its not the future, we already can do that right now

the problem is people expectation, they want the model to be smart

people aren't having problem for if its local or not, but they want the model to be useful

aurareturn · 2025-09-10T12:40:18 1757508018

Sure, that's why local LLMs aren't popular or mass market as of September 2025.

But cloud models will have diminishing returns, local hardware will get drastically faster, and techniques to efficiently inference them will be worked out further. At some point, local LLMs will have its day.

tonyhart7 · 2025-09-10T15:28:23 1757518103

only in theory and that's not gonna be happening

this is the same happening with software and game industry

because free market forces people to raise the bar every year, the requirement of apps and games never met. its only goes up

human would never be satisfied, boundary would be push further

that's why we have 12gb or 16gb ram for smartphone right now only for system + apps

and now we must accommodate for local LLM too??? it would only goes up, people would demand smarter and smarter model

frontier model today would deem unusable(dumb) in 5 years

example: people literally screaming in agony when Antrophic quantized their model