I very much don’t want to run it locally. I want the same one running somewhere else that I can interact with from all my devices. Look at something like Grok Bot. Nobody is going to run this locally. You can already self host almost anything, yet most people and businesses don’t.
Exactly the type of thing I’d pay someone not to deal with. It’s like media streaming vs piracy. Even though I could get a nice local setup with plex and have higher quality streams with free pirated br rips, I just don’t want to deal with it.
Maybe I could use codex or whatever to set that all up nowadays, but it was such a pain doing the initial setup and getting it all running and finding sources of media yadda yadda like a decade ago when I last tried lol
> Exactly the type of thing I’d pay someone not to deal with.
Very much a personality and/or lifestyle thing, but I've also been building infra for decades. I mean it was two container startups and a phone app download (10min). Not exactly difficult. If I didn't like it I certainly wouldn't be in tech!
> pay someone
I'd do that with something like 3 story roof work or foundation work with a contractor, but tech? If I want the outcome I will be happy with, often have to do it myself.
To be clear I don’t mean pay someone to set it up for me, but rather pay for a saas platform that’s already doing it. It’s not that I couldn’t run something locally, I just don’t want to deal with the hassle.
I was into home automation and self hosting media and some other stuff for a while. It’s the kind of thing I’d only do again if i was equally or more interested in the process than the outcome.
But it is quite likely a 1T market. That won't support the stock valuations of OpenAI, Anthropic or Nvidia, but it will still mean massive data center build out and little relief to RAM prices.
I want the model running wherever electricity and infra is cheapest, which will likely be China; if that gets geopolitically hot, eh, suddenly a “nearby” data center will open run by “individuals” with “no connections”, magically - it will be very funny to watch.
There will be some “rising star” businessperson who somehow got an amazing deal on land and energy and just likes to spend 1/2 their time in Shenzhen or something, but the datacenter is in Vietnam or Singapore or Thailand or wherever. They might even have a US branch, to make everyone feel better!
It will collapse the market, and everyone will realize that data centers are actually worth LESS than Toyota - they’ll look more like Tulips, suddenly.
