I used over a billion tokens per day of gpt-5.6 sol xhigh starting last Wednesday through Sunday before reaching my reset limit. The $200 pro plan is still the best deal.
There's no universe in which just buying a second or a larger subscription isn't a billion times better and cheaper than any kind of comparable local workflow.
Privacy, experimenting with ML and "unorthodox" needs are currently the only acceptable reasons to do local.
Well I wouldn't say a billion times better. I've actually been having a surprising amount of success working with local models. And my investment has only been the equivalent of 4 months of a Max x20 subscription.
Experimentation and privacy are definitely advantages, but it's also quite a lot of fun.
Yeah, it sure was convenient that there was a RAM pricing crisis right when Apple was making local inference viable. All because of a promise that AI companies will buy more of it... with money they don't yet have, whereas Apple does have lots of money.
Agreed I’ve seen what they’re paying at work for the OpenAI API but I also think that includes reserved capacity and ZDR O_o. Try some add on credits next time if you can. I was curious at how far $20 would go (500 credits). Watched them go to zero over an hour and assumed it’d stop. It then ran for another 6 hours and completed the task despite the meter at 0. What a task means is very unclear but it’s definitely not pricing sol at $20/500 credits an hr in tokens.
I mean this is kind of standard in a lot of industries? Businesses get reliability/support usually for the price increase. Just look at lots of industrial tech. Or business vs consumer 3D printers, or business vs consumer laptops etc....
Pretty basic. The codex app with one conversation per project and several running simultaneously all hours. I’m going for max caching that way and it never gets lost even with compaction somehow. Each has a plan with milestones to keep up to date and a thin agents file. I check in on them in the Remote app. Use case is protocol and control reverse engineering of audio hardware. I think they must be identifying the heavy use agent sessions and cranking up their cache lives so it’s not a big deal for them.
Ultra mode spins up many sub-agents. On a particularly challenging task, I’ve had as many as 29 agents working at one time.
Also if you don’t specify, most end up being the same as the parent model which is pretty wasteful.
I engineered a skill that spins up Terra High agents for most sub-agents, resorting to Sol Medium for technical research and Luna High for code/in-project research tasks.
On a slightly different topic, Luna Max is incredibly capable and doesn’t use as much quota (Luna tokens are dirt cheap).
Most importantly, are you seeing a return on investment for time and ultimate outcome?
No one can judge the enjoyment, learning, and hobby aspects. Just wondering if there is an end goal for that much overall expenditure (time, money, energy, etc.)
I absolutely see a return. I do not pay for this (we have a corporate gateway), for the price of a junior developer I can get 3-4-5 senior developer's work done. it's insane value.
I'd like to see a benchmark on this specific topic: Reverse engineer the hardware protocol from a driver, or just migrate a driver from one OS to another.
I’ve chipped on it with each model since 5.2 but 5.6 sol is something else. When it first came out I’d get some refusals but they’ve since stopped. I wonder what an ideal candidate benchmark task would be for that?
5.6 has been a huge pivotal change in reverse engineering tasks for me too (largely extracting game assets from binary client files). Something I spent literally weeks on in January with claude models at the time was solved in about 30 minutes with 5.6 Sol at medium just yesterday. It's both extremely satisfying but at the same time also a little annoying how much time I had previously spent on it only for it to be solved so quickly now. I suspect improvements in AI will continue this happy but annoyed trend.
Some people just do crazy stuff. For example this now ex yc guy who said he has agents constantly scanning Sf govt apis and forming dashboards just because
Yeah I am, building large software with a vision - requirements - architecture - plan - code workflow. One Claude max account is enough to work on one, maybe two of those at a time (call it 15B tokens/month per project)
I’m exclusively using ultra and I run out in 3-4 days consistently. Those resets are great but I’ve noticed they like to cluster them at the start of the cycle, would be better if they spaced them out more.
A billion tokens per day?? Plausible estimates put the energy use at about 0.001 Wh/token, which means you're using 1000 kWh/day in electricity, just to generate slop. That's about the same as 50-100 houses. 300kg of CO2 per day - roughly the same as flying from London to New York every three days.
I think on average AI energy usage is not as big a deal as everyone is panicking about, but your usage is truly absurd and I don't know how you can live with that. It's immoral.
I can't speak for that guy, but I'm a physicist and work in clean energy... So it's not too hard! That said, I usually am closer to 10M on days I do heavy coding, so not nearly that bad.
Have you seen the average physicist code? I've crawled around in the muck of Fortran codes written in 1970 with unreadable 8 character variable names (the first of which encodes the type), with implicit typing, zero comments, computed go-tos, SAVE, the works. Tests? Never heard of it. Bugs everywhere. You would be far less sanguine about physicists coding if you looked into some of the "flagship" codes used today. And believe me, it isn't a "boomer bad" phenomenon. Every incoming student I've had in the last decade writes shit code too.
My (only somewhat facetious) opinion is that physicist access to programming languages should be controlled like doctors' access to opiates.
0. It's not about "looking pretty", it's about being nigh impossible to understand or reason about. There is a 1000 LoC subroutine that I'm convinced was ported from FORTRAN 1 unchanged that cannot be understood by anyone under the age of 50 that underpins one of the "flagship" physics codes in my field. It's a fucking nightmare every time I have to worry about that stupid thing. I remind you that this was 100% the product of a human brain (pre computer age, pre social media, and I'm told quite the genius too). Perhaps one should not place the human brain on too high a pedestal and deify it.
1. Why did you take from my OP that I tell codex "write a climate simulation code, make no mistakes" and go suntanning on a beach in the tropics for the rest of the semester?
2. Perhaps you have a different experience from me in writing HPC codes, but my experience is that > 90% of the code is boilerplate. I find GPT 5.6 can be prone to overengineering, but with a little steering and good judgement it generates very nice interfaces and high level code. I just have to think about the solver structure or metastructure.
3. Even with core numerics - pre-AI, it was a bunch of iteration going back and forth between code and optreports. Now codex will just do it. I suppose this may seem grim to you if you loved decorating every variable with !DIR$ ASSUME_ALIGNED, and manually batching array operations or whatever, but I didn't and I'm glad I no longer need to.
4. I'm now highly motivated to write tests, and AI makes it way easier to write the immense boilerplate around good tests (sorry not sorry, my {FUNDING_AGENCY} program manager doesn't give a flying fuck what my test coverage is, and my next grant won't depend on that in the slightest, so pre-AI I did the bare minimum. You can argue that the results will be worse, yadda yadda, but the incentive structure that {FUNDING_AGENCY} has in place don't promote good software standards, and my career never suffered for it)
5. I can generate docstrings with high accuracy (see the above)
As a company... but that includes things like research costs, model training etc. to determine if they're selling electricity at a loss you should look at inference costs bc that's the "thing" they're selling
I can’t sign up for that. I tried authorizing Codex a couple days ago. For some reason, their system says my phone number has been used for verification 3 times even though it definitely has not. I’ve had this phone number for over 20 years. OpenAI support is useless. They just keep repeating the policy without actually helping me.
Use TextVerified, load up like $5 of credit and OAI verification is like $1.00. Then when your account is made, ensure 2FA/passkey is setup then you don't need to worry about the phone number.
Historically those are less useful because some of the verification systems require a real phone number and that your name is associated with the account, depending on what and how they verify. It's annoying, I use a google voice number as my primary, and it often gets rejected.
There are several tiers to these services, some are selling real us phone number verifications at about 0.5usd/text while others are selling virtual phone number verifications at much cheaper. From some limited experience with the former, there is rarely if ever any problems with rejections.
Yes I filed a support ticket with them and explained that their system is broken and they just did not care. I explained how it was impossible for me to use it 3 times already as I've only made 2 chatgpt accounts EVER, and only recalling entering my phone number for one of the two chatgpt accounts. I told them that this issue locked me out of codex and chatgpt for work and they weren't willing to do anything about it. Totally useless support.
I ended up borrowing my gf's phone number just so I could get access for work. Ridiculous
