> Across all attempted problems, the agents sent 4.9 million messages and used about 300 billion output tokens
Don't even try to do the math on how much that would cost at normal API prices. And we don't even know how much more expensive this internal-only model would be!
Not to mention that the exponential plummeting cost of tokens means that that $15 million will be a "pocket change" within a decade or less: https://a16z.com/llmflation-llm-inference-cost/
This could fund 10 top income mathematicians for 8 years (based on https://careers.usnews.com/best-jobs/mathematician/salary ). Imagine what kinds of results we'd have to transform the foundations of science if we were giving brilliant minds this kind of funding to do nothing but research for most of decade....
Instead, we get slop proofs that are technically correct as PR stunts to enable corrupt kleptocrats, and most likely will drive research into culs-de-sac.
Don't even try to do the math on how much that would cost at normal API prices. And we don't even know how much more expensive this internal-only model would be!