It's a monorepo and they're at over 1 million PRs. There's surely some juicy stuff there.

It's crazy that we still rely on these unsafe C dependencies, in an era where migrating code to Rust (or other languages) is so easy.

There's really no excuse.

Its my understanding that rust just addresses memory safety, and it all falls apart at the first mention of "unsafe" or whatever the keyword is, not to mention the supply chain thing with the crates. Obviously AI makes it all moot because thats where the entire theory of basic security gets thrown out the window lol just chat with facebooks robot if you want someone elses instagram account amirite?

I think most of the long hanging fruit has been discovered, and even then you'll have better ROI focusing funding on applied math instead of pure math.

Reminds me of Michelson's (of Michelson-Morley) famous statement in 1900 that all of physics had essentially already been discovered, so the only remaining work was to apply what was known to new experiments. Similar statements were made about chemistry after Mendeleev and history after the cold war.

I didn't claim you wouldn't discover things in pure math that would decades later turn out to be useful in other fields. I'm sure you would. My claim was that the ROI is lower compared to applied math, which matters when funding is limited.

You still need some brilliant mathematicians to invent new problems. AI is not yet good at inventing problems which are both novel and interesting.

You can trivially run 131k on 24GB 4bit, and there are repos with tweaks that allow you to get the full 262k but idk if there's degradation with their approach.

I tried their WebGPU version and it immediately started looping. Yeah "near lossless" my ass. Plus the reasoning that it looped on was clearly wrong and unlike the non quantized 27B

Not everyone uses laptops. I can run Qwen 3.8 27B (which is a REALLY capable model) in the background coding for me while I'm simultaneously browsing the web and playing VALORANT without any performance impact, and that's on a 6 year old GPU.

> But I also think that the state of the art in small LLM and user device capabilities aren't there yet to put a "good enough to be actually useful" local-only LLM as a prepackaged thing in a mass market distributed browser.

Then just allow it to be enabled on high end devices? But it must be local only. As hardware advances and people upgrade, more people will be able to turn on the feature.

Targeting byte code or asm instead of high level would be silly for everyday tasks. You blow up the number of tokens, reduce your effective context, and there's just more places for it to make a mistake, which most likely won't be caught by the assembler (unlike compilers).

I'm so happy for the two used 3090s I bought for $500 each after Ethereum mining ended. I even saw them for like $430 at some point lol.

The math is wrong, the tok/s is at least 2x that, at least with MTP and Q8 KV which you should always use. And the default tokens a day is ridiculously low at least for coding.

Having said that, it will never pay for itself. A simpler more absolute math is, if I buy a Mac and use it to sell tokens on OpenRouter, will I make a profit? And the answer is no.