I want to move away from claude but don't have the hardware for "good" local llms, and would rather use a ZDR api instead of one of the big apis for privacy reasons.
After my Claude subscription ended, I tried using Fireworks and OpenRouter to be less vendor-locked and access cheaper models. MiniMax, Kimi, and Qwen were the three I tried the most since they're fairly cheap, but I still burned thorugh credits way too fast. Now I'm using Codex.
I've heard that if you can deal with slower output, local LLMs can run on gaming graphics cards well enough. So they're not great for a live coding assistant, but running some tasks/agents overnight is an option.
I want to move away from claude but don't have the hardware for "good" local llms, and would rather use a ZDR api instead of one of the big apis for privacy reasons.