Join Nostr
2026-10-15 16:36:38 UTC
in reply to

ChipTuner on Nostr: giving ppq, with a (very buggy vibed tool) called routerly a try. Using tev:4b for ...

giving ppq, with a (very buggy vibed tool) called routerly a try. Using tev:4b for routing decisions, a couple self hosted qwen-3.8:27b-q_8 slots, and ppq for access to big models, im hoping to drop my spend down to well under $2.00 per work-day at floor API prices.

ppq, only because it has a model pricing api endpoint, and no-kyc wallet. Eventually ill play around with TEE, but the work it does is all public/open source.

I found ollama cloud to be the most reasonable earlier this year, but their inference prices soared this summer so it became less affordable, and the GLM models started to suck after a while. I couldn't justify the $100/mo plan.