Wish I could do that. But I only have the one graphics card. Ollama does a decent job at hotswapping models but I can go much faster with llama.cpp trouble is llama.cpp doesn't like sharing vram. It is all or crash. I'd have to actually start and stop the process with different models. Might as well just use qwen3.8 27b for everything.
In practice I am using cursor $20/mo for real development.
Daniel Wigton
npub1w4…q30zp
2026-10-11 22:47:19 UTC
in reply to nevent1q…pmrl
Author Public Key
npub1w4jkwspqn9svwnlrw0nfg0u2yx4cj6yfmp53ya4xp7r24k7gly4qaq30zpPublished at
2026-10-11 22:47:19 UTCEvent JSON
{
"id": "000000e2db5c7a8ffb89c99cde3328893a2f2b954a579313b4e7eb2a62a72c49",
"pubkey": "75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a",
"created_at": 1791758839,
"kind": 1,
"tags": [
[
"e",
"39a0931f7f4a8e5cb7e5e5e43335b8c27032933b7ec51ffc6a12f303df00e368",
"wss://theforest.nostr1.com/",
"root",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"e",
"7e8459971a85aa465396b0eb11c5c32e14a344c33574a16a79355966eb13bd9f",
"wss://nostr.wine/",
"",
"576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9"
],
[
"e",
"131d63272c3c6cfe866c49d0f6db373a4435905f29499dfdc22d8170611c3850",
"wss://theforest.nostr1.com/",
"reply",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"p",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58",
"wss://theforest.nostr1.com/"
],
[
"p",
"576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"wss://eden.nostr.land/"
],
[
"client",
"Amethyst"
],
[
"nonce",
"000han",
"24"
]
],
"content": "Wish I could do that. But I only have the one graphics card. Ollama does a decent job at hotswapping models but I can go much faster with llama.cpp trouble is llama.cpp doesn't like sharing vram. It is all or crash. I'd have to actually start and stop the process with different models. Might as well just use qwen3.8 27b for everything.\n\nIn practice I am using cursor $20/mo for real development.",
"sig": "db7fd177e78f2527ab697c47db2a66893d5217a2665b60860bafaa3ed5520515bfef3bea5865c2461acf0b4afb69cb28b5e70a3f18b6f830d386b06db7a6f143"
}