At least 16GB of VRAM.
Q4 is roughly half a byte per parameter, and you need space for context too
Raison d'État
npub1mt…3ueyt
2026-09-25 22:03:05 UTC
in reply to nevent1q…u63l
Author Public Key
npub1mts2l7rsvgpqxdc8sk39e50fpntw0p7eamq8pp3kek5h6k7qemzq83ueytPublished at
2026-09-25 22:03:05 UTCEvent JSON
{
"id": "416a07ce6484178cb400fb1e10c3715a0b288428957b559cbead19662033a914",
"pubkey": "dae0aff870620203370785a25cd1e90cd6e787d9eec0708636cda97d5bc0cec4",
"created_at": 1790373785,
"kind": 1,
"tags": [
[
"e",
"919997fb17c36a3a4d6d637fb9ed97e55ec98bf84556d815d3adde2244f98cb3",
"wss://relay.momostr.pink/",
"root",
"134923ad77a79e45dddf47a4ce8b36e1fc1270f0df735f34056598759a5c8bd6"
],
[
"e",
"b37deeed6bf42ce45638d43efc3b3a47d9347351784fe8d5ef761d7b6cce15be",
"wss://relay.momostr.pink/",
"reply",
"f2c70b8ca7b5a21f6aff975b2517e97e4fc45331fbcac750392acfc983246e25"
],
[
"p",
"134923ad77a79e45dddf47a4ce8b36e1fc1270f0df735f34056598759a5c8bd6",
"wss://relay.momostr.pink/"
],
[
"p",
"f2c70b8ca7b5a21f6aff975b2517e97e4fc45331fbcac750392acfc983246e25",
"wss://relay.momostr.pink/"
],
[
"client",
"Amethyst"
]
],
"content": "At least 16GB of VRAM.\n\nQ4 is roughly half a byte per parameter, and you need space for context too",
"sig": "80769c6ad2dff9d790c46cfd235b273f1d2f1915e508adadc920959b5696cc8b1f139e8bdb52fab195f5732c89fd2078ad851646a69adf73b6822453b6088007"
}