Don on Nostr: There's a slider on most models' huggingface you can use. Make an account, enter your ...

There's a slider on most models' huggingface you can use. Make an account, enter your hardware and it will tell you exactly which models will fit comfortably, which might fit and which will definitely not fit. I'm guessing an extreme compression iq3 or q2 Qwen 27b variant should fit.