MoE models for local inference on two 5060ti 16gb cards + 64 gb ram workstation
-
unsloth/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 35B • Updated • 1.75M • 1.83k -
huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated-MTP-GGUF
Image-Text-to-Text • 36B • Updated • 4.96M • 129 -
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF
Image-Text-to-Text • 177B • Updated • 7.53M • 1.32k -
openbmb/MiniCPM-V-4.7-35B-A3B-gguf
Image-Text-to-Text • 35B • Updated • 427k • 471