inference-optimization/MiniMax-M2.5.w8a8
229B • Updated • 193
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/MiniMax-M2.5.w4a16
34B • Updated • 123
inference-optimization/MiniMax-M2.5-BF16
Text Generation • 229B • Updated • 314
inference-optimization/DeepSeek-V4-Flash-FP8-NVFP4
163B • Updated • 54
inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK
Updated
inference-optimization/DeepSeek-V4-Flash-bf16
Updated
inference-optimization/ctest-Qwen3-8B-speculator.dflash
2B • Updated • 39
inference-optimization/MiniMax-M2.5-NVFP4
130B • Updated • 296
inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe
20B • Updated • 10
inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers
Updated • 13
inference-optimization/Qwen3.5-9B-quantized.w4a16
Image-Text-to-Text • 9B • Updated • 31
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor
26B • Updated • 32
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor
27B • Updated • 30
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor
27B • Updated • 27
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor
25B • Updated • 32
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 31
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 33
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor
23B • Updated • 32
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor
23B • Updated • 33
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor
23B • Updated • 30
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor
21B • Updated • 33
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 32
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 36
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor
19B • Updated • 33
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor
19B • Updated • 32
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor
19B • Updated • 32
inference-optimization/Qwen3.6-35B-A3B-NVFP4
Updated • 18
inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor
27B • Updated • 44
inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor
27B • Updated • 51
inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor
27B • Updated • 61