Mark B

markmonger's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in peonist-ai/halogen-qwen3.8-flash-next 2 days ago

Halogen Server 4-bit Inference Question

1

#11 opened 2 days ago by

markmonger

New activity in JC1DA/Qwen3.8-27B-DavidAU-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-INT4-W4A16 3 days ago

thanks for good job

🔥 1

3

#2 opened 21 days ago by

wcflyfish

New activity in DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored 19 days ago

Idea: Model Variation "Comparison Matrix"

👍 5

#9 opened 19 days ago by

markmonger

New activity in Danny-Dasilva/gemma-4-12B-it-antidoom-W4A16-GPTQ-g32-DSpark about 2 months ago

vLLM version

1

#1 opened 2 months ago by

McCheng

New activity in drowzeys/DeepSeek-V4-Flash-DSpark-NVFP4-KV-1.5M-CTX-2xDGX-Spark 3 months ago

Docker missing?

#1 opened 3 months ago by

markmonger

New activity in DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF 3 months ago

I am getting very good results with this model but its a bit slow, any chance for MTP?

34

#17 opened 4 months ago by

bissli

New activity in mradermacher/spikingkiki-27b-i1-GGUF 3 months ago

Broken quants?

#1 opened 3 months ago by

markmonger

New activity in mradermacher/spikingkiki-122b-a10b-i1-GGUF 3 months ago

Broken quants?

#1 opened 3 months ago by

markmonger

New activity in PiehSoft/Qwen3.6-40B-Deckard-MTP 3 months ago

Single-needle retrieval holds to 1M tokens (3.85x YaRN) + the llama.cpp context-cap workaround.

🚀 2

1

#3 opened 3 months ago by

WTPieh

New activity in unsloth/Kimi-K2.7-Code-GGUF 4 months ago

IQ2_XXS vs IQ2_M

#8 opened 4 months ago by

markmonger

New activity in DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF 4 months ago

Performance/coherence issues.

3

#15 opened 4 months ago by

Trickhat

Are any future variants planned?

7

#13 opened 4 months ago by

markmonger

New activity in mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-GGUF 4 months ago

Is IBalanced or iQuality having the highest quality of output?

👍 2

2

#4 opened 4 months ago by

jackalxyz

New activity in mradermacher/Qwen3.5-122B-A10B-Claude-Distill-v2-i1-GGUF 4 months ago

Any chance for a "combo" model?

1

#1 opened 4 months ago by

markmonger

New activity in dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-NVFP4-GB10 4 months ago

Can't get this running on DGX Spark

7

#2 opened 4 months ago by

Ahmed00Samir

Can't get this running on DGX Spark

7

#2 opened 4 months ago by

Ahmed00Samir

Can't get this running on DGX Spark

7

#2 opened 4 months ago by

Ahmed00Samir