localLLMrig

localllmrig's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF about 5 hours ago

Memory needed per quant at 8K context (file sizes + KV estimate)

👍👀 3

5

#2 opened 11 days ago by

localllmrig

New activity in unsloth/MiniMax-M3.1-Flash-GGUF about 5 hours ago

Memory needed vs common local setups (UD-Q4_K_XL 249.4 GB)

4

#2 opened 11 days ago by

localllmrig

New activity in LiquidAI/LFM3-Omni-2B-GGUF about 5 hours ago

Memory fit per quant (GGUF + mmproj + KV at 32K/128K)

#4 opened about 5 hours ago by

localllmrig

New activity in ccore/Qwen3.5-4B-3D-Coder 5 days ago

Fit table: Q4_K_M vs Q8_0 at the recommended ~72K context

❤️ 3

#8 opened 5 days ago by

localllmrig

New activity in kaitchup/Qwen3.8-27B-SLQ-GGUF 6 days ago

Memory needed per file on 24/32 GB cards (file sizes + KV estimate)

#3 opened 6 days ago by

localllmrig

New activity in LiquidAI/LFM3-1.7B-GGUF 6 days ago

Memory needed per quant at 32K and 256K context (file sizes + KV estimate)

#3 opened 6 days ago by

localllmrig

New activity in XHToken/Spark-X2.6-4B-GGUF 6 days ago

Memory needed per quant (file sizes + KV cache at 32K / 128K / 1M)

👍 3

#6 opened 6 days ago by

localllmrig

New activity in KRAFTON/Raon-1-mini-preview-gguf 7 days ago

Memory needed per quant (file sizes + KV cache estimate)

❤️ 2

#2 opened 7 days ago by

localllmrig

New activity in unsloth/Ornith-1.5-122B-GGUF 7 days ago

Quantization request: ~66 GB coding/tool-use recipe for 3x RTX 3090

2

#8 opened 8 days ago by

groxaxo

New activity in bartowski/Nanbeige_Nanbeige4.3-33B-GGUF 7 days ago

VRAM / Mac fit table by quant (8K context)

#1 opened 7 days ago by

localllmrig

New activity in basecompute/Qwen3.8-27B-BaseQuant-V1 9 days ago

Memory needed for Small / Medium / Large at 8K context

🔥 1

2

#1 opened 10 days ago by

localllmrig

New activity in RecursiveSI/flint 9 days ago

Memory needed per quant (file sizes + KV cache estimate)

4

#8 opened 13 days ago by

localllmrig

New activity in ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF 9 days ago

how to run DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF on 128gb mac？

2

#7 opened 10 days ago by

fut888

New activity in kin2341/sophosympatheia_Glistening-Gem-31B-v2.1-GGUF 10 days ago

Memory needed per quant at 8K context

#1 opened 10 days ago by

localllmrig

New activity in unsloth/LFM2.5-24B-A2B-GGUF 11 days ago

Memory needed per quant (file sizes + KV cache estimate)

#5 opened 11 days ago by

localllmrig

New activity in tencent/Hy-Memory-30B-A3B-GGUF 12 days ago

Memory needed per quant (file sizes + KV cache estimate)

#1 opened 12 days ago by

localllmrig

New activity in RecursiveSI/flint 13 days ago

Memory needed per quant (file sizes + KV cache estimate)

4

#8 opened 13 days ago by

localllmrig