unsloth
/

Nemotron-3-Nano-30B-A3B-GGUF

Text Generation

Model card Files Files and versions

Resources

View closed (2)

Plan to provide more quantized models can run on an edge device?

#8 opened about 1 hour ago by

Missing Native Tool in unsloth models?

#7 opened 3 days ago by

1 M‑token context running smoothly at ~25 t/s on a 12 GB RX 6700 XT is nothing short of impressive.

#6 opened 3 days ago by

What customizations have unsloth done with their Nemotron quants?

#5 opened 5 days ago by

<think>...</think> in the response

#3 opened 6 days ago by

Should UD-Q6_K_XL identical to Q6_K.gguf?

#1 opened 7 days ago by