---
library_name: mlx
base_model: nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16
license: other
pipeline_tag: text-generation
tags:
- mlx
- mlx-lm
- quantized
- 4-bit
- base_model:nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16
---

[![Open in MLXHub](https://mlxhub.app/assets/badge-open-in-mlxhub.svg)](https://mlxhub.app/open-model?repo=DreamFoundries/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-4bit)

# NVIDIA-Nemotron-3-Super-120B-A12B-BF16 MLX 4-bit

This repository contains an MLX-LM conversion of [nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16](https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16).

## Conversion Details

- Original model: `nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16`
- Model family: Nemotron 3
- Source model type: `nemotron_h`
- Model size: 123,611,012,096 parameters
- Quantization: MLX-LM affine quantization
- Bits: 4-bit
- Group size: 64
- Local MLX folder size at upload time: 63.35 GiB
- Local safetensors weight size at upload time: 63.33 GiB

## Usage

```bash
mlx_lm.generate --model DreamFoundries/NVIDIA-Nemotron-3-Super-120B-A12B-BF16-4bit --prompt "Hello" --max-tokens 64
```

## Benchmarks

No comparative benchmarks have been run yet. The repository does not currently provide quality, speed, memory, or benchmark comparisons against the original weights or other quantizations.

## License

This is a converted/quantized derivative of the original model. Please refer to the original model repository for the upstream license and usage terms: https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

---

[![Download MLXHub](https://mlxhub.app/assets/badge-download-mlxhub.svg)](https://apps.apple.com/app/apple-store/id6766485144?pt=121945436&ct=HuggingFace&mt=8)