maya1-mlx-4bit / README.md
0xhb's picture
Initial upload: Maya1 MLX 4-bit quantized
50f595b verified
|
Raw
History Blame Contribute Delete
1.99 kB
metadata
pipeline_tag: text-to-speech
tags:
  - mlx
  - tts
  - maya1
  - apple-silicon
  - snac
base_model: maya-research/maya1
library_name: mlx

maya1-mlx-4bit

MLX 4-bit quantized conversion of maya-research/maya1 for text-to-speech on Apple Silicon. Converted using mlx-lm.

Fastest variant. Runs above real-time on M4 Max with some quality degradation. See also: bf16 (highest quality) and 8-bit (recommended balance).

Benchmarks (M4 Max, 36GB)

Variant Size Tokens/s Real-time factor
bf16 6.2 GB ~51 tok/s 0.50x
8-bit 3.3 GB ~91 tok/s 0.82x
4-bit 1.8 GB ~108 tok/s 1.58x

Quick Start

Requires macOS with Apple Silicon and uv.

# From a text file
uv run tts.py input.txt -o output.wav

# From stdin
echo "Hello world" | uv run tts.py - -o hello.wav

# With a custom voice description
uv run tts.py input.txt -o output.wav -d "Deep male voice, British accent, slow pacing."

CLI Options

Option Default Description
input (required) Input text file path, or - for stdin
-o, --output output.wav Output WAV file path
-d, --description Calm/clear female voice Voice description prompt
-m, --model . Path to MLX model directory
--max-chars 200 Max characters per chunk
--max-tokens 2048 Max tokens per chunk
--temperature 0.4 Sampling temperature
--top-p 0.9 Top-p sampling
--repetition-penalty 1.1 Repetition penalty

Requirements

  • macOS with Apple Silicon (M1 or later)
  • uv (dependencies are declared inline via PEP 723)