Add built-in phoneme frontend metadata
Browse files- README.md +18 -8
- vits-ljspeech-F16.gguf +2 -2
- vits-ljspeech-F32.gguf +2 -2
- vits-ljspeech-Q8_MIXED.gguf +2 -2
README.md
CHANGED
|
@@ -22,6 +22,10 @@ synthesize_cpp:
|
|
| 22 |
quality_evaluation: not_run
|
| 23 |
sample_rate_hz: 22050
|
| 24 |
voice_count: 1
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
profiles:
|
| 26 |
- F32
|
| 27 |
- F16
|
|
@@ -48,9 +52,9 @@ Voice without requiring Voice selection.
|
|
| 48 |
|
| 49 |
| Profile | Download | Size | Tensor storage | SHA-256 |
|
| 50 |
| --- | --- | ---: | --- | --- |
|
| 51 |
-
| F32 | [vits-ljspeech-F32.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F32.gguf) | 113.2 MB (113,
|
| 52 |
-
| F16 | [vits-ljspeech-F16.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F16.gguf) | 70.5 MB (70,453,
|
| 53 |
-
| Q8_MIXED | [vits-ljspeech-Q8_MIXED.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-Q8_MIXED.gguf) | 52.9 MB (52,890,
|
| 54 |
|
| 55 |
All profiles use the same VITS architecture and public synthesize.cpp API. The
|
| 56 |
profile name describes a versioned storage policy, not the language or Execution
|
|
@@ -66,7 +70,7 @@ case. CUDA placement contained zero executable CPU fallback nodes.
|
|
| 66 |
|
| 67 |
| Profile | CPU max PCM drift | DGX Spark CUDA max PCM drift | RTX 4070 SUPER CUDA max PCM drift |
|
| 68 |
| --- | ---: | ---: | ---: |
|
| 69 |
-
| F32 | 0.0002223924 | 0.
|
| 70 |
| F16 | 0.0171255 | 0.20995625 | 0.20820463 |
|
| 71 |
| Q8_MIXED | 0.36679696 | 0.329434 | 0.34679114 |
|
| 72 |
|
|
@@ -82,9 +86,15 @@ This package has one fixed package-default Voice and does not expose a preset
|
|
| 82 |
speaker catalog. It produces 22050 Hz mono F32
|
| 83 |
audio. Callers omit Voice selection; the package always uses its trained Voice.
|
| 84 |
|
| 85 |
-
|
| 86 |
-
`
|
| 87 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 88 |
|
| 89 |
## Usage
|
| 90 |
|
|
@@ -102,7 +112,7 @@ hf download jiangzhuo9357/vits-ljspeech-gguf vits-ljspeech-F16.gguf \
|
|
| 102 |
build/bin/synthesize-cli \
|
| 103 |
--model models/vits-ljspeech/vits-ljspeech-F16.gguf \
|
| 104 |
--output output.wav \
|
| 105 |
-
--
|
| 106 |
--language en \
|
| 107 |
--seed 0
|
| 108 |
```
|
|
|
|
| 22 |
quality_evaluation: not_run
|
| 23 |
sample_rate_hz: 22050
|
| 24 |
voice_count: 1
|
| 25 |
+
input_kinds:
|
| 26 |
+
- phonemes_utf8
|
| 27 |
+
- token_ids
|
| 28 |
+
frontend_provider: synthesize.symbol_map
|
| 29 |
profiles:
|
| 30 |
- F32
|
| 31 |
- F16
|
|
|
|
| 52 |
|
| 53 |
| Profile | Download | Size | Tensor storage | SHA-256 |
|
| 54 |
| --- | --- | ---: | --- | --- |
|
| 55 |
+
| F32 | [vits-ljspeech-F32.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F32.gguf) | 113.2 MB (113,245,056 bytes) | 460 F32 | `bd17e44c7c2d761d33c1527059bd3921f9d3fa9d46bd73b3e020d746a8b7db7b` |
|
| 56 |
+
| F16 | [vits-ljspeech-F16.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F16.gguf) | 70.5 MB (70,453,568 bytes) | 342 F32 + 118 F16 | `5fc428ba97416cc164055f509af1b9e120b089bd0bab792ad674c862411d7bca` |
|
| 57 |
+
| Q8_MIXED | [vits-ljspeech-Q8_MIXED.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-Q8_MIXED.gguf) | 52.9 MB (52,890,240 bytes) | 342 F32 + 4 F16 + 114 Q8_0 | `df95091f975e78088c4908c3f2adfc381cfa234c3f520ddd3ffe10160ff12ba1` |
|
| 58 |
|
| 59 |
All profiles use the same VITS architecture and public synthesize.cpp API. The
|
| 60 |
profile name describes a versioned storage policy, not the language or Execution
|
|
|
|
| 70 |
|
| 71 |
| Profile | CPU max PCM drift | DGX Spark CUDA max PCM drift | RTX 4070 SUPER CUDA max PCM drift |
|
| 72 |
| --- | ---: | ---: | ---: |
|
| 73 |
+
| F32 | 0.0002223924 | 0.20982037 | 0.2027478628 |
|
| 74 |
| F16 | 0.0171255 | 0.20995625 | 0.20820463 |
|
| 75 |
| Q8_MIXED | 0.36679696 | 0.329434 | 0.34679114 |
|
| 76 |
|
|
|
|
| 86 |
speaker catalog. It produces 22050 Hz mono F32
|
| 87 |
audio. Callers omit Voice selection; the package always uses its trained Voice.
|
| 88 |
|
| 89 |
+
This package accepts UTF-8 phoneme strings through the built-in
|
| 90 |
+
`synthesize.symbol_map` frontend, and also accepts exact token IDs. The frontend
|
| 91 |
+
validates UTF-8, maps each Unicode scalar through the symbol table embedded in
|
| 92 |
+
the GGUF, and applies the model's blank-insertion rule.
|
| 93 |
+
|
| 94 |
+
The built-in frontend does not perform grapheme-to-phoneme conversion or text
|
| 95 |
+
normalization. Callers starting from raw text must currently run a compatible
|
| 96 |
+
G2P frontend externally. The runtime does not silently invoke eSpeak or download
|
| 97 |
+
a frontend.
|
| 98 |
|
| 99 |
## Usage
|
| 100 |
|
|
|
|
| 112 |
build/bin/synthesize-cli \
|
| 113 |
--model models/vits-ljspeech/vits-ljspeech-F16.gguf \
|
| 114 |
--output output.wav \
|
| 115 |
+
--phonemes "ˈeɪ." \
|
| 116 |
--language en \
|
| 117 |
--seed 0
|
| 118 |
```
|
vits-ljspeech-F16.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5fc428ba97416cc164055f509af1b9e120b089bd0bab792ad674c862411d7bca
|
| 3 |
+
size 70453568
|
vits-ljspeech-F32.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bd17e44c7c2d761d33c1527059bd3921f9d3fa9d46bd73b3e020d746a8b7db7b
|
| 3 |
+
size 113245056
|
vits-ljspeech-Q8_MIXED.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:df95091f975e78088c4908c3f2adfc381cfa234c3f520ddd3ffe10160ff12ba1
|
| 3 |
+
size 52890240
|