jiangzhuo9357 commited on
Commit
53273ee
·
verified ·
1 Parent(s): 95a4bac

Add built-in phoneme frontend metadata

Browse files
README.md CHANGED
@@ -22,6 +22,10 @@ synthesize_cpp:
22
  quality_evaluation: not_run
23
  sample_rate_hz: 22050
24
  voice_count: 1
 
 
 
 
25
  profiles:
26
  - F32
27
  - F16
@@ -48,9 +52,9 @@ Voice without requiring Voice selection.
48
 
49
  | Profile | Download | Size | Tensor storage | SHA-256 |
50
  | --- | --- | ---: | --- | --- |
51
- | F32 | [vits-ljspeech-F32.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F32.gguf) | 113.2 MB (113,244,864 bytes) | 460 F32 | `44d5fbfab510ad39b26a5224d77cf9e7d7cd8e2e520bdbdf76a42d62e4f929aa` |
52
- | F16 | [vits-ljspeech-F16.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F16.gguf) | 70.5 MB (70,453,376 bytes) | 342 F32 + 118 F16 | `ac14fd237532c75e485649e965009ddbfedc20ddbc69c157329abc11a2940d31` |
53
- | Q8_MIXED | [vits-ljspeech-Q8_MIXED.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-Q8_MIXED.gguf) | 52.9 MB (52,890,048 bytes) | 342 F32 + 4 F16 + 114 Q8_0 | `ac026b3731ac627c44043bfd542933a0d277c6a1ac72f9e473b9334208308302` |
54
 
55
  All profiles use the same VITS architecture and public synthesize.cpp API. The
56
  profile name describes a versioned storage policy, not the language or Execution
@@ -66,7 +70,7 @@ case. CUDA placement contained zero executable CPU fallback nodes.
66
 
67
  | Profile | CPU max PCM drift | DGX Spark CUDA max PCM drift | RTX 4070 SUPER CUDA max PCM drift |
68
  | --- | ---: | ---: | ---: |
69
- | F32 | 0.0002223924 | 0.0007436508 | 0.0009770896 |
70
  | F16 | 0.0171255 | 0.20995625 | 0.20820463 |
71
  | Q8_MIXED | 0.36679696 | 0.329434 | 0.34679114 |
72
 
@@ -82,9 +86,15 @@ This package has one fixed package-default Voice and does not expose a preset
82
  speaker catalog. It produces 22050 Hz mono F32
83
  audio. Callers omit Voice selection; the package always uses its trained Voice.
84
 
85
- The current VITS package consumes token IDs produced by the pinned upstream
86
- `english_cleaners2` frontend. The portable runtime does not silently run eSpeak
87
- or download a frontend.
 
 
 
 
 
 
88
 
89
  ## Usage
90
 
@@ -102,7 +112,7 @@ hf download jiangzhuo9357/vits-ljspeech-gguf vits-ljspeech-F16.gguf \
102
  build/bin/synthesize-cli \
103
  --model models/vits-ljspeech/vits-ljspeech-F16.gguf \
104
  --output output.wav \
105
- --token-ids "0,156,0,47,0,102,0,4,0" \
106
  --language en \
107
  --seed 0
108
  ```
 
22
  quality_evaluation: not_run
23
  sample_rate_hz: 22050
24
  voice_count: 1
25
+ input_kinds:
26
+ - phonemes_utf8
27
+ - token_ids
28
+ frontend_provider: synthesize.symbol_map
29
  profiles:
30
  - F32
31
  - F16
 
52
 
53
  | Profile | Download | Size | Tensor storage | SHA-256 |
54
  | --- | --- | ---: | --- | --- |
55
+ | F32 | [vits-ljspeech-F32.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F32.gguf) | 113.2 MB (113,245,056 bytes) | 460 F32 | `bd17e44c7c2d761d33c1527059bd3921f9d3fa9d46bd73b3e020d746a8b7db7b` |
56
+ | F16 | [vits-ljspeech-F16.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-F16.gguf) | 70.5 MB (70,453,568 bytes) | 342 F32 + 118 F16 | `5fc428ba97416cc164055f509af1b9e120b089bd0bab792ad674c862411d7bca` |
57
+ | Q8_MIXED | [vits-ljspeech-Q8_MIXED.gguf](https://huggingface.co/jiangzhuo9357/vits-ljspeech-gguf/resolve/main/vits-ljspeech-Q8_MIXED.gguf) | 52.9 MB (52,890,240 bytes) | 342 F32 + 4 F16 + 114 Q8_0 | `df95091f975e78088c4908c3f2adfc381cfa234c3f520ddd3ffe10160ff12ba1` |
58
 
59
  All profiles use the same VITS architecture and public synthesize.cpp API. The
60
  profile name describes a versioned storage policy, not the language or Execution
 
70
 
71
  | Profile | CPU max PCM drift | DGX Spark CUDA max PCM drift | RTX 4070 SUPER CUDA max PCM drift |
72
  | --- | ---: | ---: | ---: |
73
+ | F32 | 0.0002223924 | 0.20982037 | 0.2027478628 |
74
  | F16 | 0.0171255 | 0.20995625 | 0.20820463 |
75
  | Q8_MIXED | 0.36679696 | 0.329434 | 0.34679114 |
76
 
 
86
  speaker catalog. It produces 22050 Hz mono F32
87
  audio. Callers omit Voice selection; the package always uses its trained Voice.
88
 
89
+ This package accepts UTF-8 phoneme strings through the built-in
90
+ `synthesize.symbol_map` frontend, and also accepts exact token IDs. The frontend
91
+ validates UTF-8, maps each Unicode scalar through the symbol table embedded in
92
+ the GGUF, and applies the model's blank-insertion rule.
93
+
94
+ The built-in frontend does not perform grapheme-to-phoneme conversion or text
95
+ normalization. Callers starting from raw text must currently run a compatible
96
+ G2P frontend externally. The runtime does not silently invoke eSpeak or download
97
+ a frontend.
98
 
99
  ## Usage
100
 
 
112
  build/bin/synthesize-cli \
113
  --model models/vits-ljspeech/vits-ljspeech-F16.gguf \
114
  --output output.wav \
115
+ --phonemes "ˈeɪ." \
116
  --language en \
117
  --seed 0
118
  ```
vits-ljspeech-F16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac14fd237532c75e485649e965009ddbfedc20ddbc69c157329abc11a2940d31
3
- size 70453376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fc428ba97416cc164055f509af1b9e120b089bd0bab792ad674c862411d7bca
3
+ size 70453568
vits-ljspeech-F32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:44d5fbfab510ad39b26a5224d77cf9e7d7cd8e2e520bdbdf76a42d62e4f929aa
3
- size 113244864
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd17e44c7c2d761d33c1527059bd3921f9d3fa9d46bd73b3e020d746a8b7db7b
3
+ size 113245056
vits-ljspeech-Q8_MIXED.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac026b3731ac627c44043bfd542933a0d277c6a1ac72f9e473b9334208308302
3
- size 52890048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df95091f975e78088c4908c3f2adfc381cfa234c3f520ddd3ffe10160ff12ba1
3
+ size 52890240