Text-to-Speech
OpenVINO
kokoro
ov
tts
int8
mschuettlerTNG commited on
Commit
8813c54
·
verified ·
1 Parent(s): a5eb8bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +113 -1
README.md CHANGED
@@ -20,4 +20,116 @@ Check the [original model card](https://huggingface.co/hexgrad/Kokoro-82M) for l
20
 
21
  ## Legal information
22
 
23
- The original model is distributed under the [apache-2.0](https://choosealicense.com/licenses/apache-2.0/) license. More details can be found in the [original model card](https://huggingface.co/hexgrad/Kokoro-82M).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
  ## Legal information
22
 
23
+ The original model is distributed under the [apache-2.0](https://choosealicense.com/licenses/apache-2.0/) license. More details can be found in the [original model card](https://huggingface.co/hexgrad/Kokoro-82M).
24
+
25
+ ## Original Model Readme
26
+
27
+ **Kokoro** is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects.
28
+
29
+ <audio controls><source src="https://huggingface.co/hexgrad/Kokoro-82M/resolve/main/samples/HEARME.wav" type="audio/wav"></audio>
30
+
31
+ 🐈 **GitHub**: https://github.com/hexgrad/kokoro
32
+
33
+ 🚀 **Demo**: https://hf.co/spaces/hexgrad/Kokoro-TTS
34
+
35
+ > [!NOTE]
36
+ > As of April 2025, the market rate of Kokoro served over API is **under $1 per million characters of text input**, or under $0.06 per hour of audio output. (On average, 1000 characters of input is about 1 minute of output.) Sources: [ArtificialAnalysis/Replicate at 65 cents per M chars](https://artificialanalysis.ai/text-to-speech/model-family/kokoro#price) and [DeepInfra at 80 cents per M chars](https://deepinfra.com/hexgrad/Kokoro-82M).
37
+ >
38
+ > This is an Apache-licensed model, and Kokoro has been deployed in numerous projects and commercial APIs. We welcome the deployment of the model in real use cases.
39
+
40
+ > [!CAUTION]
41
+ > Fake websites like kokorottsai_com (snapshot: https://archive.ph/nRRnk) and kokorotts_net (snapshot: https://archive.ph/60opa) are likely scams masquerading under the banner of a popular model.
42
+ >
43
+ > Any website containing "kokoro" in its root domain (e.g. kokorottsai_com, kokorotts_net) is **NOT owned by and NOT affiliated with this model page or its author**, and attempts to imply otherwise are red flags.
44
+
45
+ - [Releases](#releases)
46
+ - [Usage](#usage)
47
+ - [EVAL.md](https://huggingface.co/hexgrad/Kokoro-82M/blob/main/EVAL.md) ↗️
48
+ - [SAMPLES.md](https://huggingface.co/hexgrad/Kokoro-82M/blob/main/SAMPLES.md) ↗️
49
+ - [VOICES.md](https://huggingface.co/hexgrad/Kokoro-82M/blob/main/VOICES.md) ↗️
50
+ - [Model Facts](#model-facts)
51
+ - [Training Details](#training-details)
52
+ - [Creative Commons Attribution](#creative-commons-attribution)
53
+ - [Acknowledgements](#acknowledgements)
54
+
55
+ ### Releases
56
+
57
+ | Model | Published | Training Data | Langs & Voices | SHA256 |
58
+ | ----- | --------- | ------------- | -------------- | ------ |
59
+ | **v1.0** | **2025 Jan 27** | **Few hundred hrs** | [**8 & 54**](https://huggingface.co/hexgrad/Kokoro-82M/blob/main/VOICES.md) | `496dba11` |
60
+ | [v0.19](https://huggingface.co/hexgrad/kLegacy/tree/main/v0.19) | 2024 Dec 25 | <100 hrs | 1 & 10 | `3b0c392f` |
61
+
62
+ | Training Costs | v0.19 | v1.0 | **Total** |
63
+ | -------------- | ----- | ---- | ----- |
64
+ | in A100 80GB GPU hours | 500 | 500 | **1000** |
65
+ | average hourly rate | $0.80/h | $1.20/h | **$1/h** |
66
+ | in USD | $400 | $600 | **$1000** |
67
+
68
+ ### Usage
69
+ You can run this basic cell on [Google Colab](https://colab.research.google.com/). [Listen to samples](https://huggingface.co/hexgrad/Kokoro-82M/blob/main/SAMPLES.md). For more languages and details, see [Advanced Usage](https://github.com/hexgrad/kokoro?tab=readme-ov-file#advanced-usage).
70
+ ```py
71
+ !pip install -q kokoro>=0.9.2 soundfile
72
+ !apt-get -qq -y install espeak-ng > /dev/null 2>&1
73
+ from kokoro import KPipeline
74
+ from IPython.display import display, Audio
75
+ import soundfile as sf
76
+ import torch
77
+ pipeline = KPipeline(lang_code='a')
78
+ text = '''
79
+ [Kokoro](/kˈOkəɹO/) is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, [Kokoro](/kˈOkəɹO/) can be deployed anywhere from production environments to personal projects.
80
+ '''
81
+ generator = pipeline(text, voice='af_heart')
82
+ for i, (gs, ps, audio) in enumerate(generator):
83
+ print(i, gs, ps)
84
+ display(Audio(data=audio, rate=24000, autoplay=i==0))
85
+ sf.write(f'{i}.wav', audio, 24000)
86
+ ```
87
+ Under the hood, `kokoro` uses [`misaki`](https://pypi.org/project/misaki/), a G2P library at https://github.com/hexgrad/misaki
88
+
89
+ ### Model Facts
90
+
91
+ **Architecture:**
92
+ - StyleTTS 2: https://arxiv.org/abs/2306.07691
93
+ - ISTFTNet: https://arxiv.org/abs/2203.02395
94
+ - Decoder only: no diffusion, no encoder release
95
+
96
+ **Architected by:** Li et al @ https://github.com/yl4579/StyleTTS2
97
+
98
+ **Trained by**: `@rzvzn` on Discord
99
+
100
+ **Languages:** Multiple
101
+
102
+ **Model SHA256 Hash:** `496dba118d1a58f5f3db2efc88dbdc216e0483fc89fe6e47ee1f2c53f18ad1e4`
103
+
104
+ ### Training Details
105
+
106
+ **Data:** Kokoro was trained exclusively on **permissive/non-copyrighted audio data** and IPA phoneme labels. Examples of permissive/non-copyrighted audio include:
107
+ - Public domain audio
108
+ - Audio licensed under Apache, MIT, etc
109
+ - Synthetic audio<sup>[1]</sup> generated by closed<sup>[2]</sup> TTS models from large providers<br/>
110
+ [1] https://copyright.gov/ai/ai_policy_guidance.pdf<br/>
111
+ [2] No synthetic audio from open TTS models or "custom voice clones"
112
+
113
+ **Total Dataset Size:** A few hundred hours of audio
114
+
115
+ **Total Training Cost:** About $1000 for 1000 hours of A100 80GB vRAM
116
+
117
+ ### Creative Commons Attribution
118
+
119
+ The following CC BY audio was part of the dataset used to train Kokoro v1.0.
120
+
121
+ | Audio Data | Duration Used | License | Added to Training Set After |
122
+ | ---------- | ------------- | ------- | --------------------------- |
123
+ | [Koniwa](https://github.com/koniwa/koniwa) `tnc` | <1h | [CC BY 3.0](https://creativecommons.org/licenses/by/3.0/deed.ja) | v0.19 / 22 Nov 2024 |
124
+ | [SIWIS](https://datashare.ed.ac.uk/handle/10283/2353) | <11h | [CC BY 4.0](https://datashare.ed.ac.uk/bitstream/handle/10283/2353/license_text) | v0.19 / 22 Nov 2024 |
125
+
126
+ ### Acknowledgements
127
+
128
+ - 🛠️ [@yl4579](https://huggingface.co/yl4579) for architecting StyleTTS 2.
129
+ - 🏆 [@Pendrokar](https://huggingface.co/Pendrokar) for adding Kokoro as a contender in the TTS Spaces Arena.
130
+ - 📊 Thank you to everyone who contributed synthetic training data.
131
+ - ❤️ Special thanks to all compute sponsors.
132
+ - 👾 Discord server: https://discord.gg/QuGxSWBfQy
133
+ - 🪽 Kokoro is a Japanese word that translates to "heart" or "spirit". It is also the name of an [AI in the Terminator franchise](https://terminator.fandom.com/wiki/Kokoro).
134
+
135
+ <img src="https://static0.gamerantimages.com/wordpress/wp-content/uploads/2024/08/terminator-zero-41-1.jpg" width="400" alt="kokoro" />