aaiiaxom commited on
Commit
d8d2583
·
verified ·
1 Parent(s): d710dc6

Upload 8 files

Browse files
Files changed (8) hide show
  1. README.md +59 -0
  2. config.json +5 -0
  3. decoder.onnx +3 -0
  4. encoder.onnx +3 -0
  5. metadata.json +11 -0
  6. token_list.json +81 -0
  7. variance_predictor.onnx +3 -0
  8. vocoder.onnx +3 -0
README.md CHANGED
@@ -1,3 +1,62 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - brx
4
+
5
+ tags:
6
+ - text-to-speech
7
+ - bodo
8
+ - tts
9
+ - espnet
10
+ - fastspeech2
11
+ - multiband-melgan
12
+
13
  license: apache-2.0
14
+
15
+ library_name: espnet
16
+ pipeline_tag: text-to-speech
17
  ---
18
+
19
+ # AAII - Bodo Neural TTS Model
20
+
21
+ This model has been trained on the female voice subset of the **[AI4Bharat Rasa Bodo TTS dataset](https://huggingface.co/datasets/ai4bharat/Rasa)** and is built using an **ESPnet-based FastSpeech2 + Multi-band MelGAN** TTS pipeline.
22
+
23
+ ---
24
+ ## Model Overview
25
+
26
+ The TTS system is based on:
27
+ - **Acoustic model:** FastSpeech2
28
+ - **Vocoder:** Multi-band MelGAN
29
+ - **Toolkit:** ESPnet
30
+ - **Language:** Bodo (`brx`)
31
+ - **Training data:** [AI4Bharat Rasa Bodo TTS Dataset](https://huggingface.co/datasets/ai4bharat/Rasa) (Female Voice)
32
+ - **Input:** Bodo Devanagari text
33
+ - **Output:** Bodo speech waveform
34
+
35
+ The goal of this model is to provide a lightweight and usable Bodo neural TTS system for browser-based and community-focused language technology applications.
36
+
37
+ ---
38
+ ## Applications Built Using This Model
39
+
40
+ Using this Bodo model, we have developed two free public-facing Bodo reading tools.
41
+
42
+ ### 1. Bodo Text-to-Speech Web App
43
+ A browser-based Bodo TTS web application that can read Bodo Devanagari text directly from webpages, pasted text, or uploaded photos/PDFs (via on-device OCR).
44
+
45
+ **Key features:**
46
+ - Reads Bodo Devanagari text
47
+ - Supports webpage URL input
48
+ - Supports direct text input
49
+ - Supports Photo and PDF text extraction (OCR)
50
+ - Runs speech synthesis inside the browser using WebAssembly / WebGPU
51
+ - No server-side API call required for synthesis
52
+ - Model is cached in the browser after first load
53
+ - Can work offline after the model is loaded
54
+ - Useful for accessibility, reading support, education, and Bodo digital content consumption
55
+
56
+ ---
57
+ ## Acknowledgement
58
+ We express our sincere gratitude to **[AI4Bharat](https://ai4bharat.iitm.ac.in/)** for creating and open-sourcing the **[Rasa Dataset](https://huggingface.co/datasets/ai4bharat/Rasa)**. The training of this model relies on the female Bodo voice subset provided in the Rasa corpus.
59
+
60
+ ---
61
+ ## Disclaimer
62
+ This is an early version of the Bodo TTS model. The model is designed to generate clear and natural Bodo speech, but pronunciation, prosody, and expressiveness may still improve with further data tuning and future model updates.
config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "model_type": "bodo-tts",
3
+ "language": "brx",
4
+ "task": "text-to-speech"
5
+ }
decoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5767d1c0fcabe5fd7c19b61b560e53ab17d4b30616e75c3902d9c403442051d0
3
+ size 78723849
encoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca93e307b0058bba4789dd532c2f1673647a75bffbe1c2d2c5b3322e12c36c73
3
+ size 73966547
metadata.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "idim": 79,
3
+ "odim": 80,
4
+ "adim": 384,
5
+ "eos": 78,
6
+ "padding_idx": 0,
7
+ "reduction_factor": 1,
8
+ "fs": 16000,
9
+ "export_type": "split_v2",
10
+ "vocab_size": 79
11
+ }
token_list.json ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "<blank>": 0,
3
+ "<unk>": 1,
4
+ "|": 2,
5
+ "ा": 3,
6
+ "न": 4,
7
+ "ो": 5,
8
+ "ि": 6,
9
+ "र": 7,
10
+ "ब": 8,
11
+ "स": 9,
12
+ "य": 10,
13
+ "म": 11,
14
+ "ं": 12,
15
+ "्": 13,
16
+ "ज": 14,
17
+ "े": 15,
18
+ "ग": 16,
19
+ "ल": 17,
20
+ "द": 18,
21
+ "ख": 19,
22
+ "थ": 20,
23
+ "आ": 21,
24
+ "व": 22,
25
+ "ु": 23,
26
+ "फ": 24,
27
+ ".": 25,
28
+ "ह": 26,
29
+ "ै": 27,
30
+ "ौ": 28,
31
+ "क": 29,
32
+ "ट": 30,
33
+ ",": 31,
34
+ "इ": 32,
35
+ "'": 33,
36
+ "प": 34,
37
+ "ड": 35,
38
+ "ए": 36,
39
+ "त": 37,
40
+ "ङ": 38,
41
+ "उ": 39,
42
+ "ी": 40,
43
+ "अ": 41,
44
+ "भ": 42,
45
+ "श": 43,
46
+ "?": 44,
47
+ "च": 45,
48
+ "!": 46,
49
+ "ओ": 47,
50
+ "ध": 48,
51
+ "ष": 49,
52
+ "ण": 50,
53
+ "ू": 51,
54
+ "ई": 52,
55
+ "़": 53,
56
+ "औ": 54,
57
+ "घ": 55,
58
+ "ृ": 56,
59
+ "ठ": 57,
60
+ "झ": 58,
61
+ "छ": 59,
62
+ "ढ": 60,
63
+ "ड़": 61,
64
+ "ः": 62,
65
+ "ऋ": 63,
66
+ "ऐ": 64,
67
+ "ञ": 65,
68
+ "ऊ": 66,
69
+ "ढ़": 67,
70
+ "॰": 68,
71
+ "ॅ": 69,
72
+ "I": 70,
73
+ "ॊ": 71,
74
+ "ॉ": 72,
75
+ ":": 73,
76
+ "ँ": 74,
77
+ "’": 75,
78
+ "‍": 76,
79
+ "3": 77,
80
+ "<sos/eos>": 78
81
+ }
variance_predictor.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fc7c6ea7a0c068ebfee175587c454aaf64d37bed6d307112346af77470318ac
3
+ size 11188900
vocoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:224a36a869d48b7c7dbe4353d31fec20b153a8806b992f11ec0b56a8035f2db8
3
+ size 10164577