Jarbas commited on
Commit
e13a99c
·
verified ·
1 Parent(s): f07e8bd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +82 -0
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - pt
4
+ license: cc-by-nc-4.0
5
+ library_name: onnx-asr
6
+ pipeline_tag: automatic-speech-recognition
7
+ tags:
8
+ - automatic-speech-recognition
9
+ - speech-to-text
10
+ - ctc
11
+ - fastconformer
12
+ - nemo
13
+ - onnx
14
+ - openvoiceos
15
+ base_model: nvidia/stt_pt_fastconformer_hybrid_large_pc
16
+ ---
17
+
18
+ # stt_pt_fastconformer_hybrid_large_pc_onnx
19
+
20
+ Portuguese speech-to-text model. ONNX export of
21
+ [nvidia/stt_pt_fastconformer_hybrid_large_pc](https://huggingface.co/nvidia/stt_pt_fastconformer_hybrid_large_pc) — an NVIDIA NeMo **FastConformer-Hybrid** CTC model — for
22
+ [onnx-asr](https://github.com/istupakov/onnx-asr). Runs offline with ONNX
23
+ Runtime; PyTorch and NeMo are not required.
24
+
25
+ Part of the [OpenVoiceOS STT/ASR ONNX collection](https://huggingface.co/collections/OpenVoiceOS/stt-asr-onnx-699321e8732462509c642fbe).
26
+
27
+ ## Files
28
+
29
+ | File | Purpose |
30
+ |---|---|
31
+ | `model.onnx` | Encoder + CTC head, fp32 |
32
+ | `vocab.txt` | Token vocabulary (`<token> <id>` per line, `▁` = space, `<blk>` = CTC blank) |
33
+ | `config.json` | onnx-asr metadata: `model_type: nemo-conformer-ctc`, `features_size: 80`, `subsampling_factor: 8` |
34
+
35
+ There is no int8 variant: these architectures are convolution-dominated, and
36
+ dynamic quantization produces `ConvInteger` nodes that ONNX Runtime cannot
37
+ execute on CPU. int8 requires static QDQ quantization with calibration data.
38
+
39
+ ## Usage
40
+
41
+ With [onnx-asr](https://github.com/istupakov/onnx-asr) (`pip install onnx-asr[cpu,hub]`):
42
+
43
+ ```python
44
+ import onnx_asr
45
+
46
+ model = onnx_asr.load_model("OpenVoiceOS/stt_pt_fastconformer_hybrid_large_pc_onnx")
47
+ print(model.recognize("speech.wav")) # 16 kHz PCM wav
48
+ ```
49
+
50
+ With [OpenVoiceOS](https://github.com/OpenVoiceOS), through
51
+ [ovos-stt-plugin-onnx-asr](https://github.com/OpenVoiceOS/ovos-stt-plugin-onnx-asr)
52
+ (`mycroft.conf`):
53
+
54
+ ```json
55
+ {
56
+ "stt": {
57
+ "module": "ovos-stt-plugin-onnx-asr",
58
+ "ovos-stt-plugin-onnx-asr": {
59
+ "model": "OpenVoiceOS/stt_pt_fastconformer_hybrid_large_pc_onnx"
60
+ }
61
+ }
62
+ }
63
+ ```
64
+
65
+ ## Export and verification
66
+
67
+ Exported from the original checkpoint with NeMo's `model.export()`
68
+ (CTC decoder head of the hybrid model; see the [conversion guide](https://github.com/istupakov/onnx-asr/blob/main/docs/conversion.md)).
69
+ The `subsampling_factor` was measured empirically on the exported graph, and
70
+ the export was verified differentially: the ONNX model and the original NeMo
71
+ checkpoint produce identical transcriptions on a reference clip.
72
+
73
+ ## Accuracy, training data and limitations
74
+
75
+ See the [source model card](https://huggingface.co/nvidia/stt_pt_fastconformer_hybrid_large_pc) for benchmark results, training
76
+ corpora and known limitations. This repo changes the runtime, not the weights.
77
+
78
+ ## Related projects
79
+
80
+ - [onnx-asr](https://github.com/istupakov/onnx-asr) — ASR inference with ONNX Runtime
81
+ - [ovos-stt-plugin-onnx-asr](https://github.com/OpenVoiceOS/ovos-stt-plugin-onnx-asr) — OpenVoiceOS STT plugin
82
+ - [NVIDIA NeMo](https://github.com/NVIDIA/NeMo) — framework the source model was trained with