Instructions to use DOSaAI/VALa1Tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DOSaAI/VALa1Tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("DOSaAI/VALa1Tokenizer", dtype="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "model_type": "tokenizer", | |
| "tokenizer_type": "custom", | |
| "tokenizer_name": "vala1tokenizer", | |
| "description": "Custom tokenizer implementation written in Python.", | |
| "license": "Apache-2.0", | |
| "language": "python", | |
| "repository_url": "https://github.com/CufoTv/VALa1Tokenizer", | |
| "tags": [ | |
| "tokenizer", | |
| "custom-tokenizer", | |
| "python" | |
| ], | |
| "download_url": "https://huggingface.co/models/DOSaAI/vala1tokenizer", | |
| "version": "0.1" | |
| } |