Thai
tokenizers
thai
tokenizer
nlp
subword
Thaitokenizer / tokenizer_config.json

Commit History

  1. Add tokenizer configuration file with special tokens and settings

    Nattapong Tapachoom
    12f0d60
  2. Delete tokenizer_config.json

    Verified signature
    8c74559

  1. Upload folder using huggingface_hub

    Verified signature
    a408e1e