Fill-Mask
Transformers
Safetensors
English
ultrabert
encoder
masked-language-modeling
long-context
custom_code
Instructions to use dmis-lab/UltraBERT-150M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dmis-lab/UltraBERT-150M with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="dmis-lab/UltraBERT-150M", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("dmis-lab/UltraBERT-150M", trust_remote_code=True) model = AutoModelForMaskedLM.from_pretrained("dmis-lab/UltraBERT-150M", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
paper link missing
#1
by rony - opened
Thanks for the great work. However the current paper link in the description leads to the same huggingface page. Could you please fix that?
Hi, thanks for letting us know! We’ve added the correct paper link to the model card.