Sentence Similarity
sentence-transformers
PyTorch
ONNX
Safetensors
OpenVINO
xlm-roberta
mteb
Sentence Transformers
Eval Results (legacy)
Eval Results
text-embeddings-inference
Instructions to use intfloat/multilingual-e5-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use intfloat/multilingual-e5-base with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("intfloat/multilingual-e5-base") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Inference
- Notebooks
- Google Colab
- Kaggle
Model can't be moved to GPU
#20
by ftopal - opened
When I move model to GPU, I get RuntimeError
RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be
incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.
What is the issue here?
I could not reproduce your reported issue. Are you running other code before this code snippet?
Nope, I found that it happens with other models as well so I suppose something Google Colab specific going here. I can't figure it out what tho. We can probably close this one as it doesn't seem model specific in this case.
ftopal changed discussion status to closed