Image-Text-to-Text
Safetensors
ColPali
sentence-transformers
sauerkrautlm-colpali
collfm2
document-retrieval
vision-language-model
multi-vector
late-interaction
visual-retrieval
lfm2
small-model
efficient
curriculum-learning
hierarchical-merge
mteb
vidore
Instructions to use VAGOsolutions/SauerkrautLM-ColLFM2-450M-v0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- ColPali
How to use VAGOsolutions/SauerkrautLM-ColLFM2-450M-v0.1 with ColPali:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- sentence-transformers
How to use VAGOsolutions/SauerkrautLM-ColLFM2-450M-v0.1 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("VAGOsolutions/SauerkrautLM-ColLFM2-450M-v0.1") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
| { | |
| "crop_size": null, | |
| "data_format": "channels_first", | |
| "default_to_square": true, | |
| "device": null, | |
| "disable_grouping": null, | |
| "do_center_crop": null, | |
| "do_convert_rgb": null, | |
| "do_image_splitting": true, | |
| "do_normalize": true, | |
| "do_pad": true, | |
| "do_rescale": true, | |
| "do_resize": false, | |
| "downsample_factor": 2, | |
| "encoder_patch_size": 16, | |
| "image_mean": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "image_processor_type": "Lfm2VlImageProcessorFast", | |
| "image_std": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "input_data_format": null, | |
| "max_image_tokens": 256, | |
| "max_num_patches": 1024, | |
| "max_pixels_tolerance": 2.0, | |
| "max_tiles": 10, | |
| "min_image_tokens": 64, | |
| "min_tiles": 2, | |
| "pad_size": null, | |
| "patch_size": 16, | |
| "processor_class": "Lfm2VlProcessor", | |
| "resample": 3, | |
| "rescale_factor": 0.00392156862745098, | |
| "return_row_col_info": true, | |
| "return_tensors": "pt", | |
| "size": { | |
| "height": 512, | |
| "width": 512 | |
| }, | |
| "tile_size": 512, | |
| "use_thumbnail": true | |
| } | |