Visual Document Retrieval
Transformers
Safetensors
sentence-transformers
multilingual
qwen3_5
feature-extraction
text
image
multimodal-embedding
vidore
colbert
colqwen3_5
multilingual-embedding
multi-vector
custom_code
Instructions to use webAI-Official/webAI-ColVec1.1-4b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use webAI-Official/webAI-ColVec1.1-4b with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("webAI-Official/webAI-ColVec1.1-4b", trust_remote_code=True) model = AutoModel.from_pretrained("webAI-Official/webAI-ColVec1.1-4b", trust_remote_code=True, device_map="auto") - sentence-transformers
How to use webAI-Official/webAI-ColVec1.1-4b with sentence-transformers:
from sentence_transformers import MultiVectorEncoder model = MultiVectorEncoder("webAI-Official/webAI-ColVec1.1-4b", trust_remote_code=True) queries = ["Which planet is known as the Red Planet?"] documents = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", ] query_embeddings = model.encode_query(queries) document_embeddings = model.encode_document(documents) similarities = model.similarity(query_embeddings, document_embeddings) print(similarities) - Notebooks
- Google Colab
- Kaggle
Commit History
-
Integrate with Sentence Transformers and implement replace_image_token (#1)
- Integrate with Sentence Transformers and implement replace_image_token (c58869428f0697e55a6e84dd6adf96a57e8a80f0) - Accept forwarded kwargs in replace_image_token (e.g. return_tensors from transformers 5.15 ProcessorMixin) (693421269b4e2eba73e17d2f8eda963ed0510149) Co-authored-by: Tom Aarsen <tomaarsen@users.noreply.huggingface.co>d88d015
-
Upload README.md with huggingface_hub
Verified signature8e92bfb
-
Add frozen evaluation environment requirements
Verified signature5b4004b -
Update model card: SDPA scores, quick start, eval environment
Verified signature6a680cb
-
Update 4B model card
Verified signatureb4f97a7
-
Upload README.md with huggingface_hub
Verified signature4332508 -
Upload README.md with huggingface_hub
Verified signature8873615 -
Upload folder using huggingface_hub
Verified signaturec799470 -
Upload folder using huggingface_hub
Verified signaturee8491df -
initial commit
Verified signature9b39f61