Sentence Similarity
Safetensors
sentence-transformers
PyLate
lfm2
liquid
lfm2.5
edge
ColBERT
feature-extraction
custom_code
Instructions to use LiquidAI/LFM2.5-ColBERT-350M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use LiquidAI/LFM2.5-ColBERT-350M with sentence-transformers:
from pylate import models queries = [ "Which planet is known as the Red Planet?", "What is the largest planet in our solar system?", ] documents = [ ["Mars is the Red Planet.", "Venus is Earth's twin."], ["Jupiter is the largest planet.", "Saturn has rings."], ] model = models.ColBERT(model_name_or_path="LiquidAI/LFM2.5-ColBERT-350M") queries_emb = model.encode(queries, is_query=True) docs_emb = model.encode(documents, is_query=False) - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -45,10 +45,12 @@ license_link: LICENSE
|
|
| 45 |
|
| 46 |
# LFM2.5-ColBERT-350M
|
| 47 |
|
| 48 |
-
We release two new multilingual retrieval models
|
| 49 |
|
| 50 |
-
- **[LFM2.5-Embedding-350M](https://huggingface.co/LiquidAI/LFM2.5-Embedding-350M)** — one vector per document. Smallest, fastest index.
|
| 51 |
-
- **LFM2.5-ColBERT-350M** —
|
|
|
|
|
|
|
| 52 |
|
| 53 |
For the full story on architecture (bidirectional patches over LFM2.5), training recipe, and benchmarks, see the [release blog post](https://www.liquid.ai/blog) *(link to be added)*.
|
| 54 |
|
|
@@ -58,7 +60,7 @@ For the full story on architecture (bidirectional patches over LFM2.5), training
|
|
| 58 |
| --------------------- | -------------------------------------- | ----------------------------------- |
|
| 59 |
| **Type** | Late interaction (per-token vectors) | Dense bi-encoder (single vector) |
|
| 60 |
| **Total parameters** | ~353M | ~350M |
|
| 61 |
-
| **Layers** | 17 (10 conv + 6 attn + 1 dense) | 16 (10 conv + 6 attn) |
|
| 62 |
| **Context length** | 32,768 tokens | 32,768 tokens |
|
| 63 |
| **Vocabulary size** | 64,402 | 64,402 |
|
| 64 |
| **Output** | 128-dim per token | 1024-dim CLS vector |
|
|
@@ -66,7 +68,7 @@ For the full story on architecture (bidirectional patches over LFM2.5), training
|
|
| 66 |
| **Training precision**| BF16 | BF16 |
|
| 67 |
| **License** | LFM Open License v1.0 | LFM Open License v1.0 |
|
| 68 |
|
| 69 |
-
**Document length:** 512 tokens **Query length:** 32 tokens
|
| 70 |
|
| 71 |
**Supported languages:** English, Spanish, German, French, Italian, Portuguese, Arabic, Swedish, Norwegian, Japanese, Korean.
|
| 72 |
|
|
|
|
| 45 |
|
| 46 |
# LFM2.5-ColBERT-350M
|
| 47 |
|
| 48 |
+
We release two new multilingual retrieval models:
|
| 49 |
|
| 50 |
+
- **[LFM2.5-Embedding-350M](https://huggingface.co/LiquidAI/LFM2.5-Embedding-350M)** — A dense bi-encoder, one vector per document. Smallest, fastest index.
|
| 51 |
+
- **LFM2.5-ColBERT-350M** — A late-interaction model. One vector per *token*, matched via MaxSim. Higher accuracy and better generalization at the cost of index size.
|
| 52 |
+
|
| 53 |
+
Both models are 350M params and the first bidirectional members of the LFM family, built on [LFM2.5-350M-Base](https://huggingface.co/LiquidAI/LFM2.5-350M-Base). They target fast, cheap, and reliable multilingual / cross-lingual search across 11 languages.
|
| 54 |
|
| 55 |
For the full story on architecture (bidirectional patches over LFM2.5), training recipe, and benchmarks, see the [release blog post](https://www.liquid.ai/blog) *(link to be added)*.
|
| 56 |
|
|
|
|
| 60 |
| --------------------- | -------------------------------------- | ----------------------------------- |
|
| 61 |
| **Type** | Late interaction (per-token vectors) | Dense bi-encoder (single vector) |
|
| 62 |
| **Total parameters** | ~353M | ~350M |
|
| 63 |
+
| **Layers** | 17 (10 conv + 6 attn + 1 dense) | 16 (10 conv + 6 attn + 1 pool) |
|
| 64 |
| **Context length** | 32,768 tokens | 32,768 tokens |
|
| 65 |
| **Vocabulary size** | 64,402 | 64,402 |
|
| 66 |
| **Output** | 128-dim per token | 1024-dim CLS vector |
|
|
|
|
| 68 |
| **Training precision**| BF16 | BF16 |
|
| 69 |
| **License** | LFM Open License v1.0 | LFM Open License v1.0 |
|
| 70 |
|
| 71 |
+
**Document length:** 512 tokens **Query length:** 32 tokens
|
| 72 |
|
| 73 |
**Supported languages:** English, Spanish, German, French, Italian, Portuguese, Arabic, Swedish, Norwegian, Japanese, Korean.
|
| 74 |
|