EdoardoMosca commited on
Commit
94d86b5
·
verified ·
1 Parent(s): 632d72a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -5
README.md CHANGED
@@ -45,10 +45,12 @@ license_link: LICENSE
45
 
46
  # LFM2.5-ColBERT-350M
47
 
48
- We release two new multilingual retrieval models built on [LFM2.5-350M-Base](https://huggingface.co/LiquidAI/LFM2.5-350M-Base): **LFM2.5-ColBERT-350M**, a late-interaction retriever, and **[LFM2.5-Embedding-350M](https://huggingface.co/LiquidAI/LFM2.5-Embedding-350M)**, a dense bi-encoder. Both are 350M params and the first bidirectional members of the LFM family, targeting fast, cheap, and reliable multilingual / cross-lingual search across 11 languages.
49
 
50
- - **[LFM2.5-Embedding-350M](https://huggingface.co/LiquidAI/LFM2.5-Embedding-350M)** — one vector per document. Smallest, fastest index.
51
- - **LFM2.5-ColBERT-350M** — one vector per *token*, matched via MaxSim. Higher accuracy and better generalization at the cost of index size.
 
 
52
 
53
  For the full story on architecture (bidirectional patches over LFM2.5), training recipe, and benchmarks, see the [release blog post](https://www.liquid.ai/blog) *(link to be added)*.
54
 
@@ -58,7 +60,7 @@ For the full story on architecture (bidirectional patches over LFM2.5), training
58
  | --------------------- | -------------------------------------- | ----------------------------------- |
59
  | **Type** | Late interaction (per-token vectors) | Dense bi-encoder (single vector) |
60
  | **Total parameters** | ~353M | ~350M |
61
- | **Layers** | 17 (10 conv + 6 attn + 1 dense) | 16 (10 conv + 6 attn) |
62
  | **Context length** | 32,768 tokens | 32,768 tokens |
63
  | **Vocabulary size** | 64,402 | 64,402 |
64
  | **Output** | 128-dim per token | 1024-dim CLS vector |
@@ -66,7 +68,7 @@ For the full story on architecture (bidirectional patches over LFM2.5), training
66
  | **Training precision**| BF16 | BF16 |
67
  | **License** | LFM Open License v1.0 | LFM Open License v1.0 |
68
 
69
- **Document length:** 512 tokens    **Query length:** 32 tokens (ColBERT)
70
 
71
  **Supported languages:** English, Spanish, German, French, Italian, Portuguese, Arabic, Swedish, Norwegian, Japanese, Korean.
72
 
 
45
 
46
  # LFM2.5-ColBERT-350M
47
 
48
+ We release two new multilingual retrieval models:
49
 
50
+ - **[LFM2.5-Embedding-350M](https://huggingface.co/LiquidAI/LFM2.5-Embedding-350M)** — A dense bi-encoder, one vector per document. Smallest, fastest index.
51
+ - **LFM2.5-ColBERT-350M** — A late-interaction model. One vector per *token*, matched via MaxSim. Higher accuracy and better generalization at the cost of index size.
52
+
53
+ Both models are 350M params and the first bidirectional members of the LFM family, built on [LFM2.5-350M-Base](https://huggingface.co/LiquidAI/LFM2.5-350M-Base). They target fast, cheap, and reliable multilingual / cross-lingual search across 11 languages.
54
 
55
  For the full story on architecture (bidirectional patches over LFM2.5), training recipe, and benchmarks, see the [release blog post](https://www.liquid.ai/blog) *(link to be added)*.
56
 
 
60
  | --------------------- | -------------------------------------- | ----------------------------------- |
61
  | **Type** | Late interaction (per-token vectors) | Dense bi-encoder (single vector) |
62
  | **Total parameters** | ~353M | ~350M |
63
+ | **Layers** | 17 (10 conv + 6 attn + 1 dense) | 16 (10 conv + 6 attn + 1 pool) |
64
  | **Context length** | 32,768 tokens | 32,768 tokens |
65
  | **Vocabulary size** | 64,402 | 64,402 |
66
  | **Output** | 128-dim per token | 1024-dim CLS vector |
 
68
  | **Training precision**| BF16 | BF16 |
69
  | **License** | LFM Open License v1.0 | LFM Open License v1.0 |
70
 
71
+ **Document length:** 512 tokens    **Query length:** 32 tokens
72
 
73
  **Supported languages:** English, Spanish, German, French, Italian, Portuguese, Arabic, Swedish, Norwegian, Japanese, Korean.
74