Amharic Neural Information Retrieval models: Bi-Encoders, Cross Encoders, ColBERT, and SPLADE
Yosef Worku Alemneh
rasyosef
AI & ML interests
Pretraining, Supervised Fine Tuning, Direct Preference Optimization, Retrieval Augmented Generation (RAG), Function Calling
Recent Activity
updated a collection about 12 hours ago
Amharic Neural IR Models updated a dataset about 12 hours ago
rasyosef/Amharic-Passage-Retrieval-Dataset-V2-With-Negatives published a dataset about 12 hours ago
rasyosef/Amharic-Passage-Retrieval-Dataset-V2-With-NegativesOrganizations
Text Embedding and ColBERT models based on Amharic RoBERTa and BERT for Amharic passage retrieval
-
Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval
Paper • 2505.19356 • Published -
rasyosef/roberta-amharic-text-embedding-base
Sentence Similarity • 0.1B • Updated • 330 -
rasyosef/colbert-roberta-amharic-base
Sentence Similarity • 0.1B • Updated • 29 -
rasyosef/roberta-amharic-text-embedding-medium
Sentence Similarity • 42.1M • Updated • 410
BERT and RoBERTa transformer encoder models pretrained on 290 million tokens of Amharic text
These models underwent supervised fine-tuning and direct preference optimization for instruction following on top of Microsoft's Phi 1.5 base LLM
Instruction-tuned (chat) versions of Nvidia's Minitron base models created through supervised fine-tuning (SFT)
SPLADE sparse retrieval models based on BERT-Tiny (4M) and BERT-Mini (11M) distilled from a Cross-Encoder on the MSMARCO dataset
Llama 3.2 decoder transformer models trained on Amharic text
-
rasyosef/Llama-3.2-400M-Amharic
Text Generation • 0.4B • Updated • 185 • 3 -
rasyosef/Llama-3.2-400M-Amharic-Instruct-Poems-Stories-Wikipedia
Text Generation • 0.4B • Updated • 6 • 1 -
rasyosef/Llama-3.2-400M-Amharic-Instruct
Text Generation • 0.4B • Updated • 15 -
rasyosef/Llama-3.2-180M-Amharic
Text Generation • 0.2B • Updated • 22 • 1
GPT2 transformer decoder models pretrained on 290 million tokens of Amharic text
These models underwent supervised fine-tuning and direct preference optimization for instruction following on top of Microsoft's Phi 2 base LLM
Amharic Neural Information Retrieval models: Bi-Encoders, Cross Encoders, ColBERT, and SPLADE
SPLADE sparse retrieval models based on BERT-Tiny (4M) and BERT-Mini (11M) distilled from a Cross-Encoder on the MSMARCO dataset
Text Embedding and ColBERT models based on Amharic RoBERTa and BERT for Amharic passage retrieval
-
Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval
Paper • 2505.19356 • Published -
rasyosef/roberta-amharic-text-embedding-base
Sentence Similarity • 0.1B • Updated • 330 -
rasyosef/colbert-roberta-amharic-base
Sentence Similarity • 0.1B • Updated • 29 -
rasyosef/roberta-amharic-text-embedding-medium
Sentence Similarity • 42.1M • Updated • 410
Llama 3.2 decoder transformer models trained on Amharic text
-
rasyosef/Llama-3.2-400M-Amharic
Text Generation • 0.4B • Updated • 185 • 3 -
rasyosef/Llama-3.2-400M-Amharic-Instruct-Poems-Stories-Wikipedia
Text Generation • 0.4B • Updated • 6 • 1 -
rasyosef/Llama-3.2-400M-Amharic-Instruct
Text Generation • 0.4B • Updated • 15 -
rasyosef/Llama-3.2-180M-Amharic
Text Generation • 0.2B • Updated • 22 • 1
BERT and RoBERTa transformer encoder models pretrained on 290 million tokens of Amharic text
GPT2 transformer decoder models pretrained on 290 million tokens of Amharic text
These models underwent supervised fine-tuning and direct preference optimization for instruction following on top of Microsoft's Phi 1.5 base LLM
These models underwent supervised fine-tuning and direct preference optimization for instruction following on top of Microsoft's Phi 2 base LLM
Instruction-tuned (chat) versions of Nvidia's Minitron base models created through supervised fine-tuning (SFT)