David Mezzetti
davidmezzetti
AI & ML interests
None yet
Recent Activity
upvoted an article 2 days ago
Tokenmaxxing BERT: 50x faster tokenization new activity about 2 months ago
NeuML/colbert-bert-tiny:Add Sentence Transformers usage repliedto their post about 2 months ago
Exciting addition coming with the next txtai release: LEMUR for ColBERT-style Late-Interaction Retrieval! 🎉
Contributor @Morgan-coded introduced LEMUR to txtai, making it, as far as we know, the first framework to incorporate LEMUR for late-interaction retrieval using standard, fixed-vector indexes.
Key benefits:
🚀 Significant boost: 49–62% higher NDCG@10 than 2,048-dimensional MUVERA
💾 5x less storage: 2,048 dimensions vs. MUVERA’s default 10,240
📐 Better geometry: Optional batch mean centering addresses anisotropy in token embeddings
A promising step toward making ColBERT-style retrieval more practical with conventional vector search.
Read the full breakdown: https://huggingface.co/blog/NeuML/txtai-lemurOrganizations