Athrael.net Tag: embeddings
All the articles with the tag "embeddings".
-
Mine the Way Your Model Scores: MaxSim Hard-Negative Mining for a Late-Interaction Student
Updated:The standard way to mine hard negatives for a late-interaction model uses a single-vector cosine teacher, even though the model itself scores with multi-vector MaxSim. So I rebuilt my miner to score the way my model does. Matched mining clearly beat training with no mined negatives, while the cosine approach was barely doing anything at all.
-
Implementing Spatially-Grounded Document Retrieval via Patch-to-Region Propagation
A deep dive into my recent research on spatially-grounded document retrieval using ColPali models and OCR bounding boxes, enabling precise region-level retrieval during inference time and without additional training.
-
ColQwen2.5 FastAPI Integration
A little-script to create a FastAPI server for ColQwen2.5
-
Audio RAG with ColQwen2.5-Omni
An audio RAG system that processes video URLs and answers questions about their content using ColQwen2.5-Omni and OpenAI audio
-
The Most Beautiful RAG: Starring Colnomic, Qdrant, Minio and Friends
Updated:Introducing the first project in my little-scripts monorepo - A simple, yet beautiful RAG implementation using Colnomic, Qdrant and Nomic