assistance-engine/research/embeddings/datasets/cosqa
izapata 4deda83a8e Add BEIR analysis notebooks and evaluation pipeline for embedding models
- Created `n00 Beir Analysis_cosqa.ipynb` for analyzing CoSQA dataset with BEIR.
- Created `n00 first Analysis.ipynb` for initial analysis using Ragas and Ollama embeddings.
- Implemented `evaluate_embeddings_pipeline.py` to evaluate embedding models across CodexGlue, CoSQA, and SciFact benchmarks.
- Added adapters for Ollama and HuggingFace embeddings to ensure compatibility with BEIR.
- Included functions to load datasets and evaluate models with detailed metrics.
2026-03-26 16:53:20 +01:00
..
qrels Add BEIR analysis notebooks and evaluation pipeline for embedding models 2026-03-26 16:53:20 +01:00
corpus.jsonl Add BEIR analysis notebooks and evaluation pipeline for embedding models 2026-03-26 16:53:20 +01:00
queries.jsonl Add BEIR analysis notebooks and evaluation pipeline for embedding models 2026-03-26 16:53:20 +01:00