Commit Graph

4 Commits

Author SHA1 Message Date
izapata 4deda83a8e Add BEIR analysis notebooks and evaluation pipeline for embedding models
- Created `n00 Beir Analysis_cosqa.ipynb` for analyzing CoSQA dataset with BEIR.
- Created `n00 first Analysis.ipynb` for initial analysis using Ragas and Ollama embeddings.
- Implemented `evaluate_embeddings_pipeline.py` to evaluate embedding models across CodexGlue, CoSQA, and SciFact benchmarks.
- Added adapters for Ollama and HuggingFace embeddings to ensure compatibility with BEIR.
- Included functions to load datasets and evaluate models with detailed metrics.
2026-03-26 16:53:20 +01:00
izapata e4a8e5b85d chore: update Embedding model selection PDF with new content 2026-03-26 10:19:24 +01:00
acano 14b279b8af Refactor code structure for improved readability and maintainability 2026-03-19 16:40:57 +01:00
acano b6f9b386ef Add BEIR analysis notebooks for different datasets and models
- Created `n00 Beir Analysis.ipynb` for analyzing BEIR dataset with Ollama embeddings.
- Added `n00 Beir Analysis_cosqa.ipynb` for evaluating the CosQA dataset using similar methods.
- Introduced `n00 first Analysis.ipynb` for initial analysis with Ragas embeddings and semantic similarity evaluation.
- Implemented data loading, processing, and evaluation metrics for each notebook.
- Included functionality to save results to JSON files for further analysis.
2026-03-19 16:27:25 +01:00