assistance-engine/scratches/pseco/synthetic_dataset
pseco 1ee5f21c7c Add BEIR analysis notebooks and evaluation pipeline for embedding models
- Created `n00 Beir Analysis_cosqa.ipynb` for analyzing CoSQA dataset with BEIR.
- Created `n00 first Analysis.ipynb` for initial analysis with embeddings.
- Implemented `evaluate_embeddings_pipeline.py` to evaluate embedding models across CodexGlue, CoSQA, and SciFact benchmarks.
- Added adapters for Ollama and HuggingFace embeddings to ensure compatibility with BEIR.
- Enhanced error handling and data normalization in embedding processes.
- Included functionality to load datasets from local cache or download if not present.
2026-03-26 09:37:37 +01:00
..
avap_test working on examples verification and testing on avap language server 2026-03-17 11:46:25 +01:00
generate_synthethic_data.ipynb Add BEIR analysis notebooks and evaluation pipeline for embedding models 2026-03-26 09:37:37 +01:00
mbap_tester.py working on synthetic dataset 2026-03-17 11:02:06 +01:00
n00 Ragas TestSet Generation.ipynb adding ragas to dev 2026-02-26 09:45:42 +01:00
n01 Human Eval.ipynb working on synthetic dataset 2026-03-17 11:02:06 +01:00