- Created `n00 Beir Analysis_cosqa.ipynb` for analyzing CoSQA dataset with BEIR. - Created `n00 first Analysis.ipynb` for initial analysis with embeddings. - Implemented `evaluate_embeddings_pipeline.py` to evaluate embedding models across CodexGlue, CoSQA, and SciFact benchmarks. - Added adapters for Ollama and HuggingFace embeddings to ensure compatibility with BEIR. - Enhanced error handling and data normalization in embedding processes. - Included functionality to load datasets from local cache or download if not present. |
||
|---|---|---|
| .. | ||
| utils | ||
| evaluate.py | ||
| golden_dataset.json | ||
| graph.py | ||
| openai_proxy.py | ||
| prompts.py | ||
| server.py | ||
| state.py | ||