4 Commits

Author	SHA1	Message	Date
pseco	a9bf84fa79	feat: Add synthetic dataset generation for AVAP using MBPP dataset ... - Implemented a new script `translate_mbpp.py` to generate synthetic datasets using various LLM providers. - Integrated the `get_prompt_mbpp` function in `prompts.py` to create prompts tailored for AVAP language conversion.	2026-03-09 17:43:07 +01:00
pseco	4afba7d89d	working on scrappy	2026-03-09 15:00:07 +01:00
acano	d951868200	refactor: Simplify Elasticsearch ingestion by removing chunk management module and integrating document building directly	2026-03-05 16:23:27 +01:00
acano	1549069f5a	feat: Add Elasticsearch ingestion pipeline and document chunking functionality ... - Implemented `elasticsearch_ingestion` function to handle document ingestion into Elasticsearch. - Created `build_chunks_from_folder` function to read and clean text files, generating document chunks. - Added logging for better traceability during the ingestion process. - Updated `uv.lock` to include `boto3` as a new dependency.	2026-03-04 18:21:01 +01:00