[xwiki-notifications] [xwiki-contrib/ai-llm-benchmark] da3df3: LLMAI-61: Implement an evaluation framework

Branch: refs/heads/master Home: https://github.com/xwiki-contrib/ai-llm-benchmark Commit: da3df3547d2f02c7388bdbb9bf66e4244f03f18f https://github.com/xwiki-contrib/ai-llm-benchmark/commit/da3df3547d2f02c738… Author: Paul Pantiru <paul.pantiru(a)xwiki.com> Date: 2024-05-12 (Sun, 12 May 2024) Changed paths: M .gitignore R CollectData.py R Eval.py R IndexContext.py R MakePlots.py M README.md A Snakefile R download_wiki_page.py A environment.yml R input/questions/1.json R input/questions/2.json R input/questions/3.json R input/questions/4.json R input/questions/5.json R input/splitToFiles.py R output/1.json R output/2.json R output/3.json R output/4.json R output/5.json R plots/accuracy_scores.png R plots/relevance_scores.png M request.json R results/1_result.json R results/2_result.json R results/3_result.json R results/4_result.json R results/5_result.json A scripts/calculate_scores.py A scripts/collect_data.py A scripts/create_plots.py A scripts/download_wiki_page.py A scripts/index_data.py A scripts/split_input_to_files.py Log Message: ----------- LLMAI-61: Implement an evaluation framework * Organize the pipeline using conda and snamkemake To unsubscribe from these emails, change your notification settings at https://github.com/xwiki-contrib/ai-llm-benchmark/settings/notifications