[xwiki-notifications] [xwiki-contrib/ai-llm-benchmark] cda419: LLMAI-61: Implement an evaluation framework

Branch: refs/heads/master Home: https://github.com/xwiki-contrib/ai-llm-benchmark Commit: cda419473baeb93d50535e1d18072244fad3c871 https://github.com/xwiki-contrib/ai-llm-benchmark/commit/cda419473baeb93d50… Author: Michael Hamann <michael.hamann(a)xwiki.com> Date: 2024-05-08 (Wed, 08 May 2024) Changed paths: M README.md M context_data/collections/collection.json M context_data/collections/collection2.json Log Message: ----------- LLMAI-61: Implement an evaluation framework * Adjust collection metadata to current version * Extend the README Commit: afcdd7cb5e0dbad773f856f7b30ddff0c0e5e125 https://github.com/xwiki-contrib/ai-llm-benchmark/commit/afcdd7cb5e0dbad773… Author: Michael Hamann <michael.hamann(a)xwiki.com> Date: 2024-05-08 (Wed, 08 May 2024) Changed paths: A context_data/documents/dev_Community.SupportStrategy.DatabaseSupportStrategy.json A context_data/documents/extensions_Extension.Administration Application.json A context_data/documents/extensions_Extension.LDAP.Authenticator.WebHome.json A context_data/documents/extensions_Extension.LLM Application.Authenticator.WebHome.json A context_data/documents/extensions_Extension.LLM Application.Index for the LLM Application.WebHome.json A context_data/documents/extensions_Extension.Model.Validation.UI.WebHome.json A context_data/documents/extensions_Extension.Notifications Application.WebHome.json A context_data/documents/extensions_Extension.Office Importer Application.json A context_data/documents/extensions_Extension.OpenID Connect.OpenID Connect Authenticator.WebHome.json A context_data/documents/urls.txt A context_data/documents/xwiki_Documentation.AdminGuide.Access Rights.Permission types.WebHome.json A context_data/documents/xwiki_Documentation.AdminGuide.Access Rights.WebHome.json A context_data/documents/xwiki_Documentation.AdminGuide.Authentication.WebHome.json A context_data/documents/xwiki_Documentation.AdminGuide.Configuration.WebHome.json A context_data/documents/xwiki_Documentation.AdminGuide.Upgrade.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Accessibility.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Applications.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Attachments.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Authentication.json A context_data/documents/xwiki_Documentation.UserGuide.Features.ContentOrganization.NestedPagesMigration.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.ContentOrganization.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.ContentOrganization.WikiVsNestedPages.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.DatabaseSupport.json A context_data/documents/xwiki_Documentation.UserGuide.Features.DistributionWizard.json A context_data/documents/xwiki_Documentation.UserGuide.Features.DocumentLifecycle.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Exports.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Forms.json A context_data/documents/xwiki_Documentation.UserGuide.Features.I18N.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Imports.json A context_data/documents/xwiki_Documentation.UserGuide.Features.KeyboardShortcuts.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Navigate.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Notifications.json A context_data/documents/xwiki_Documentation.UserGuide.Features.PageEditing.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Programming.json A context_data/documents/xwiki_Documentation.UserGuide.Features.RSS.json A context_data/documents/xwiki_Documentation.UserGuide.Features.RightsManagement.json A context_data/documents/xwiki_Documentation.UserGuide.Features.ScalabilityPerformance.json A context_data/documents/xwiki_Documentation.UserGuide.Features.SecondGenerationWiki.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.Skins.json A context_data/documents/xwiki_Documentation.UserGuide.Features.UsersAndGroupsManagement.json A context_data/documents/xwiki_Documentation.UserGuide.Features.VersionControl.json A context_data/documents/xwiki_Documentation.UserGuide.Features.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.Features.XWikiRESTfulAPI.json A context_data/documents/xwiki_Documentation.UserGuide.Features.XWikiSyntax.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.ChangingTheLogoAndThePanels.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.CreatingABasicApp.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.CreatingAPage.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.CreatingNewUsers.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.EditingAPage.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.FirstStepsWithXWiki.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.GoingFurther.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.PageHistory.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.SettingUserRights.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.WhatIsAWiki.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.WhatsSpecialAboutXWiki.WebHome.json A context_data/documents/xwiki_Documentation.UserGuide.GettingStarted.XWikiBasicConcepts.json A download_wiki_page.py Log Message: ----------- LLMAI-63: Prepare a collection of documents for benchmarking the LLMs * Add a script to download wiki pages from xwiki.org * Add an initial collection of 56 wiki pages, primarily the user guide and some guides about authentication Compare: https://github.com/xwiki-contrib/ai-llm-benchmark/compare/a43361fb91d7...af… To unsubscribe from these emails, change your notification settings at https://github.com/xwiki-contrib/ai-llm-benchmark/settings/notifications