This issue has been created
There are 2 updates.
 
 
LLM AI Integration / cid:jira-generated-image-avatar-ff68e9cd-7a51-4a5b-b454-a3665649a323 LLMAI-113 Open

Benchmark context collections of different sizes

 
View issue   ยท   Add comment
 

Issue created

 
cid:jira-generated-image-avatar-b01a9058-120a-49df-b04a-4abec06480f0 Michael Hamann created this issue on 19/Nov/24 09:40
 
Summary: Benchmark context collections of different sizes
Issue Type: cid:jira-generated-image-avatar-ff68e9cd-7a51-4a5b-b454-a3665649a323 New Feature
Affects Versions: 0.6.2
Assignee: Unassigned
Created: 19/Nov/24 09:40
Priority: cid:jira-generated-image-static-major-f69643b1-b1e2-4365-b272-0f67d13f8c9e Major
Reporter: Michael Hamann
Description:

The benchmark should use collections of different size in order to measure the effect of "noise" on context retrieval. For this, the benchmark tool should support assigning a document to several collections.

 
 

2 updates

 
cid:jira-generated-image-avatar-b01a9058-120a-49df-b04a-4abec06480f0 Changes by Michael Hamann on 19/Nov/24 09:40
 
Fix Version: 0.7
Assignee: Michael Hamann