This issue has been created
There is 1 update.
 
 
LLM AI Integration / cid:jira-generated-image-avatar-a9fb22bb-d287-4f0d-b3e9-945c9cfcee2f LLMAI-87 Open

Execute the benchmark and document results

 
View issue   ยท   Add comment
 

Issue created

 
cid:jira-generated-image-avatar-93c2ac92-bdc6-4e7a-aff5-db42d64c6d64 Michael Hamann created this issue on 20/Jun/24 11:25
 
Summary: Execute the benchmark and document results
Issue Type: cid:jira-generated-image-avatar-a9fb22bb-d287-4f0d-b3e9-945c9cfcee2f Task
Affects Versions: 0.3.1
Assignee: Unassigned
Created: 20/Jun/24 11:25
Priority: cid:jira-generated-image-static-major-1f546ae2-0093-48a9-9f19-187f176001e4 Major
Reporter: Michael Hamann
Description:

The benchmark we created needs to be executed and results need to be compiled. For this, the following needs to be done:

  • Select a list of LLMs to evaluate
  • Execute the benchmark
  • Check the results, making sure that the automated evaluation is good
  • Document the results
 
 

1 update

 
cid:jira-generated-image-avatar-93c2ac92-bdc6-4e7a-aff5-db42d64c6d64 Changes by Michael Hamann on 20/Jun/24 11:25
 
Assignee: Paul Pantiru