This issue has been created
 
 
LLM AI Integration / cid:jira-generated-image-avatar-34e5f390-706b-44ba-a0b4-04b9e605c139 LLMAI-91 Open

There is no context when the prompt doesn't include it in the model configuration

 
View issue   ยท   Add comment
 

Issue created

 
cid:jira-generated-image-avatar-c23b43c3-4511-416a-94d7-15d4b673856e Michael Hamann created this issue on 20/Jun/24 11:54
 
Summary: There is no context when the prompt doesn't include it in the model configuration
Issue Type: cid:jira-generated-image-avatar-34e5f390-706b-44ba-a0b4-04b9e605c139 Bug
Affects Versions: 0.3.1
Assignee: Unassigned
Created: 20/Jun/24 11:54
Priority: cid:jira-generated-image-static-major-73ba7ca7-0402-4743-ba40-a4bf8a3e98fe Major
Reporter: Michael Hamann
Description:

When you configure a model with context collections, search results are displayed in the messages but the model doesn't actually get the search results. Only when you include the placeholder for search results in the prompt, search results are displayed. We should:

  • Have a standard prompt that is used when the prompt is empty
  • Include explicit instructions for the user to include the placeholder
  • (optional) Validate that the prompt includes the placeholder
  • (optional) Include search results after the prompt if there is no placeholder