This issue has been created
 
 
LLM AI Integration / cid:jira-generated-image-avatar-0e8b4aaf-808a-4e9a-9918-e676bf035c9d LLMAI-229 Open

Allow extensions to provide chunking methods for collections

 
View issue   ยท   Add comment
 

Issue created

 
cid:jira-generated-image-avatar-29a4284a-6bb9-4834-bc4c-de012ba2c963 Gunter Ohrner created this issue on 14/Nov/26 21:45
 
Summary: Allow extensions to provide chunking methods for collections
Issue Type: cid:jira-generated-image-avatar-0e8b4aaf-808a-4e9a-9918-e676bf035c9d Improvement
Assignee: Unassigned
Created: 14/Nov/26 21:45
Priority: cid:jira-generated-image-static-major-614dfe47-440a-4c3b-ba6f-c591dbdd7fd5 Major
Reporter: Gunter Ohrner
Description:

Collections have a "Chunking method" setting, but it offers a single value, "Max characters chunking", and the indexer ignores it. Chunking methods should be components selected by this setting, so that the application and other extensions can provide alternatives.

  • The current algorithm becomes the maxChars method; indexing results do not change.
  • The collection edit form lists the installed methods, like the document stores. A method that is no longer installed stays selected and is marked as such, instead of being replaced silently.
  • A blank setting means maxChars. An unknown method is rejected when it is set through REST or the script service, and indexing reports it instead of falling back silently.