Basic support for indexing documents and querying them needs to be added as described on https://design.xwiki.org/xwiki/bin/view/Proposal/X-AI/WAISE/High-level%20Architecture/#HKnowledgeIndex Basic features include:
- Chunking API and and one simple chunking method, e.g., just based on a number of characters.
- REST API for adding, updating and removing documents
- Queue for indexing requests
- Queue consumer that chunks the document, embeds chunks and stores them in the vector index
- API for authentication with a mock implementation that is meant for public collections
- UI for managing collections
- Query support that embeds a query, searches chunks from the index, queries an authentication method and returns them.
|