We recently concluded am experiment to test the robustness of guardrail implementation by five popular AI chat agents against a potential data exfiltration vulnerability. Our
Appropriate logging facilitates performance, cost and security analyses. We share three key categories of data and metadata every production RAG system should maintain within their logs.
Guardrails are key, but the diversity and complexity of input formats makes it challenging to put them in place, especially for multimodal systems.
Post-retrieval, a combination of filtering and reranking of search results help to refine, optimize and stack content for LLM operations.
The pre-retrieval phase is a critical stage where user input is processed and transformed into optimized vector search queries
The way content is chunked has a profound impact on the eventual performance of a RAG system. We introduce three broad approaches to chunking.
