Skip to main content
There are two ways how contents of a file are processed for generating an answer:
  • One is that the entire document is sent to the model, together with your prompt (see this guide). This is the standard in chats and agents.
  • AI models have a context window, which is the limit of how much text can be processed at once. For long documents or a large number of documents, the documents are split into chunks and a semantic search retrieves only the most relevant sections, which are then sent to the model in the context window. This is used in folders.
Attaching the files directly to an agent or to a chat leads to the best results. If possible, you should follow this option. We recommend to attach as few documents as possible to an agent or chat. In some use cases, for example when working with large documentation or for an FAQ agent, attaching the documents to an agent or to a chat directly is not possible. Here, you can use folders, which work well for use cases where only specific sections are relevant, but not the entire documents.