Background

In the chat and assistants, you can add up to 20 files and send them with your prompt to the model. This limit exists because of the model’s context window (the maximum amount of information models can process simultaneously). For details about sending documents in the context window, see this guide. To work with more than 20 files, you can create knowledge folders in the settings. Here, you can add up to 1,000 files in one folder. This folder can then be attached to assistants and found in the Search feature. When you attach a knowledge folder, the system uses vector search to identify the most relevant sections for your prompt, then sends only those sections to the model within the context window. This approach lets you work with large document collections but trades off some accuracy since not every part of the documents is considered for each response. Knowledge folders can be shared between users, groups, or with the entire workspace, similar to how assistants can be shared. Admins can configure which roles are allowed to share knowledge folders here in the workspace settings.

How to use knowledge folders

You can find the knowledge folders in the integrations. You can either upload files from your computer or push files into the folder through an API (see next section below). After you’ve added files to the folder, go to an assistant and attach the folder in the Knowledge section by clicking Add Action, searching for the required folder, and clicking Add for the "Search in knowledge folder name" action.

Knowledge folder API

To push files to the knowledge folder, you can use the folder’s API. Workspace admins can generate API keys directly in the workspace settings, while non-admins will need to request a key from their workspace admin. You can find the API schema in the following guides. The current rate limit is 50 requests per minute.