Skip to main content
AI models are not good at processing a whole repository yet. There are a few reasons for this:
  • First, they have a context window, which is the maximum amount of text they can process at once. The chat has a limit of 20 files and agents have a limit of 50 files to increase the chance that the files fit into the context window. Repositories often contain many more files than that.
  • Knowledge bases handle documents or document batches that are larger than the context window. Since the context window is a technical limitation of the model, not everything can be sent to the model. Semantic search identifies relevant sections of the documents, and only these sections are sent to the model. For coding, it is important to consider the entire document, not only selected sections. Therefore, the context window also limits this behavior.
  • Lastly, even if the repository fits into the context window, the model might still struggle to understand it if it is a large repository, since the answers decrease in quality with a fuller context window.
In our experience, the best approach is to work with individual files, smaller sections, or screenshots only.