To use your own models and not the flat fee of Langdock, BYOK needs to be activated. This section guides you through the process of adding your own models.
You need different models for the platform to work. Here are the models necessary to cover all functionalities:
After you have received all keys you need, please reach out to the Langdock team. We will agree with you on a timeslot to turn on BYOK on our side. After that, you can add the different models. Usually, this is done in the evening, when less users are active, as there might be a downtime of a few minutes during the model switch.
After BYOK is activated, you can add the different models in the model settings. Here is a guide on how to add models.
Please make sure that all of the models work correctly. Here is how you can test the models:
Completion models: Send a prompt to each model you can select in the interface (e.g. “write a story about dogs”).
Embedding model: Upload a file and ask a question about it (e.g. “what is in the file”). The upload should work and you should receive an answer based on the file.
Image model: Ask any model to generate an image. You should see an image generated by the model in the background.
Backbone model: Select a model which does not support native tool calling (like Llama or Mistral) and ask to search the web (e.g. “search the web for Langdock”). If you do not have any model without tool calling, send a message in a new chat and observe if the conversation name in the bar on the left changes after a few seconds.
Please do not hesitate to contact the Langdock team if there are any issues here.
To use your own models and not the flat fee of Langdock, BYOK needs to be activated. This section guides you through the process of adding your own models.
You need different models for the platform to work. Here are the models necessary to cover all functionalities:
After you have received all keys you need, please reach out to the Langdock team. We will agree with you on a timeslot to turn on BYOK on our side. After that, you can add the different models. Usually, this is done in the evening, when less users are active, as there might be a downtime of a few minutes during the model switch.
After BYOK is activated, you can add the different models in the model settings. Here is a guide on how to add models.
Please make sure that all of the models work correctly. Here is how you can test the models:
Completion models: Send a prompt to each model you can select in the interface (e.g. “write a story about dogs”).
Embedding model: Upload a file and ask a question about it (e.g. “what is in the file”). The upload should work and you should receive an answer based on the file.
Image model: Ask any model to generate an image. You should see an image generated by the model in the background.
Backbone model: Select a model which does not support native tool calling (like Llama or Mistral) and ask to search the web (e.g. “search the web for Langdock”). If you do not have any model without tool calling, send a message in a new chat and observe if the conversation name in the bar on the left changes after a few seconds.
Please do not hesitate to contact the Langdock team if there are any issues here.