logo

How To Test Your Chatbot

This guide will walk you through how to test your chatbot using various parameters such as different LLMs, AI creativity (temperature), and prompts. You’ll be able to compare responses from different configurations and choose the one that delivers the best performance.

1

Navigate to https://app.fastbots.ai/

2

Open the chatbot by clicking on it.

Open the chatbot by clicking on it.
3

Click on the "Test Your Bot" button to open the page.

Click on the "Test Your Bot" button to open the page.
4

On this page, you can test your chatbot and compare the performance of different LLMs, temperature settings, AI Prompts, and choose the one that works best for you.

On this page, you can test your chatbot and compare the performance of different LLMs, temperature settings, AI Prompts, and choose the one that works best for you.
5

To add more chatbot windows, simply click on "Add an instance". You can add up to 4 instances at a time.

To add more chatbot windows, simply click on "Add an instance". You can add up to 4 instances at a time.
6

You can choose if you want each chatbot window to be synced with the other. It means, if you type a question in one window, it will be automatically written in other windows as well.

You can choose if you want each chatbot window to be synced with the other. It means, if you type a question in one window, it will be automatically written in other windows as well.
7

Click this icon to open more settings.

Click this icon to open more settings.
8

Once you click on the filters icon, it will show you a pop-up. You can choose the LLM that you want to test in this window by clicking the drop-down menu. Please select the LLM for each window for testing purposes.

Once you click on the filters icon, it will show you a pop-up. You can choose the LLM that you want to test in this window by clicking the drop-down menu. Please select the LLM for each window for testing purposes.
9

You may also set the temperature for the AI creativity for all chatbot windows.

You may also set the temperature for the AI creativity for all chatbot windows.
10

From the "System Prompt" option, you can select the AI prompt that you want to test for this chatbot window. Make sure to select the desired prompt for all windows before starting testing.

From the "System Prompt" option, you can select the AI prompt that you want to test for this chatbot window. Make sure to select the desired prompt for all windows before starting testing.
11

Once all the changes are done, click anywhere on the screen and the bot will save the settings and show you a confirmation message.

Once all the changes are done, click anywhere on the screen and the bot will save the settings and show you a confirmation message.
12

Click on the "Actions" icon to see the option of moving the chatbot left/right or clearing the chat.

Click on the "Actions" icon to see the option of moving the chatbot left/right or clearing the chat.
13

Make sure to configure the required parameters for all bots.

Make sure to configure the required parameters for all bots.
14

Once all the parameters are set, ask a question to the chatbot. The question will be written and sent in all bots if you type in one, as long as these are synced.

Once all the parameters are set, ask a question to the chatbot. The question will be written and sent in all bots if you type in one, as long as these are synced.
15

All chatbots will respond to the questions, and you can compare the performance/answer of each bot and decide which configuration is providing you best responses.

All chatbots will respond to the questions, and you can compare the performance/answer of each bot and decide which configuration is providing you best responses.
16

Click this icon to open more settings.

Click this icon to open more settings.
17

You can keep testing it until you find the best configuration for your chatbot. Once satisfied, you can select the same settings on the Tune AI page to apply these to the chatbot.

You can keep testing it until you find the best configuration for your chatbot. Once satisfied, you can select the same settings on the Tune AI page to apply these to the chatbot.
18

Done 🚀