Skip to main content
All CollectionsTroubleshooting
Testing Bot Responses Yourself with OpenAI Playground
Testing Bot Responses Yourself with OpenAI Playground

Learn how to replicate bot responses by testing with OpenAI's playground for users who want fine-tuned troubleshooting ability

Max Pattillo avatar
Written by Max Pattillo
Updated over 5 months ago

The OpenAI playground is where to go when you want to quickly test why your bot responded a certain way. You can copy any of the prompt history from your CloseBot portal and run it within the playground to replicate results. This is helpful if you want to test how minor adjustments to areas of the prompting affect the output.

This is the same way CloseBot submits every message sent through the system. You can make changes to your prompting and test the result instantly instead of having to go through an entire conversation just to get to a specific objective you're trying to fix.

1. Copy

To get started, click on any message in your Closebot Dashboard to see the process that message went through before the final result. Here I clicked on the Main After Goal section and copied the contents. Take note of this message's Temperature and Model as we will need this information later as well.

The last tab is usually the one you'll want to copy. This is the final prompt that's used to determine what the bot will say to the customer.

2. Paste

In the Playground, I paste in what I just copied into the System section. When you paste, right click and select "Paste and Match Style". If you just select Paste, the formatting will be much more difficult to correct. We will have to move some of this over to the User and Assistant part next.

3. Format

Now you can delete the word System and start to transfer the User/Assistant messages to the right hand side of the playground. You can click on +Add message and click to toggle between User and Assistant type messages to make sure your labels are correct. Then delete from the System section everything you just moved over.

Once I've formatted everything it will look like this:

4. Adjust Settings

This is where we will make sure the Temperature and Model settings match what we had in our CloseBot dashboard message.

Submit

Now we are ready to submit!

You can see my result this time is slightly different then before. This is because of the 0.15 temperature setting. If I move temperature to 0 it will be the same every time I submit.

Now you can make changes to your prompting and see how those changes impacted the AI's response. In this example we copied in from our Main After Goal section but you can do this for the Goals, Calendar, and Library sections as well!๐Ÿค–

Did this answer your question?