All guides

Test Your AI Agent in the Playground Before You Go Live

Watsy Team·

Why test before going live

Your AI agent talks to real customers on WhatsApp. First impressions stick. So before you connect it to your number, you want to know exactly how it answers.

That’s what the Playground is for. It’s a private chat where you play the customer and watch your agent respond — no real customers involved, nothing public. Test as much as you want, change things, test again.

Think of it as a dress rehearsal. You catch the awkward moments now, not in front of a paying customer.

Simulate real customer questions

Don’t test with easy questions. Test with the messages your customers actually send.

Pull a few real ones from your WhatsApp history and try them:

  1. The common ones — “What are your hours?”, “How much does this cost?”, “Do you deliver to my area?”
  2. The messy ones — half-typed questions, voice notes, two questions in one message, a different language.
  3. The tricky ones — a complaint, an unusual request, something only a human should handle.

Send them one at a time. Read each reply like a customer would.

Spot wrong or awkward replies

As you chat, watch for:

  • Wrong facts — a price, a policy, or a detail that’s off.
  • Off-brand tone — too stiff, too casual, not how you’d talk.
  • Vague answers — it dances around the question instead of answering it.
  • Made-up info — it confidently says something you never told it.

Every weak reply is a clue. It usually points to either your agent’s persona or a missing Skill.

Tweak the persona and Skills, then re-test

Here’s the loop that makes your agent great:

  1. Adjust the persona for tone and behavior. Want shorter answers? A warmer voice? Tell it directly in the instructions.
  2. Add or fix a Skill for knowledge and process. Skills are on-demand playbooks your agent pulls in only when a question calls for it — your refund process, your delivery zones, your booking steps. If the agent didn’t know something, that’s a Skill to write or sharpen.
  3. Re-test the same question. Confirm the new reply is right.
  4. Repeat until the answers feel like your best team member wrote them.

Small changes, tested fast. That’s the whole game.

Check that it hands off when it should

Your agent should know its limits. It shouldn’t try to fake its way through everything.

Test the handoff on purpose:

  • Type “I want to talk to a person.”
  • Send an angry or upset message.
  • Ask something genuinely outside what your agent can resolve.

A good agent recognizes these moments and hands the conversation to a human — telling the customer a person will follow up. Confirm that happens cleanly in the Playground before you trust it with live chats.

Assign it to your number with confidence

Once your agent answers your real questions well, sounds like your brand, and hands off at the right moments — you’re ready.

Assign it to your WhatsApp number. Now it’s live, doing exactly what you watched it do in the Playground.

And testing never has to stop. Any time you change your prices, add a service, or want to improve a reply, go back to the Playground first. Test, tweak, then ship — your customers only ever see the polished version.