Is your AI setter working? How to measure AI appointment setting
Booked appointments are only the first number. The metrics that show whether AI appointment setting is paying off, and a weekly review routine to keep improving it.
·5 min read
Once an AI assistant is replying to leads and booking appointments, it is tempting to judge it by one number: how many appointments landed on the calendar. That number matters, but on its own it can hide real problems, such as low show rates, poor-fit bookings, or leads who stop replying halfway through.
A handful of simple measurements, reviewed every week, tells you whether the assistant is helping and where to improve its instructions.
The four numbers that matter
Track these for AI-handled conversations and, if you can, for conversations your team handles by hand, so you have a fair comparison.
- ✓Reply-to-booking rate: of leads who replied, how many booked
- ✓Show rate: of booked appointments, how many happened
- ✓Close rate: of appointments held, how many became customers
- ✓Handoff rate: how often the conversation needed a person
Read a sample of conversations every week
Numbers tell you something is off; transcripts tell you why. Each week, read ten or fifteen AI conversations, including a few that booked, a few that stalled, and every one where a lead seemed unhappy. Look for replies that are too long, questions asked twice, invented details, and moments where the assistant missed a clear buying signal.
Every problem you find becomes a change to the instructions. Over a few weeks, the same small edits add up to a noticeably better setter.
Find where conversations stall
Most stalled conversations stop at the same few points: right after the first qualifying question, when times are offered, or after a price question the assistant cannot answer. If many conversations die at one step, that step needs work. Try a different question, offer times earlier, or give a clearer answer about when pricing will be discussed.
Separate show-rate problems from booking problems
If bookings look healthy but attendance is poor, the issue is usually after the booking: a vague confirmation, no reminder, or appointments booked too far out. Tighten confirmations and reminders before changing how the assistant books.
If attendance is good but few leads book, the issue is in the conversation itself, and the transcripts will show where.
Count the cost honestly
Compare what AI replies cost with what the appointments are worth. On the Text2Sale + AI plan, AI replies are $0.025 each on top of the $0.012 per text segment. A conversation of ten AI replies costs well under a dollar, which is easy to justify if even a small share of those conversations becomes a sale, but it is still worth knowing the number.
Compare against your own team
The most useful benchmark is not an industry average; it is your own team. For a few weeks, look at conversations a person handled next to conversations AI handled, from similar lead sources. If AI books at a similar rate and those appointments show and close at a similar rate, it is doing the job at any hour. If one number lags, you know exactly which part of the instructions or follow-up to work on.
Keep the comparison fair. Leads that arrive at 2 a.m. behave differently from leads that arrive at 2 p.m., so compare like with like wherever you can.
Key takeaways
- →Measure reply-to-booking, show rate, close rate, and handoff rate.
- →Read a sample of AI conversations every week and update the instructions.
- →Find the step where most conversations stall and fix that step.
- →Low attendance is usually a confirmation and reminder problem.
- →Compare AI reply costs with the value of the appointments booked.
Put this into practice with Text2Sale
Upload your leads, automate fast first-touch texts and follow-ups, stay 10DLC and TCPA compliant, and manage every conversation in one inbox.
Frequently asked questions
What is a good show rate for AI-booked appointments?
It depends on your industry and how far out appointments are booked. Compare AI-booked appointments with appointments your team books by hand; if the AI's show rate is noticeably lower, focus on confirmations and reminders.
How often should I update the AI's instructions?
Review conversations weekly and make small changes when you see a pattern. Frequent, small edits work better than occasional rewrites.
How much do AI replies cost in Text2Sale?
On the Text2Sale + AI plan ($59.99 per month), AI replies cost $0.025 each, plus $0.012 per text segment sent.