An AI voice agent answering your calls is brilliant until the moment it shouldn't be. A customer needs a refund outside policy. A tradie rings about a site access issue your CRM doesn't track. Someone's emotional, confused, or just wants to speak to "a real person, mate." If your AI doesn't know when to step aside, you risk frustrating the exact people you're trying to help.

The hand-off isn't a failure of automation. It's the point where automation proves its value by recognising its limit. Here are six trigger rules every Australian SMB should configure before their AI takes its first live call.

1. Confidence score below threshold

Every AI platform calculates a confidence score for what the caller just said. If the AI is only 60% sure it understood the request, it's better to escalate than guess. On the VoxReach platform, you can set a floor - typically 70-75% - below which the agent says, "Let me get someone who can help with that," and either transfers live or books a callback.

This threshold protects you from the AI confidently misinterpreting "cancel my appointment" as "confirm my appointment" because the line was noisy or the caller had a strong accent. One call we reviewed last week had background noise from a building site. The agent correctly flagged low confidence, transferred to the office, and the customer never knew anything went wrong.

2. Explicit escalation phrases

Train your AI to recognise phrases that mean "I want out of this loop." Common Australian signals include:

• "Can I just speak to someone?"
• "This isn't working."
• "Put me through to a person."
• "I need to talk to the boss."
• "Look, mate, I just want..."

When the agent detects these, the correct response is immediate transfer or offer to take details for urgent callback. Don't make the AI try three more times to solve the problem. Respect the request.

3. Refund, complaint, or legal keywords

Some topics carry risk you can't automate away. If the caller says "refund," "complaint," "privacy breach," "lawyer," "fair trading," or "ACCC," flag the call for human review or live transfer. The same goes for medical triage in health practices or anything involving a minor in allied health or education settings.

You can still let the AI collect initial details - name, booking reference, nature of issue - then route to the right person. But the decision itself stays human. This protects your business legally and shows the customer you take them seriously.

4. Repeat loop detection

If the AI asks the same clarifying question twice, something's broken. Maybe the caller's answering in an unexpected way. Maybe your workflow has a gap. Either way, continuing the loop frustrates everyone.

Set a rule: after two attempts to gather the same piece of information, the agent says, "Let me connect you with the team," and transfers or schedules callback. This prevents the dreaded "sorry, I didn't catch that" death spiral that makes people hang up and ring your competitor.

5. High-value or VIP caller flags

Not every caller is equal. If your CRM tags a customer as high-value, long-term, or VIP, you might want a human voice from the start - or at least a lower threshold for transfer. On VoxReach, you can check the caller's number against your CRM in real time and route accordingly.

A Bondi-based clinic using the platform told us they flag any caller who's spent over five figures in the past year. The AI still answers, confirms identity, but immediately offers, "I'll put you straight through to Sarah," rather than running the standard triage. It's a small touch that reinforces the relationship.

6. Time-sensitive or emergency scenarios

Some calls can't wait. If a tradie rings about a burst pipe, a patient calls with chest pain, or a client needs urgent after-hours access to a file, the AI should fast-track. You define the keywords or phrases, and the agent either transfers immediately or - if no one's available - takes detailed notes and fires an SMS or email alert to your on-call number.

This rule also covers after-hours policy. You might let the AI handle routine bookings and FAQs overnight but escalate anything marked urgent to your mobile. That way you sleep through the "what are your opening hours?" calls and wake up for the ones that matter.

Setting the policy in practice

Start simple. Pick three of the six rules above and configure them in your first week. Monitor the transcripts. If you see the AI handing off too often, tighten the confidence threshold or refine your phrase list. If you see it trying to handle something it shouldn't, add a new keyword trigger.

The goal isn't zero hand-offs. It's smart hand-offs - automated triage that knows when a human touch is worth more than speed. When you get that balance right, your AI becomes the best receptionist you've ever had: tireless for the routine, humble enough to step aside for the complex.

Sign up at app.voxreach.com.au/signup and test these rules with a free 90-second demo call on us. You get full Australian voice, and you'll see exactly where your first hand-off happens.