Articles  /  Conversation

How an AI Voice Agent Should Handle Interruptions

Conversation 6 min read By the TelAI team

Real phone calls rarely go in neat turns. Callers correct a detail before the agent finishes reading it back. They answer a question before it has been fully asked. They say "uh-huh" while listening, and their own voice echoes back from a speakerphone. A voice agent that only works when people wait politely for their turn will fall apart on the first real call.

This guide covers what an AI voice agent needs to get right when two voices overlap, and how to test it.

Not all overlap is an interruption

When the agent hears sound from the caller while it is speaking, that sound can mean very different things:

  • A real interruption. The caller wants to say something now, such as "wait, that's the wrong address."
  • A listening cue. Short sounds like "mm-hm", "yeah", "right" or "go ahead" that mean "I'm following, keep going."
  • Echo. The agent's own voice coming back through the caller's speakerphone.
  • Background noise. A television, a car, someone else in the room.

The agent has to tell these apart in a fraction of a second. Treating all of them as interruptions makes the agent stop constantly. Treating none of them as interruptions makes it talk over people.

Stop quickly, but not abruptly

When a caller really does cut in, the agent should yield fast. If it keeps talking for another sentence, the caller has to raise their voice or repeat themselves, and they come away feeling ignored. TelAI stops within a couple of words of the caller starting to speak.

How it stops matters too. A person who is interrupted doesn't go silent mid-syllable. They get quieter and trail off. An agent that cuts out instantly sounds like a dropped call. TelAI lowers its volume when the caller starts to speak and trails off naturally, which sounds like someone politely making room.

Remember what the caller actually heard

This is the easiest part to get wrong, and callers notice it even if they can't say why.

Say the agent was in the middle of this sentence: "Your order shipped Tuesday and should arrive by Friday, and the tracking number is in your confirmation email." The caller cuts in right after "should arrive by" to ask which address it went to.

A careless agent records that it said the whole sentence. From then on it assumes the caller knows the delivery day and where to find the tracking number, even though they never heard either one. Later in the call it might say "as I mentioned, it arrives Friday," which confuses the caller, or it might never mention the tracking number at all.

A better agent keeps track of how far it got before it was interrupted. TelAI remembers what the caller actually heard, so after answering the question about the address, it can come back to the delivery day naturally.

A good test is to interrupt the agent halfway through a sentence that contains two facts, then see whether the second fact comes up again later in the call.

Keep talking through "mm-hm"

Listening cues are a normal part of how people talk on the phone, and some callers use them constantly. If the agent stops every time it hears "yeah", it ends up saying half a sentence, pausing, waiting, and starting again. The caller didn't want the floor. They were just being polite.

TelAI treats short cues such as "mm-hm", "yeah" and "go ahead" as listening, not as interruptions, so the agent finishes what it was saying.

Don't mistake echo for the caller

Speakerphones and some headsets let the agent's own voice leak back into the line. A system that doesn't account for this can hear itself, decide the caller is speaking, and stop mid-sentence for no reason. Worse, it can try to reply to its own words.

TelAI rejects speakerphone echo, so the agent's voice coming back through the caller's phone is never mistaken for the caller.

Give the caller room to finish

The flip side of yielding to interruptions is not interrupting the caller. People pause mid-sentence to remember an order number or find the right word. If the agent jumps in during those pauses, it is the one doing the interrupting.

TelAI adjusts its pacing to the conversation: quicker replies after a clear question, more patience when the caller pauses mid-sentence. We cover the timing side in more detail in how quickly an AI phone agent should reply.

Keep answers short

The easiest way to reduce interruptions is to give callers fewer reasons to interrupt. Long answers invite them. A caller who hears a paragraph about the return policy when they only asked about the deadline will cut in to steer the conversation.

Short, conversational answers leave natural gaps where the caller can respond. TelAI keeps replies short by default, and you can reinforce that in the agent's instructions. See writing a scenario and instructions for an AI phone agent.

How to test interruption handling

Put a few minutes into calls designed to be awkward:

  • Interrupt the agent early, in the middle and near the end of a sentence.
  • Say "mm-hm" and "yeah" while it talks, and check that it keeps going.
  • Call on speakerphone with the volume turned up.
  • Interrupt a sentence that contains two pieces of information and see whether the second one comes back.
  • Pause for a couple of seconds mid-sentence and see whether the agent waits.
  • Talk over the agent with a correction, such as a different date, and check that it uses the correction.

Listen to the recordings afterward. If your system records the agent and the caller on separate channels, as TelAI does, it is much easier to hear exactly when each side started and stopped talking.


TelAI is an AI voice agent for phone calls that yields within a couple of words and remembers what the caller heard. See the conversation features

Hear TelAI on your own kind of call

TelAI puts a natural-sounding AI voice agent on your phone line, with live controls for your team and an analysis of each call. You can also see how it works first.

Request a demo