Voice

Voice orchestrator settings control how the assistant handles spoken conversations — how it listens, how it speaks, and how it behaves during a call.

What the page shows depends on the voice version the assistant runs on:

  • Voice 2.0 runs calls on a native speech-to-speech model (GPT Realtime), which listens and speaks in one step. It speaks the caller's language and can switch language partway through a call. The page has three sections: Instructions, Speech detection, and Select voice.
  • Voice 1.0 runs calls on the legacy Retell pipeline, which converts speech to text and synthesizes the reply. It understands and speaks English only. The page has two sections: Transcription settings and Select voice.
⚠️

Voice 1.0 is being retired

Voice 1.0, the Retell-based pipeline, is deprecated and will be retired by January 2027. Voice 2.0 will then be turned on by default for every assistant still on voice 1.0.

If your assistant is on voice 1.0, switch your UAT assistant to voice 2.0 now and test it against your real use cases. The switch can't be undone, so start with UAT.

Where to find it

Open the Admin Console, then go to Orchestrator → Voice.

📘

Access and prerequisites

Voice sits inside the Orchestrator group, so it is available to roles granted Orchestrator settings.

The virtual assistant must also be on the latest architecture (AIC). If it isn't, contact your Leena AI implementation contact before enabling voice.

Which version is the assistant on?

What you seeVoice 2.0Voice 1.0
Sections on the pageInstructions, Speech detection, Select voiceTranscription settings, Select voice
More menu (⋮) in headerDisable voice orchestratorSwitch to voice 2.0, Disable voice orchestrator
Call button tooltip in the web appStart voice chatStart voice chat (English only)
LanguagesThe caller's language, switching mid-call — see LanguagesEnglish only
Call history in AI Colleagues StudioYes — see Call historyNo

Enabling voice

Until voice is switched on, the page shows a disabled state — Voice is disabled, with a prompt explaining that enabling it lets employees speak and receive spoken responses. Click Enable voice to turn it on. Voice is always enabled on voice 2.0; there is no version to choose.

To turn it off again, open the more menu (⋮) and choose Disable voice orchestrator. A confirmation appears first, because disabling removes voice calling for the whole organization and it has to be switched back on manually — there is no automatic recovery.

📘

Re-enabling starts on voice 2.0

Turning voice off and on again brings the assistant back on voice 2.0, even if it was on voice 1.0 before. Treat disabling a voice 1.0 assistant the same way as switching it.

Switching to voice 2.0

An assistant on voice 1.0 moves to voice 2.0 from this page:

  1. Open the more menu (⋮) in the page header and choose Switch to voice 2.0. It isn't available while you're editing — save or cancel your changes first.
  2. Read the confirmation and click Switch now.

The page reloads with the voice 2.0 settings, and the next call runs on voice 2.0.

⚠️

The switch is one-way

Once an assistant is on voice 2.0, it can't be moved back to voice 1.0. Switch your UAT assistant first, test it, then switch production.

What happens to existing settings

Voice 1.0 settingOn voice 2.0
Additional instructionsCarried over as Voice model instructions. They now guide the speech-to-speech model, so review them after switching
Selected voiceNot carried over. Voice 1.0 voices don't exist on voice 2.0, so the assistant uses Marin until you choose another
Denoising modeNo setting. Voice 2.0 reduces noise automatically, tuned separately for phone and web calls
Vocabulary specialization, Boosted keywordsNo equivalent
Small talk frequencyNo setting. Voice 2.0 handles silence on its own — see Handled automatically
Phone numberMoves to voice 2.0 with the assistant, so phone calls switch at the same moment as web calls
Language (English only)The assistant now speaks the caller's language, on web and phone. There is no language list to configure — see Languages

If the assistant takes phone calls

⚠️

Phone calls on voice 2.0 need a Leena AI number

Phone calls on voice 2.0 currently run only on numbers from the Leena AI Twilio account. If the assistant's number is on your own Twilio account, the switch is refused and the assistant stays on voice 1.0.

Keep phone assistants on your own Twilio account on voice 1.0 for now. We'll update this page when your own Twilio account is supported on voice 2.0. See Voice & SMS → Phone call.

Test in UAT before the default changes

Switch your UAT assistant, then run the calls your employees actually make — on web, and on phone if you use it:

  • Your highest-volume requests, end to end — leave balance, tickets, policy questions, approvals.
  • Requests that carry IDs, codes, email addresses and names. Voice 2.0 has no boosted keywords list, so check that the terms your employees say most are understood.
  • Every language your employees speak — on web and phone, starting a call in each one, switching partway through a call, and mixed speech such as Hindi with English words. Check the spoken answers and the chat cards that come with them.
  • Call control — interrupting the assistant, cancelling a running request, putting the call on hold and resuming.
  • Sign-in prompts during a call, if any of your workflows ask the employee to authenticate.
  • Your corporate network and VPN. On voice 2.0, web call audio travels over WebRTC directly between the browser and OpenAI, so test from the networks your employees use.
  • Noisy places, with the speech detection threshold at its default first.

Review each test call in Call history — status, disconnection reason and the runs it started — then tune the voice model instructions and the speech detection threshold, and test again. Report anything that doesn't behave as expected to your Leena AI implementation contact.

Editing settings

The page opens read-only. Click Edit to make changes, then Save to apply them or Cancel to discard them. Every section is an accordion and is expanded by default.

Voice 2.0 settings

Instructions

Voice model instructions is free-text guidance for the speech-to-speech model — tone, speaking speed, response style, and how to read out inputs such as alphanumeric codes (for example, digit by digit).

It accepts up to 1,000 words. The field shows a running word count and stops accepting text at the limit.

Instructions here shape how the assistant speaks, not what it does. Requests are still answered by the same orchestrator, tools and knowledge as in chat.

Speech detection

Speech detection threshold sets how clearly a sound must be speech before the assistant treats it as the caller talking. It is a slider from 0.30 to 0.95, in steps of 0.05. The default, 0.70, is marked Recommended and suits most callers.

DirectionEffect
Lower (more sensitive)Catches quiet or distant voices, but also reacts to background noise — the assistant may stop speaking or respond to sounds that weren't the caller
Higher (less sensitive)Ignores more noise, but can miss soft-spoken callers
👍

Change it in small steps

Start at the default. If the assistant keeps getting cut off by background noise, raise it a step or two; if it misses quiet callers, lower it. Test a few calls after each change.

Select voice

Voice 2.0 uses the speech-to-speech model's own voices. Marin and Cedar are marked Recommended, and Marin is the default.

The table shows a preview button to play a sample, the voice name and its gender. Narrow the list with the gender filter or search by name. Voice 2.0 voices aren't tied to an accent or age — every voice speaks whichever language the call is in — so there is no accent filter.

Use Select voice on a row to make it active. The current voice is marked Voice selected. In read-only mode the table shows just the active voice.

👍

Preview before you commit

Tone shapes how natural the assistant feels, and the effect is much stronger in speech than in text. Play a few samples in the languages your employees speak before selecting.

Languages

Voice 2.0 is multilingual by default. There is no language list or setting on this page — the assistant follows the caller.

WhatHow it works
Greeting on web callsIn the language the employee uses the web app in, or the assistant's default language
Greeting on phone callsIn the employee's language once the caller is identified. Before that — including OTP and KBA prompts — the assistant speaks its default language
SwitchingWhen the caller says a full sentence in another language, the call switches to it — speech, transcription, progress updates and the goodbye all follow
What doesn't switchSingle words, names, numbers, IDs, product names, a greeting, thanks or a goodbye in another language
Mixed speechA sentence that mixes languages counts as the language it is mainly in — Hindi with English words, or Hindi typed in Latin letters, is Hindi
AnswersEach request carries the call's language to the orchestrator, so answers come back in that language, as in chat
Which languagesAny language Leena AI supports. If the assistant picks the wrong one, the caller can correct it by saying which language they're speaking
MemoryNothing is remembered per employee. Every call starts from the greeting language

Language handling has no separate setting. Any extra guidance belongs in the Voice model instructions, and should be tested in each language your employees use.

Handled automatically on voice 2.0

These behaviours have no setting:

BehaviourWhat happens
Noise reductionTuned for phone handsets on phone calls and for laptop microphones on web calls
LanguageFollows the caller — see Languages
SilenceAfter about 12 seconds of silence the assistant checks in, and ends the call if there's still no reply 20 seconds later
Call lengthCalls end at 15 minutes. The assistant always says why before the line drops

Voice 1.0 settings (deprecated)

These settings apply only to assistants still on voice 1.0, and don't exist on voice 2.0.

📘

Voice 1.0 is English only

Speech recognition on voice 1.0 is set to US English, on web and phone calls, and there is no setting to change it. Employees who speak another language should use chat, or the assistant should be switched to voice 2.0. The web app's call button says Start voice chat (English only) for these assistants.

Transcription settings

These tune the quality and behaviour of speech-to-text during a call.

SettingWhat it does
Denoising modeFilters unwanted sound out of the input. Remove noise strips ambient environmental noise. Remove noise + background speech additionally suppresses other people audible nearby — the right choice for open-plan offices and shared spaces
Vocabulary specializationThe vocabulary set used for transcription. General suits most enterprise deployments; Medical is tuned for medical terminology
Boosted keywordsA custom list of words added to the model's vocabulary, so it recognises terms it would otherwise mishear
Additional instructionsFree-text guidance on how the voice orchestrator should behave — handling of small talk, filler words, response style, or input formats such as reading alphanumeric codes digit by digit
Small talk frequency (sec)How readily the assistant fills idle moments with small talk

Boosted keywords

Use this for anything the default model is unlikely to know: product codes, internal acronyms, team or system names, employee ID formats. It is the single most effective fix when the assistant consistently mishears a specific term.

You can add up to 100 keywords. Beyond that, the field asks you to remove existing entries before adding more.

Additional instructions

Free text, up to 1,000 words. The field shows a running word count and stops accepting text at the limit.

Small talk frequency

Set in seconds, from 3 to 8, adjusted with the stepper controls rather than typed. The default is 3.

📘

Lower means more small talk

The value is a threshold on idle time, not a rate — so a lower number produces small talk more often, and a higher number less often. Setting 8 makes the assistant noticeably quieter during pauses than the default of 3.

Select voice

Choose the voice the assistant speaks in. Voices span a range of accents, genders, and age styles, so you can match the assistant to your users.

The section header shows how many voices are available. Narrow the list using the gender and accent filters, or search — search matches on accent and age as well as name.

ColumnWhat it shows
SamplePreview button. Plays a clip of the voice
AvatarVisual avatar for the voice
VoiceThe voice name
AccentFor example American, British, Indian, Mexican
GenderThe voice's gender
AgeAge style, such as Young or Middle Aged

Use Select voice on a row to make it active. The current voice is marked Voice selected. In read-only mode the table shows just the active voice rather than the full list.


Did this page help you?