How to setup AI voices

The AI voice feature uses ElevenLabs to generate text to speech messages with AI generated voices. Elevenlabs has a wide range of pre-made voices and you can create your own AI voices based on audio fragments.

How to setup

  1. Sign up for ElevenLabs to get access to their AI voices. If you want to support Stream buddy, please consider using our affiliate link

  2. Once you have an account, you can create your own AI voices using the VoiceLab

  3. In order to link ElevenLabs to Stream buddy, you can grab your API key by clicking on your My Account > Profile + API key. This API key should be inserted into Stream buddy in the AI Voices screen.

Setup AI voices in Stream buddy

Prerequisites

  • You need to have StreamElements linked in the Connections screen.
  • Turn off the text to speech on your StreamElements alert widget. Otherwise both TTS will play simultaneously.

Manage AI voice

Here you can setup the voice you created in ElevenLabs in Stream buddy.

For each voice you can setup a Prefix. People who donate can then place that prefix in front of their donation message in order to play a certain voice. For example: Hitch: to play Hitch’s voice.

You can then select the Voice and Model from Elevenlabs. We currently recommend using the Eleven Multilangual v2 model.

Finally you can also mark one voice as the Default voice. This is the AI voice that will be used if no Prefix is used in the donation/cheer message. Note: If you don’t select a default voice no text to speech will be generated in case there’s no prefix in the message.

Events

You can use AI voices for specific events:

  • StreamElements donations
  • Twitch bits
  • Twitch subscriptions

For each of the events you can setup:

  • Use AI voice
    This will enable the AI voice for this event.
  • Minimum amount for using AI voice
    Select the minimum amount of donation/bits to use the AI voice
  • Announce the event with AI voice
    Enabling this will also have the AI voice announce the event that happens. For example xxx just donated xxx usd.
  • Announcement message
    Provide the message announcing the event. You can use {username} and {amount} in this message to get those values in the message.

Delay for text to speech (seconds)
If you have an audio alert with a donation or cheer, you want to set the duration of that audio alert here. Doing that will cause the AI text to speech to start playing after the audio alert.