When using an Avatar + Gemini Realtime = Error when interrupting

[mercuryyy]

This is very hard to repreduce i'v tested this on various setups and tried finding why this is happening but i think it might have to do with the avatar framework.

Only when an avatar is enabled and on gemini realtime when we interrupt the agent we get

2025-08-22 15:08:52,614 - WARNING livekit.plugins.google - truncate is not supported by the Google Realtime API. {"pid": 28580, "job_id": "AJ_YfHLDpCzEMao"}

which is normal since gemini does not support cutting the response short but this causes the avatar+llm to freeze up and not recover.

[longcw]

which avatar provider are you using, and does that work for other LLMs?

[mercuryyy]

using "hedra" This also happens with OpenAI realtime but not as consistently as with Gemini realtime.

This does not happen when we setup Gemini realtime to use elevanlabs (or other providers) for TTS pipeline.

I also tested this on 1.2.1 - 1.2.6

[mercuryyy]

@longcw i have tested with various combinations and this happens only with Gemini realtime on full realtime pipeline once you add a TTS provider it does not happen anymore.

Also this sometimes happens even without the avatar.

Finally when this happens the chat transcript keeps going the agent is receiving and responding (inside the chat context) but the audio does not play, this happens more often when not speaking english.

I have tried so many different logging steps and debugs i cant understand why this is happening mainly because it keeps responding in the chat context but the audio do not play.

[longcw]

it sounds an issue of the gemini realtime? can you share the logs and agent configurations