Skip to content

Add AddisAI STT and TTS plugin - #6601

Open
ZelalemGizachew wants to merge 5 commits into
livekit:mainfrom
ZelalemGizachew:agent/addisai-plugin
Open

Add AddisAI STT and TTS plugin#6601
ZelalemGizachew wants to merge 5 commits into
livekit:mainfrom
ZelalemGizachew:agent/addisai-plugin

Conversation

@ZelalemGizachew

@ZelalemGizachew ZelalemGizachew commented Jul 29, 2026

Copy link
Copy Markdown

What this adds

I'm adding an AddisAI plugin for LiveKit Agents with:

  • batch STT through addis-whisper
  • non-streaming TTS through Addis Voices 2
  • explicit Amharic (am) and Afaan Oromo (om) language support
  • dynamic voice IDs, with am-hamen as the documented Amharic default
  • pcm_16000, wav_44100, and mp3_44100 output support

AddisAI is building language-native speech models for Amharic and Afaan Oromo, and I wanted those services to be usable directly in a LiveKit voice pipeline.

Implementation notes

The current AddisAI Python SDK is synchronous, so this plugin uses LiveKit's shared asynchronous HTTP session instead of blocking the agent event loop.

The capabilities match what the APIs provide today:

  • STT is marked non-streaming and returns final transcripts. LiveKit can adapt it with a VAD.
  • TTS is marked non-streaming. LiveKit can adapt it by synthesizing sentence chunks.
  • TTS keeps one provider client_request_id across retry attempts so an uncertain response does not create or bill a second clip.
  • Every retry attempt uses a fresh LiveKit output request ID, while the stable provider clip ID is retained separately for trace correlation. This lets downstream consumers discard partial audio from a failed attempt safely.
  • STT maps the provider request ID, confidence, and usage metadata.
  • The STT multipart field headers match the official SDK wire format. The production endpoint ignores request_data when that part is labeled text/plain.
  • Provider HTTP failures remain LiveKit APIStatusError values so retryability and diagnostics are preserved.

I intentionally kept AddisAI text/multimodal generation and the realtime audio WebSocket out of this PR. They are promising follow-ups, but their current public contracts do not yet expose all of the streaming, tool, transcript, session, and interruption behavior needed for complete LiveKit LLM or Realtime Model implementations.

Validation

  • 13 hermetic unit tests covering STT multipart requests, response mapping, language validation, HTTP errors, TTS clip download, inline audio, retry idempotency, and fresh output IDs across retries
  • Ruff formatting and linting
  • Mypy type checking
  • Wheel and source-distribution builds
  • Live Amharic round trip: am-hamen TTS to STT, 0.919 transcription confidence
  • Live Afaan Oromo round trip: om-ayyaantuu TTS to STT, 0.949 transcription confidence
  • End-to-end LiveKit Cloud test project using the AddisAI STT and TTS providers

The credential-backed smoke tests exercised the plugin itself against the production AddisAI TTS and STT endpoints. Both language paths completed successfully, and I have also tested the providers in a LiveKit Cloud agent, so I'm marking this ready for review.

Node.js companion

The matching Node.js package is now proposed separately in livekit/agents-js#2160. It follows the agents-js package architecture as @livekit/agents-plugin-addisai and includes the same STT/TTS language support, retry behavior, tests, TypeDoc/API report, README, and a Gemini example.

Documentation and provider listing

I would also like AddisAI to be discoverable alongside the other model providers after these plugins are merged and released. Could you please:

  • add AddisAI (Python and Node.js) to the STT provider table at /agents/models/stt/
  • add AddisAI (Python and Node.js) to the TTS provider table at /agents/models/tts/
  • publish an AddisAI STT guide at /agents/models/stt/addisai/ with Python and Node.js tabs
  • publish an AddisAI TTS guide at /agents/models/tts/addisai/ with Python and Node.js tabs

The Python package README and Node package README/API report include docs-ready installation, authentication, usage, parameters, language support, and resource links for both guides. I'm happy to send a separate docs PR too if the current documentation source or workflow is available to external contributors.

@CLAassistant

CLAassistant commented Jul 29, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@ZelalemGizachew
ZelalemGizachew marked this pull request as ready for review July 29, 2026 11:02
@ZelalemGizachew
ZelalemGizachew requested a review from a team as a code owner July 29, 2026 11:02

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 285d9d0b6a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread livekit-plugins/livekit-plugins-addisai/livekit/plugins/addisai/tts.py Outdated

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 654f30fce7

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread livekit-plugins/livekit-plugins-addisai/livekit/plugins/addisai/tts.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants