Skip to content

docs(deepgram): note current release 260728 and drop half_precision #306

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jonoirwinrsa wants to merge 2 commits into
base: master
Choose a base branch
from
Open

docs(deepgram): note current release 260728 and drop half_precision #306

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
a45de2c
docs(deepgram): note current release 260728 and drop half_precision
jonoirwinrsa Jul 31, 2026
6598c7c
Prettified Code!
jonoirwinrsa Jul 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 14 additions & 8 deletions partner-services/deepgram.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,13 @@ Consult the Deepgram representative on how to achieve parity with the Deepgram A
Deepgram Partner Service is available from CLI version 1.39.0 and greater
</Note>

<Note>
Deployments currently run Deepgram self-hosted release `260728`. Model files
and `engine.toml`/`api.toml` settings should match that release — check with
your Deepgram Account Representative if you are unsure whether your model
files are current.
</Note>

<Info>
The Deepgram Partner Service is in beta. It's available to all users and ready
for production workloads, but expect occasional rough edges while the
Expand Down Expand Up @@ -132,16 +139,15 @@ streaming_ner = false # or true
### streams supported by a single GPU. Please contact your Deepgram Account
### representative for more details.
step = 0.2


### Engine will automatically enable half precision operations if your GPU supports
### them. You can explicitly enable or disable this behavior with the state parameter
### which supports enabled, disabled, and auto (the default).
[half_precision]
state = "auto"
# state = "disabled" # or "enabled" or "auto"
```

<Note>
The Engine sets half precision automatically based on GPU support, so
`engine.toml` needs no `[half_precision]` section. Deepgram dropped that
setting in self-hosted release `260305`; if your `engine.toml` still carries
it, remove it when you next update the file.
</Note>

5. Create a file named <b>api.toml</b> with the following content and upload to your persistent storage under the app name directory (e.g., `{appName}/api.toml`). These are
the default settings. Adjust as needed.

Expand Down