Skip to content

fix(inference): tolerate null token counts in streamed usage - #6596

Closed
VihaanAgarwal wants to merge 1 commit into
livekit:mainfrom
VihaanAgarwal:fix/inference-null-usage-tokens
Closed

fix(inference): tolerate null token counts in streamed usage#6596
VihaanAgarwal wants to merge 1 commit into
livekit:mainfrom
VihaanAgarwal:fix/inference-null-usage-tokens