False
        

tag:github.com,2008:https://github.com/BerriAI/litellm/releases

Release notes from litellm

2026-10-01T05:40:24Z tag:github.com,2008:Repository/671269505/v1.103.2 2026-10-01T06:37:31Z
2026-10-02T01:55:43Z tag:github.com,2008:Repository/671269505/v1.105.0-dev.2 2026-10-02T08:33:03Z

v1.105.0-dev.2

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.2</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.105.0-dev.2/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.105.0-dev.2/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.2</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>fix(router): carry per-request routing reads on context variables instead of public method kwargs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5641341096" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43814" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43814/hovercard" href="https://github.com/BerriAI/litellm/pull/43814">#43814</a></li> <li>fix(bedrock): add beta header for output config in message by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5638444999" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43778" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43778/hovercard" href="https://github.com/BerriAI/litellm/pull/43778">#43778</a></li> <li>refactor: clean up fresh tech debt from 2026-09-29 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5643258611" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43830" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43830/hovercard" href="https://github.com/BerriAI/litellm/pull/43830">#43830</a></li> <li>test(router): settle the shared logging worker before recording shadow callbacks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5644865971" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43847" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43847/hovercard" href="https://github.com/BerriAI/litellm/pull/43847">#43847</a></li> <li>chore(model_prices): add Gemini Veo, Mistral and Azure Claude 4.5 deprecation dates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5647115979" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43857" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43857/hovercard" href="https://github.com/BerriAI/litellm/pull/43857">#43857</a></li> <li>fix(cost_calculator): bill ultrafast prompts above 272k at the ultrafast long-context rates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5636438212" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43764" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43764/hovercard" href="https://github.com/BerriAI/litellm/pull/43764">#43764</a></li> <li>refactor(rust): centralize Python bridge execution wrappers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5649135229" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43871" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43871/hovercard" href="https://github.com/BerriAI/litellm/pull/43871">#43871</a></li> <li>chore(cost-map): add openai gpt-image-2.5 batch prices from the pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5648641468" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43869" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43869/hovercard" href="https://github.com/BerriAI/litellm/pull/43869">#43869</a></li> <li>chore(cost-map): add fireworks priority prices for ember-1, nemotron and glm 5.3 us rows by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5640731612" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43811" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43811/hovercard" href="https://github.com/BerriAI/litellm/pull/43811">#43811</a></li> <li>fix(proxy): attribute completed batch cost rows to /batches in daily activity by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5648986207" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43870" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43870/hovercard" href="https://github.com/BerriAI/litellm/pull/43870">#43870</a></li> <li>fix(router): strip encrypted reasoning the pinned deployment cannot decrypt by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5638785720" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43781" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43781/hovercard" href="https://github.com/BerriAI/litellm/pull/43781">#43781</a></li> <li>fix(cost_calculator): stop copying optional_params into response hidden params by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622338895" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43637" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43637/hovercard" href="https://github.com/BerriAI/litellm/pull/43637">#43637</a></li> <li>feat(pricing): add vertex_ai gemini-3.8 flash tts rows by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5650138472" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43876" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43876/hovercard" href="https://github.com/BerriAI/litellm/pull/43876">#43876</a></li> <li>fix(proxy): keep request-body credentials out of stored spend-log requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622307070" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43635" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43635/hovercard" href="https://github.com/BerriAI/litellm/pull/43635">#43635</a></li> <li>fix(ui): right-align money and count columns across tables by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5218082447" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/37889" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/37889/hovercard" href="https://github.com/BerriAI/litellm/pull/37889">#37889</a></li> <li>feat(agents): enforce authoritative agent permissions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5632729792" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43721" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43721/hovercard" href="https://github.com/BerriAI/litellm/pull/43721">#43721</a></li> <li>fix(proxy): strip caller credentials from websocket passthrough by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5646837260" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43855" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43855/hovercard" href="https://github.com/BerriAI/litellm/pull/43855">#43855</a></li> <li>fix(ui): render access group MCP and agent selections as wrapping chips by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5461835942" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41228" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41228/hovercard" href="https://github.com/BerriAI/litellm/pull/41228">#41228</a></li> <li>fix(responses): scan and mask top-level instructions with guardrails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622070730" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43629" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43629/hovercard" href="https://github.com/BerriAI/litellm/pull/43629">#43629</a></li> <li>feat(traces): add Rust storage foundation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5642137417" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43819" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43819/hovercard" href="https://github.com/BerriAI/litellm/pull/43819">#43819</a></li> <li>feat(ui): agent traces tab on logs with timeline and otel setup guide by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651405410" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43891" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43891/hovercard" href="https://github.com/BerriAI/litellm/pull/43891">#43891</a></li> <li>feat(otel v2): excluded_services opt-out for datastore spans on tenant destinations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591039974" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43278" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43278/hovercard" href="https://github.com/BerriAI/litellm/pull/43278">#43278</a></li> <li>fix(traces): correct ClickHouse rollup partitioning, dedupe keys, and retention changes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651732584" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43901" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43901/hovercard" href="https://github.com/BerriAI/litellm/pull/43901">#43901</a></li> <li>fix(bedrock): keep applicable beta headers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5643092899" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43829" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43829/hovercard" href="https://github.com/BerriAI/litellm/pull/43829">#43829</a></li> <li>feat(agents): authenticate Entra identities and delegated requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5632730579" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43722" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43722/hovercard" href="https://github.com/BerriAI/litellm/pull/43722">#43722</a></li> <li>fix(hosted_vllm): keep reasoning_content on replayed assistant messages by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619937959" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43599" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43599/hovercard" href="https://github.com/BerriAI/litellm/pull/43599">#43599</a></li> <li>fix(proxy): delete large teams without per-member transaction fan-out by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5572051358" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42998" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42998/hovercard" href="https://github.com/BerriAI/litellm/pull/42998">#42998</a></li> <li>feat(tracing): port OTLP ingestion to current trace foundation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652342218" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43915" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43915/hovercard" href="https://github.com/BerriAI/litellm/pull/43915">#43915</a></li> <li>feat(proxy): add native ROI calculator for gateway spend vs merged PRs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5626046726" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43669" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43669/hovercard" href="https://github.com/BerriAI/litellm/pull/43669">#43669</a></li> <li>test(e2e): repair completion, SAIL, and spend-log fixtures by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651736995" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43902" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43902/hovercard" href="https://github.com/BerriAI/litellm/pull/43902">#43902</a></li> <li>test(s3_v2): pin async 5xx retry through the production AsyncHTTPHandler by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5575915381" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43080" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43080/hovercard" href="https://github.com/BerriAI/litellm/pull/43080">#43080</a></li> <li>feat(ui): adopt the new LiteLLM logo and monogram by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652264622" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43913" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43913/hovercard" href="https://github.com/BerriAI/litellm/pull/43913">#43913</a></li> <li>fix(proxy): relay Azure passthrough body model groups through the router by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651582852" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43896" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43896/hovercard" href="https://github.com/BerriAI/litellm/pull/43896">#43896</a></li> <li>fix(proxy): register a UI-configured arize callback next to otel under OTel v2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651805454" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43906" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43906/hovercard" href="https://github.com/BerriAI/litellm/pull/43906">#43906</a></li> <li>fix(transcription): honor base_url alias for Groq Whisper and report it as the api base by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652443638" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43917" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43917/hovercard" href="https://github.com/BerriAI/litellm/pull/43917">#43917</a></li> <li>feat(tracing): store spend in ClickHouse automatically by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5653420048" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43928" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43928/hovercard" href="https://github.com/BerriAI/litellm/pull/43928">#43928</a></li> <li>fix(packaging): keep wheel paths under Windows MAX_PATH for Store Python by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651752634" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43903" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43903/hovercard" href="https://github.com/BerriAI/litellm/pull/43903">#43903</a></li> <li>feat(agents): add identity registration and dashboard controls by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5632731407" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43723" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43723/hovercard" href="https://github.com/BerriAI/litellm/pull/43723">#43723</a></li> <li>refactor(proxy): answer every team access check with TeamAccess.allows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598069455" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43364" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43364/hovercard" href="https://github.com/BerriAI/litellm/pull/43364">#43364</a></li> <li>test(bedrock): restore the AWS env after a failed live call in the auth tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652739895" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43921" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43921/hovercard" href="https://github.com/BerriAI/litellm/pull/43921">#43921</a></li> <li>feat(lens): analyze agent activity with a separate worker by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651258115" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43889" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43889/hovercard" href="https://github.com/BerriAI/litellm/pull/43889">#43889</a></li> <li>fix(router): bill service tiers at catalog rates for custom-priced deployments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651278742" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43890" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43890/hovercard" href="https://github.com/BerriAI/litellm/pull/43890">#43890</a></li> <li>test(ci): refresh qualified retired OpenAI fixtures by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5653897672" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43938" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43938/hovercard" href="https://github.com/BerriAI/litellm/pull/43938">#43938</a></li> <li>fix(anthropic): forward the dangerous-tool-use beta to Azure AI Foundry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5653752349" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43934" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43934/hovercard" href="https://github.com/BerriAI/litellm/pull/43934">#43934</a></li> <li>test(proxy): scope user_api_key_auth overrides in proxy_server tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654781962" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43952" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43952/hovercard" href="https://github.com/BerriAI/litellm/pull/43952">#43952</a></li> <li>fix(wandb): set supports_vision true on GLM-5.3-Flash by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654702475" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43951" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43951/hovercard" href="https://github.com/BerriAI/litellm/pull/43951">#43951</a></li> <li>chore(cost-map): sync openrouter prices from the models API by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654700226" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43950" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43950/hovercard" href="https://github.com/BerriAI/litellm/pull/43950">#43950</a></li> <li>fix(grayswan): send request conversation and tool calls to post-call monitor by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5637385683" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43770" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43770/hovercard" href="https://github.com/BerriAI/litellm/pull/43770">#43770</a></li> <li>fix(azure_storage): name Data Lake objects without base64 padding or slashes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652285837" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43914" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43914/hovercard" href="https://github.com/BerriAI/litellm/pull/43914">#43914</a></li> <li>fix(guardrails): treat an unknown straiker api_version as unset instead of skipping the guardrail by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655133843" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43956" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43956/hovercard" href="https://github.com/BerriAI/litellm/pull/43956">#43956</a></li> <li>chore(deps): bump gitpython and tornado, extend diskcache osv ignore to Nov 1 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655237286" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43961" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43961/hovercard" href="https://github.com/BerriAI/litellm/pull/43961">#43961</a></li> <li>fix(azure_storage): keep the DataLakeServiceClient alive until its TTL elapses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5575926655" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43082" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43082/hovercard" href="https://github.com/BerriAI/litellm/pull/43082">#43082</a></li> <li>feat(proxy): record in spend logs whether a request used a client-forwarded Anthropic OAuth token by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5575477318" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43063" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43063/hovercard" href="https://github.com/BerriAI/litellm/pull/43063">#43063</a></li> <li>test(ci): repair stale tests and move retired OpenAI text-completion fixtures by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655177632" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43958" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43958/hovercard" href="https://github.com/BerriAI/litellm/pull/43958">#43958</a></li> <li>feat(e2e): record each e2e test's steps, starting with ProxyClient by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5534367285" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42393" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42393/hovercard" href="https://github.com/BerriAI/litellm/pull/42393">#42393</a></li> <li>feat(providers): add Cortecs as an OpenAI-compatible provider by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5649279864" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43872" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43872/hovercard" href="https://github.com/BerriAI/litellm/pull/43872">#43872</a></li> <li>feat(ui): filter tags by name and description on the Tag Management page by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/galovics/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/galovics">@galovics</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5569110662" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42949" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42949/hovercard" href="https://github.com/BerriAI/litellm/pull/42949">#42949</a></li> <li>fix(caching): write the response-cache SET to Redis at once instead of on the post-call batch by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5656189976" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43973" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43973/hovercard" href="https://github.com/BerriAI/litellm/pull/43973">#43973</a></li> <li>test(e2e): typed per-test metadata for the e2e suite by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5514355745" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42044" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42044/hovercard" href="https://github.com/BerriAI/litellm/pull/42044">#42044</a></li> <li>feat(guardrails): honor litellm_params.timeout in every HTTP guardrail by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578121348" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43134" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43134/hovercard" href="https://github.com/BerriAI/litellm/pull/43134">#43134</a></li> <li>chore(cost-map): add fireworks inkling priority prices from the prices api by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654698934" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43949" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43949/hovercard" href="https://github.com/BerriAI/litellm/pull/43949">#43949</a></li> <li>chore(cost-map): add deprecation date for anthropic claude-sonnet-4-5 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651636314" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43898" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43898/hovercard" href="https://github.com/BerriAI/litellm/pull/43898">#43898</a></li> <li>fix(cost-map): raise baseten DeepSeek-V4.1-Flash max output to 262144 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652353329" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43916" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43916/hovercard" href="https://github.com/BerriAI/litellm/pull/43916">#43916</a></li> <li>fix(proxy): restore pre-config-wins handling of pass-through endpoints by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655294294" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43962" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43962/hovercard" href="https://github.com/BerriAI/litellm/pull/43962">#43962</a></li> <li>feat(lens): investigate sampled traces and retain batch results by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654272229" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43942" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43942/hovercard" href="https://github.com/BerriAI/litellm/pull/43942">#43942</a></li> <li>fix(guardrails): scan Responses API input in Azure Prompt Shield by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639096542" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43786" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43786/hovercard" href="https://github.com/BerriAI/litellm/pull/43786">#43786</a></li> <li>fix(guardrails): scan Responses API input in Azure Text Moderation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655655590" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43965" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43965/hovercard" href="https://github.com/BerriAI/litellm/pull/43965">#43965</a></li> <li>refactor: clean up fresh tech debt from 2026-09-30 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5658920279" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43993" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43993/hovercard" href="https://github.com/BerriAI/litellm/pull/43993">#43993</a></li> <li>test: inject the HIBP client and the MCP loop clock so two backend tests stop flaking by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5661111581" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44007" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44007/hovercard" href="https://github.com/BerriAI/litellm/pull/44007">#44007</a></li> <li>fix(cost-map): reprice fireworks deepseek v4.1 flash to the 2026-10-01 pricing update by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5664175983" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44024" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44024/hovercard" href="https://github.com/BerriAI/litellm/pull/44024">#44024</a></li> <li>test(anthropic): native /v1/messages reasoning integration tests built on a captured Claude Code request by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597905979" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43361" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43361/hovercard" href="https://github.com/BerriAI/litellm/pull/43361">#43361</a></li> <li>fix(bedrock): add beta header for thinking display updates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5643418619" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43832" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43832/hovercard" href="https://github.com/BerriAI/litellm/pull/43832">#43832</a></li> <li>fix(proxy): preserve decision request bodies under token limits by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652713683" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43920" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43920/hovercard" href="https://github.com/BerriAI/litellm/pull/43920">#43920</a></li> <li>test(proxy): migrate DB and Redis backed proxy tests into tests/integration by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5659681333" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43996" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43996/hovercard" href="https://github.com/BerriAI/litellm/pull/43996">#43996</a></li> <li>feat(lens): track worker spend through virtual keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5658072877" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43989" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43989/hovercard" href="https://github.com/BerriAI/litellm/pull/43989">#43989</a></li> <li>test(proxy): move auth, hooks, policy_engine and client tests into tests/unit/proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5660061401" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43998" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43998/hovercard" href="https://github.com/BerriAI/litellm/pull/43998">#43998</a></li> <li>fix(ui): give model leaderboard a distinct trophy icon by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5665961953" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44036" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44036/hovercard" href="https://github.com/BerriAI/litellm/pull/44036">#44036</a></li> <li>test(ci): repair stale tests and flaky CI infrastructure by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5657259933" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43983" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43983/hovercard" href="https://github.com/BerriAI/litellm/pull/43983">#43983</a></li> <li>test(proxy): move management_endpoints, management_helpers and guardrails tests into tests/unit/proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5660378025" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44003" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44003/hovercard" href="https://github.com/BerriAI/litellm/pull/44003">#44003</a></li> <li>feat(ui): agent traces open in a side drawer with a chat-style run view by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5656163407" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43972" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43972/hovercard" href="https://github.com/BerriAI/litellm/pull/43972">#43972</a></li> <li>feat(s3_v2): add s3_partition_granularity option for hourly S3 folders by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5635130961" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43748" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43748/hovercard" href="https://github.com/BerriAI/litellm/pull/43748">#43748</a></li> <li>refactor(lens)!: rename internal engine code and API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5665882231" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44034" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44034/hovercard" href="https://github.com/BerriAI/litellm/pull/44034">#44034</a></li> <li>test(proxy): move utils, agent_endpoints and endpoint tests into tests/unit/proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5661068693" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44006" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44006/hovercard" href="https://github.com/BerriAI/litellm/pull/44006">#44006</a></li> <li>test(proxy): move proxy_server, _experimental and db tests into tests/unit/proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5662070949" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44012" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44012/hovercard" href="https://github.com/BerriAI/litellm/pull/44012">#44012</a></li> <li>test(proxy): move middleware, spend_tracking, pass_through, common_utils and root proxy tests into tests/unit/proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5662325719" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44015" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44015/hovercard" href="https://github.com/BerriAI/litellm/pull/44015">#44015</a></li> <li>test(proxy): delete the legacy proxy test tree and shard tests/unit/proxy by glob by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5662593289" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44018" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44018/hovercard" href="https://github.com/BerriAI/litellm/pull/44018">#44018</a></li> <li>chore(deps): bump pypdf from 6.16.2 to 6.19.0 by <a class="user-mention notranslate" data-hovercard-type="organization" data-hovercard-url="/orgs/dependabot/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dependabot">@dependabot</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5665842920" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44033" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44033/hovercard" href="https://github.com/BerriAI/litellm/pull/44033">#44033</a></li> <li>chore(deps): drop unused pytest-postgresql dev dependency by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5667329694" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44056" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44056/hovercard" href="https://github.com/BerriAI/litellm/pull/44056">#44056</a></li> <li>docs(proxy): point mcp_server test references at tests/unit/proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5667326361" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44055" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44055/hovercard" href="https://github.com/BerriAI/litellm/pull/44055">#44055</a></li> <li>feat(ui): show daily token totals on the model leaderboard by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5666632941" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44044" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44044/hovercard" href="https://github.com/BerriAI/litellm/pull/44044">#44044</a></li> <li>chore(lint): remove the LIT002 mutable-construction rule by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655939513" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43971" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43971/hovercard" href="https://github.com/BerriAI/litellm/pull/43971">#43971</a></li> <li>feat(vertex-ai): add vertex_ai/xai/grok-4.7 pricing by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5667682722" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44059" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44059/hovercard" href="https://github.com/BerriAI/litellm/pull/44059">#44059</a></li> <li>feat(ui): drop the Beta badge from the Cost Optimization nav item by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655769176" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43967" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43967/hovercard" href="https://github.com/BerriAI/litellm/pull/43967">#43967</a></li> <li>test(e2e): bill Sail windows that synchronous calls can still use by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5667533906" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44058" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44058/hovercard" href="https://github.com/BerriAI/litellm/pull/44058">#44058</a></li> <li>ci(circleci): test Redis behavior against local Redis and print short tracebacks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668018015" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44062" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44062/hovercard" href="https://github.com/BerriAI/litellm/pull/44062">#44062</a></li> <li>fix(router): keep silent_model out of embedding provider requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668134323" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44064" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44064/hovercard" href="https://github.com/BerriAI/litellm/pull/44064">#44064</a></li> <li>fix(cost-map): add perplexity, openrouter, voyage and nebius models and fix registry metadata by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651842615" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43907" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43907/hovercard" href="https://github.com/BerriAI/litellm/pull/43907">#43907</a></li> <li>feat(tool-policies): show the user who owns the key that discovered a tool by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651416988" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43892" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43892/hovercard" href="https://github.com/BerriAI/litellm/pull/43892">#43892</a></li> <li>feat(proxy): gzip buffered responses for clients that accept it by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5667115987" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44052" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44052/hovercard" href="https://github.com/BerriAI/litellm/pull/44052">#44052</a></li> <li>fix(auto-router): show actual and baseline spend for historical savings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5667375438" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44057" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44057/hovercard" href="https://github.com/BerriAI/litellm/pull/44057">#44057</a></li> <li>refactor(proxy): inject tracing receiver and access context by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5665901672" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44035" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44035/hovercard" href="https://github.com/BerriAI/litellm/pull/44035">#44035</a></li> <li>feat: improve trace ingestion and trace details by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5656412808" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43975" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43975/hovercard" href="https://github.com/BerriAI/litellm/pull/43975">#43975</a></li> <li>fix(proxy): enforce key/team vector_stores allowlist on /v1/rag/query by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654835405" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43953" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43953/hovercard" href="https://github.com/BerriAI/litellm/pull/43953">#43953</a></li> <li>feat(lens): move traces and setup into Lens by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668688719" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44068" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44068/hovercard" href="https://github.com/BerriAI/litellm/pull/44068">#44068</a></li> <li>test(proxy-extras): run the db push timeout hint test without a database URL by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668890026" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44073" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44073/hovercard" href="https://github.com/BerriAI/litellm/pull/44073">#44073</a></li> <li>fix(proxy-extras): build the SpendLogs indexes in the migration job instead of in migrations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654625256" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43948" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43948/hovercard" href="https://github.com/BerriAI/litellm/pull/43948">#43948</a></li> <li>fix(mcp): resolve team-granted toolsets for non-admin keys and dashboard sessions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651879935" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43908" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43908/hovercard" href="https://github.com/BerriAI/litellm/pull/43908">#43908</a></li> <li>fix(bedrock): accept Converse messages with no content key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5653796613" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43936" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43936/hovercard" href="https://github.com/BerriAI/litellm/pull/43936">#43936</a></li> <li>feat: add litellm.agent() to run claude code, codex, opencode and deep agents through the ai gateway by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5650961689" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43885" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43885/hovercard" href="https://github.com/BerriAI/litellm/pull/43885">#43885</a></li> <li>feat(ui): add test trace, tracing key and otel endpoints to tracing setup by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5669903323" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44090" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44090/hovercard" href="https://github.com/BerriAI/litellm/pull/44090">#44090</a></li> <li>feat(proxy): add LITELLM_DISABLE_LAZY_ROUTES to register optional routers at startup by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5652061247" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43911" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43911/hovercard" href="https://github.com/BerriAI/litellm/pull/43911">#43911</a></li> <li>test(e2e): keep 1ms-timeout deployments off the provider cache by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5669170773" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44082" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44082/hovercard" href="https://github.com/BerriAI/litellm/pull/44082">#44082</a></li> <li>refactor(repositories): daily activity repository with centralized bounded usage queries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598986018" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43398" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43398/hovercard" href="https://github.com/BerriAI/litellm/pull/43398">#43398</a></li> <li>fix(bedrock): add beta for mid-conversation tool changes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5643421485" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43833" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43833/hovercard" href="https://github.com/BerriAI/litellm/pull/43833">#43833</a></li> <li>feat(proxy): bounded daily activity routes (aggregated, search, model_top_keys, export, cache_leakage_keys) for all usage entities by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599441981" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43408" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43408/hovercard" href="https://github.com/BerriAI/litellm/pull/43408">#43408</a></li> <li>feat(ui): usage pages consume bounded daily activity routes instead of storing all keys client-side by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599537407" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43409" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43409/hovercard" href="https://github.com/BerriAI/litellm/pull/43409">#43409</a></li> <li>build(docker): drop the no-op PROXY_EXTRAS_SOURCE switch from the non-root image by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5670460635" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44097" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44097/hovercard" href="https://github.com/BerriAI/litellm/pull/44097">#44097</a></li> <li>fix(proxy): persist SSO display name as user_alias on login by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668193733" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44065" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44065/hovercard" href="https://github.com/BerriAI/litellm/pull/44065">#44065</a></li> <li>fix(cost-map): restore later azure Models API retirement dates and date gpt-6.1-sol by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668868158" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44072" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44072/hovercard" href="https://github.com/BerriAI/litellm/pull/44072">#44072</a></li> <li>feat(lens): simplify setup and investigation workflow by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/moe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/moe-berri">@moe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5669649821" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44089" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44089/hovercard" href="https://github.com/BerriAI/litellm/pull/44089">#44089</a></li> <li>chore(cost-map): sync openrouter prices from the models API by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5670904407" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44105" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44105/hovercard" href="https://github.com/BerriAI/litellm/pull/44105">#44105</a></li> <li>fix(providers): keep thinking display updates beta by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655922754" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43969" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43969/hovercard" href="https://github.com/BerriAI/litellm/pull/43969">#43969</a></li> <li>feat(rust): embed migration folders with a shared migrate! macro by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5670851715" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44104" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44104/hovercard" href="https://github.com/BerriAI/litellm/pull/44104">#44104</a></li> <li>refactor(tracing): normalize agent spans in Rust by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5668840256" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44071" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44071/hovercard" href="https://github.com/BerriAI/litellm/pull/44071">#44071</a></li> <li>perf(traces): recalculate ClickHouse TTL info only on retention changes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5671425275" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44117" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44117/hovercard" href="https://github.com/BerriAI/litellm/pull/44117">#44117</a></li> <li>fix(proxy-extras): bound the lock waits of the partitioned SpendLogs index build by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5671142519" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44109" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44109/hovercard" href="https://github.com/BerriAI/litellm/pull/44109">#44109</a></li> <li>build(deps): bump oauthlib to 4.0.0 to clear osv-scan by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651642171" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43899" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43899/hovercard" href="https://github.com/BerriAI/litellm/pull/43899">#43899</a></li> <li>fix(ui): label lens trace services as agents by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5671412048" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44116" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44116/hovercard" href="https://github.com/BerriAI/litellm/pull/44116">#44116</a></li> <li>fix(ui): split the KeyActivityPanel condition chains to bring the lint budget back under its ceiling by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5671339287" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44114" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44114/hovercard" href="https://github.com/BerriAI/litellm/pull/44114">#44114</a></li> <li>chore: bump litellm-enterprise 0.1.72 -> 0.1.73, litellm-proxy-extras 0.4.103 -> 0.4.104 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5671671783" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/44126" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/44126/hovercard" href="https://github.com/BerriAI/litellm/pull/44126">#44126</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/galovics/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/galovics">@galovics</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5569110662" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42949" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42949/hovercard" href="https://github.com/BerriAI/litellm/pull/42949">#42949</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.105.0-dev.1...v1.105.0-dev.2"><tt>v1.105.0-dev.1...v1.105.0-dev.2</tt></a></p> litellm-dispatcher[bot] tag:github.com,2008:Repository/671269505/v1.103.2 2026-10-01T06:37:31Z

v1.103.2

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.2</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.2/cosign.pub \ ghcr.io/berriai/litellm:v1.103.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.2/cosign.pub \ ghcr.io/berriai/litellm:v1.103.2</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>chore(release): sync stable/1.103.x to v1.103.1 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5642381043" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43824" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43824/hovercard" href="https://github.com/BerriAI/litellm/pull/43824">#43824</a></li> <li>fix(proxy): backport <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5407692559" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40541" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40541/hovercard" href="https://github.com/BerriAI/litellm/pull/40541">#40541</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622882106" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43642" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43642/hovercard" href="https://github.com/BerriAI/litellm/pull/43642">#43642</a>, and <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5623923791" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43656" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43656/hovercard" href="https://github.com/BerriAI/litellm/pull/43656">#43656</a> to stable/1.103.x for v1.103.2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5651591001" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43897" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43897/hovercard" href="https://github.com/BerriAI/litellm/pull/43897">#43897</a></li> <li>fix(anthropic): backport <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5519336557" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42152" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42152/hovercard" href="https://github.com/BerriAI/litellm/pull/42152">#42152</a> and <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5531443313" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42288" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42288/hovercard" href="https://github.com/BerriAI/litellm/pull/42288">#42288</a> to stable/1.103.x by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5625033762" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43662" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43662/hovercard" href="https://github.com/BerriAI/litellm/pull/43662">#43662</a></li> <li>fix(proxy): backport <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655294294" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43962" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43962/hovercard" href="https://github.com/BerriAI/litellm/pull/43962">#43962</a> to stable/1.103.x by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5657456554" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43984" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43984/hovercard" href="https://github.com/BerriAI/litellm/pull/43984">#43984</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.103.1...v1.103.2"><tt>v1.103.1...v1.103.2</tt></a></p> litellm-dispatcher[bot] tag:github.com,2008:Repository/671269505/v1.101.4 2026-10-01T05:10:19Z

v1.101.4

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.101.4"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.101.4</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.101.4/cosign.pub \ ghcr.io/berriai/litellm:v1.101.4"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.101.4/cosign.pub \ ghcr.io/berriai/litellm:v1.101.4</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>chore(release): sync stable/1.101.x to v1.101.3 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5642379088" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43822" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43822/hovercard" href="https://github.com/BerriAI/litellm/pull/43822">#43822</a></li> <li>chore(release): backport <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508889824" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41941" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41941/hovercard" href="https://github.com/BerriAI/litellm/pull/41941">#41941</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504837524" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41880" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41880/hovercard" href="https://github.com/BerriAI/litellm/pull/41880">#41880</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5655133843" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43956" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43956/hovercard" href="https://github.com/BerriAI/litellm/pull/43956">#43956</a> to stable/1.101.x and cut 1.101.4 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5654419572" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43943" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43943/hovercard" href="https://github.com/BerriAI/litellm/pull/43943">#43943</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.101.3...v1.101.4"><tt>v1.101.3...v1.101.4</tt></a></p> litellm-dispatcher[bot] tag:github.com,2008:Repository/671269505/v1.105.0-dev.1 2026-09-30T08:44:29Z

v1.105.0-dev.1

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.1</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.105.0-dev.1/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.105.0-dev.1/cosign.pub \ ghcr.io/berriai/litellm:v1.105.0-dev.1</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>test(e2e): cover Azure code_interpreter container files by native id with a service-account key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577615016" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43122" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43122/hovercard" href="https://github.com/BerriAI/litellm/pull/43122">#43122</a></li> <li>fix(router): await budget redis pipeline before sync reads (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4846643424" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/32618" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/32618/hovercard" href="https://github.com/BerriAI/litellm/pull/32618">#32618</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577797567" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43125" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43125/hovercard" href="https://github.com/BerriAI/litellm/pull/43125">#43125</a></li> <li>chore(cost-map): add openai cached image input prices from the pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578726487" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43143" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43143/hovercard" href="https://github.com/BerriAI/litellm/pull/43143">#43143</a></li> <li>feat(langfuse)!: migrate the sdk callback to langfuse v4 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5138392653" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36741" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36741/hovercard" href="https://github.com/BerriAI/litellm/pull/36741">#36741</a></li> <li>fix(key_management): count team unified access group MCP servers when validating key MCP grants by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5462032255" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41231" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41231/hovercard" href="https://github.com/BerriAI/litellm/pull/41231">#41231</a></li> <li>fix(ui): group cost optimization cache leakage by model group by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5572571328" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43008" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43008/hovercard" href="https://github.com/BerriAI/litellm/pull/43008">#43008</a></li> <li>fix(presidio): mask streamed /v1/messages output when the first upstream read is a keepalive, a data-less ping, or a split utf8 character by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5573242625" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43023" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43023/hovercard" href="https://github.com/BerriAI/litellm/pull/43023">#43023</a></li> <li>feat(mcp): share compatibility-aware result conversion across tool surfaces by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5576169352" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43089" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43089/hovercard" href="https://github.com/BerriAI/litellm/pull/43089">#43089</a></li> <li>fix(caching): propagate auth cache invalidation over Redis Cluster via a node-level pub/sub client by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577123639" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43110" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43110/hovercard" href="https://github.com/BerriAI/litellm/pull/43110">#43110</a></li> <li>feat(model-catalog): add Rust registry validation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578270728" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43136" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43136/hovercard" href="https://github.com/BerriAI/litellm/pull/43136">#43136</a></li> <li>test(rust): reorganize core crate tests and split cache and OCR suites by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5585357717" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43177" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43177/hovercard" href="https://github.com/BerriAI/litellm/pull/43177">#43177</a></li> <li>fix(proxy): give SpendLogToolIndex its own share of the cleanup budget and log a per-run summary by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5496054441" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41768" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41768/hovercard" href="https://github.com/BerriAI/litellm/pull/41768">#41768</a></li> <li>feat(rust): hand upstream response headers to the native Messages stream by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5585553813" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43178" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43178/hovercard" href="https://github.com/BerriAI/litellm/pull/43178">#43178</a></li> <li>feat(testkit): agent clients for Claude Code, Codex and opencode by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5585913863" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43181" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43181/hovercard" href="https://github.com/BerriAI/litellm/pull/43181">#43181</a></li> <li>ci: run migrated unit selections on every event in legacy GHA shards by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5585976307" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43182" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43182/hovercard" href="https://github.com/BerriAI/litellm/pull/43182">#43182</a></li> <li>test: move tests/test_litellm root and small trees into tests/unit by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5586354642" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43186" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43186/hovercard" href="https://github.com/BerriAI/litellm/pull/43186">#43186</a></li> <li>fix(sso): gate /sso/debug routes behind ENABLE_SSO_DEBUG, off by default by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ojensen-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ojensen-berri">@ojensen-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5579964702" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43150" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43150/hovercard" href="https://github.com/BerriAI/litellm/pull/43150">#43150</a></li> <li>refactor(framer): replace Framer trait with tokio-util codecs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5586771380" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43193" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43193/hovercard" href="https://github.com/BerriAI/litellm/pull/43193">#43193</a></li> <li>fix(anthropic): surface Responses bridge stream failures as Anthropic error events by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577800244" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43126" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43126/hovercard" href="https://github.com/BerriAI/litellm/pull/43126">#43126</a></li> <li>test: move tests/test_litellm/llms into tests/unit/llms by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5586701358" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43191" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43191/hovercard" href="https://github.com/BerriAI/litellm/pull/43191">#43191</a></li> <li>test: move tests/test_litellm integrations and secret_managers into tests/unit by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5586905488" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43194" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43194/hovercard" href="https://github.com/BerriAI/litellm/pull/43194">#43194</a></li> <li>feat(mcp): configure protocol versions and capability discovery by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5584557251" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43169" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43169/hovercard" href="https://github.com/BerriAI/litellm/pull/43169">#43169</a></li> <li>fix(proxy): record streamed /v1/responses container ownership before the response.completed frame by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578436136" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43140" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43140/hovercard" href="https://github.com/BerriAI/litellm/pull/43140">#43140</a></li> <li>fix(tests): drop the repeated UNIT_FLAG key in test_unit_shard_missing_paths by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588330293" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43212" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43212/hovercard" href="https://github.com/BerriAI/litellm/pull/43212">#43212</a></li> <li>fix(router): count provider budget spend on every API surface by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/daqiangganjun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/daqiangganjun">@daqiangganjun</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5241642491" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38172" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38172/hovercard" href="https://github.com/BerriAI/litellm/pull/38172">#38172</a></li> <li>fix(responses): fall back on pre-output stream drops, fail truncated streams, honor request_timeout by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578093032" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43133" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43133/hovercard" href="https://github.com/BerriAI/litellm/pull/43133">#43133</a></li> <li>fix(sentry): scrub PII and secrets inside object reprs and nested locals, add SENTRY_SEND_DEFAULT_PII opt-in by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577628384" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43123" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43123/hovercard" href="https://github.com/BerriAI/litellm/pull/43123">#43123</a></li> <li>fix(bedrock): surface a converse-stream 200 that decodes to no events as a 502 instead of an empty turn by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588412139" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43213" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43213/hovercard" href="https://github.com/BerriAI/litellm/pull/43213">#43213</a></li> <li>fix(jwt): let x-litellm-team-id select DB membership teams when the token also carries a team claim by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588044077" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43206" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43206/hovercard" href="https://github.com/BerriAI/litellm/pull/43206">#43206</a></li> <li>feat(integrations): add Databricks Zerobus trace logging callback by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5513301006" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42013" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42013/hovercard" href="https://github.com/BerriAI/litellm/pull/42013">#42013</a></li> <li>fix(vertex_ai): keep legacy bucket_name in credential resolution and add GCS_BATCH_BUCKET_NAME env var by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mubashir1osmani/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mubashir1osmani">@mubashir1osmani</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5559503634" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42803" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42803/hovercard" href="https://github.com/BerriAI/litellm/pull/42803">#42803</a></li> <li>feat(xai): add native xAI batches and files support by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5560041579" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42812" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42812/hovercard" href="https://github.com/BerriAI/litellm/pull/42812">#42812</a></li> <li>fix(proxy): send a real error event when a /v1/messages stream fails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/4refael/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/4refael">@4refael</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5501263624" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41826" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41826/hovercard" href="https://github.com/BerriAI/litellm/pull/41826">#41826</a></li> <li>fix(logging): redact raw_request when turn_off_message_logging is set in the proxy config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588657349" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43219" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43219/hovercard" href="https://github.com/BerriAI/litellm/pull/43219">#43219</a></li> <li>fix(router): parse the classifier verdict out of surrounding prose instead of falling to the default tier by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588450357" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43215" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43215/hovercard" href="https://github.com/BerriAI/litellm/pull/43215">#43215</a></li> <li>test(zerobus): move tests into active CI selection by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589431783" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43235" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43235/hovercard" href="https://github.com/BerriAI/litellm/pull/43235">#43235</a></li> <li>fix(proxy): keep the submitted body out of 422 validation errors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589330948" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43231" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43231/hovercard" href="https://github.com/BerriAI/litellm/pull/43231">#43231</a></li> <li>test: move tests/test_litellm core utils, routing, responses, caching and rust_bridge into tests/unit by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5587248399" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43199" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43199/hovercard" href="https://github.com/BerriAI/litellm/pull/43199">#43199</a></li> <li>chore(cost-map): add fireworks us-only deepseek v4.1 flash priority prices by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589860544" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43247" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43247/hovercard" href="https://github.com/BerriAI/litellm/pull/43247">#43247</a></li> <li>chore(cost-map): sync openrouter prices and add perceptron-mk1.5 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589854646" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43246" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43246/hovercard" href="https://github.com/BerriAI/litellm/pull/43246">#43246</a></li> <li>fix(cost-map): correct fireworks_ai deepseek-v4p1-flash pricing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590023391" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43253" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43253/hovercard" href="https://github.com/BerriAI/litellm/pull/43253">#43253</a></li> <li>feat(openrouter): add typesafe/jev-router to the cost map by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589862340" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43248" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43248/hovercard" href="https://github.com/BerriAI/litellm/pull/43248">#43248</a></li> <li>chore(cost-map): add fireworks priority prices for muse glimmer 30b and deepseek v4 flash vision exp by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590021405" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43252" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43252/hovercard" href="https://github.com/BerriAI/litellm/pull/43252">#43252</a></li> <li>refactor(rust): move credential inheritance and SDK limits into a driver preflight by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590205562" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43259" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43259/hovercard" href="https://github.com/BerriAI/litellm/pull/43259">#43259</a></li> <li>fix(router): hold Responses lifecycle events until output so a pre-output fallback announces one response by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589479974" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43238" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43238/hovercard" href="https://github.com/BerriAI/litellm/pull/43238">#43238</a></li> <li>refactor(http): hand out an owned Client and route all providers through the pool by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589831841" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43245" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43245/hovercard" href="https://github.com/BerriAI/litellm/pull/43245">#43245</a></li> <li>test: fix stale and state-leaking tests red on scheduled CircleCI by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590493058" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43266" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43266/hovercard" href="https://github.com/BerriAI/litellm/pull/43266">#43266</a></li> <li>fix(cost-map): retirement dates, chatgpt reasoning flags, bing pricing, bedrock mantle and mythos, azure gpt-5.6 alias, anthropic batch rates, new nebius, openrouter and xai rows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5569123636" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42951" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42951/hovercard" href="https://github.com/BerriAI/litellm/pull/42951">#42951</a></li> <li>refactor(rust): promote anthropic messages out of experimental_pass_through by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590573412" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43269" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43269/hovercard" href="https://github.com/BerriAI/litellm/pull/43269">#43269</a></li> <li>test: stop CI tests from downloading tokenizer files and images by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590156027" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43257" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43257/hovercard" href="https://github.com/BerriAI/litellm/pull/43257">#43257</a></li> <li>fix(rust): preserve nested optional import failures by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590433169" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43265" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43265/hovercard" href="https://github.com/BerriAI/litellm/pull/43265">#43265</a></li> <li>ci: drop main and litellm_* branch filters from the CircleCI litellm-main workflows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590727594" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43272" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43272/hovercard" href="https://github.com/BerriAI/litellm/pull/43272">#43272</a></li> <li>feat(proxy): email alerts at configured percentages of a team member budget by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5548413890" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42665" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42665/hovercard" href="https://github.com/BerriAI/litellm/pull/42665">#42665</a></li> <li>fix(callbacks-legacy-python): traverse and release the retained headers dict by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590807454" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43274" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43274/hovercard" href="https://github.com/BerriAI/litellm/pull/43274">#43274</a></li> <li>test(integration): port langfuse callbacks-in-db coverage to the local harness by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591367127" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43282" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43282/hovercard" href="https://github.com/BerriAI/litellm/pull/43282">#43282</a></li> <li>test(e2e): accept the otel cost write as a linked root trace by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5566308005" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42931" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42931/hovercard" href="https://github.com/BerriAI/litellm/pull/42931">#42931</a></li> <li>test: finish the non-proxy half of tests/test_litellm by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591326868" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43281" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43281/hovercard" href="https://github.com/BerriAI/litellm/pull/43281">#43281</a></li> <li>refactor(rust): prepare inference and auth foundations for the gateway by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591744491" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43287" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43287/hovercard" href="https://github.com/BerriAI/litellm/pull/43287">#43287</a></li> <li>feat(rust): add config, router and gateway crates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591745233" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43289" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43289/hovercard" href="https://github.com/BerriAI/litellm/pull/43289">#43289</a></li> <li>fix(cost-map): remove duplicate openrouter/perceptron/perceptron-mk1.5 entry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590776856" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43273" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43273/hovercard" href="https://github.com/BerriAI/litellm/pull/43273">#43273</a></li> <li>fix(e2e): resolve the blank-S3 gateway repo root from the litellm package location by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5565352779" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42911" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42911/hovercard" href="https://github.com/BerriAI/litellm/pull/42911">#42911</a></li> <li>test(integration): run the Langfuse DB-callback test on its own scratch database by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591744992" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43288" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43288/hovercard" href="https://github.com/BerriAI/litellm/pull/43288">#43288</a></li> <li>refactor(rust): expand logging and test coverage across gateway and Anthropic messages by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5592334313" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43295" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43295/hovercard" href="https://github.com/BerriAI/litellm/pull/43295">#43295</a></li> <li>refactor: daily fresh tech debt cleanup, rolling PR (2026-09-25) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5580026921" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43151" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43151/hovercard" href="https://github.com/BerriAI/litellm/pull/43151">#43151</a></li> <li>test(proxy_behavior): scope the management proxy fixture to its package so its spend monitor cannot race the spend tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5593096043" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43302" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43302/hovercard" href="https://github.com/BerriAI/litellm/pull/43302">#43302</a></li> <li>fix(cost-map): registry audit 2026-09-26, MAI-Image-2.5-Flash price, Databricks Claude Opus 5.5, Azure Foundry retirement dates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590024329" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43254" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43254/hovercard" href="https://github.com/BerriAI/litellm/pull/43254">#43254</a></li> <li>fix(cost-map): price fireworks deepseek v4.1 flash at the prices api value by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5595182698" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43311" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43311/hovercard" href="https://github.com/BerriAI/litellm/pull/43311">#43311</a></li> <li>fix(ci): stop stale CI reds, keep unit tests off the host env, retry CyberArk policy conflicts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5592211982" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43294" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43294/hovercard" href="https://github.com/BerriAI/litellm/pull/43294">#43294</a></li> <li>fix(otel): detach post-response service spans by request phase, name redis spans by operation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589459833" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43237" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43237/hovercard" href="https://github.com/BerriAI/litellm/pull/43237">#43237</a></li> <li>test(e2e): assert only litellm-owned batch behavior and move the blank S3 env pin to an integration test by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5595903396" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43321" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43321/hovercard" href="https://github.com/BerriAI/litellm/pull/43321">#43321</a></li> <li>test(integration): pin the team-admin status-code matrix across every management route by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589894464" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43249" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43249/hovercard" href="https://github.com/BerriAI/litellm/pull/43249">#43249</a></li> <li>feat(proxy): add fail_closed_rate_limit_enforcement to reject requests with 503 while Redis rate limit counters are unreachable by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589976668" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43251" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43251/hovercard" href="https://github.com/BerriAI/litellm/pull/43251">#43251</a></li> <li>fix(responses): run stream failure and success hooks on the iterating loop instead of blocking it by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590582315" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43270" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43270/hovercard" href="https://github.com/BerriAI/litellm/pull/43270">#43270</a></li> <li>fix(guardrails): block private destinations in custom code http_request and bound guardrail execution time by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591193770" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43280" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43280/hovercard" href="https://github.com/BerriAI/litellm/pull/43280">#43280</a></li> <li>feat(sail): add Sail as a provider with service_tier mapped to its completion window by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5561437395" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42840" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42840/hovercard" href="https://github.com/BerriAI/litellm/pull/42840">#42840</a></li> <li>test(mcp): pin server resolution and authorization behavior by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590313511" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43261" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43261/hovercard" href="https://github.com/BerriAI/litellm/pull/43261">#43261</a></li> <li>refactor(anthropic): rename experimental_pass_through to pass_through by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5596315302" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43329" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43329/hovercard" href="https://github.com/BerriAI/litellm/pull/43329">#43329</a></li> <li>refactor(mcp): add shared server resolver without changing callers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590313865" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43262" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43262/hovercard" href="https://github.com/BerriAI/litellm/pull/43262">#43262</a></li> <li>ci: fail on new unbounded SQL IN lists and add a Prisma chunking helper by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5547158306" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42629" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42629/hovercard" href="https://github.com/BerriAI/litellm/pull/42629">#42629</a></li> <li>test(logging): drain the logging worker after each logging callback test so no later test inherits its events by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597086105" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43344" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43344/hovercard" href="https://github.com/BerriAI/litellm/pull/43344">#43344</a></li> <li>feat(guardrails): scan retrieved vector store chunks with the request's pre-call guardrails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590720691" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43271" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43271/hovercard" href="https://github.com/BerriAI/litellm/pull/43271">#43271</a></li> <li>fix(mcp): adopt shared server resolution and caller authorization by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590314292" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43263" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43263/hovercard" href="https://github.com/BerriAI/litellm/pull/43263">#43263</a></li> <li>fix(s3_v2): upload fresh events first, drop terminal failures and hour-old retries by default, opt-in adaptive concurrency by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5573143500" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43022" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43022/hovercard" href="https://github.com/BerriAI/litellm/pull/43022">#43022</a></li> <li>feat(proxy): add maximum_daily_tag_spend_retention_period cleanup setting by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5317905441" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39221" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39221/hovercard" href="https://github.com/BerriAI/litellm/pull/39221">#39221</a></li> <li>fix(cost-map): sync OpenRouter, Together, Cohere and Azure AI registry values with official sources by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5596656521" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43337" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43337/hovercard" href="https://github.com/BerriAI/litellm/pull/43337">#43337</a></li> <li>docs(pr-template): add the backport-stable label only for a P0 regression by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597662123" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43351" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43351/hovercard" href="https://github.com/BerriAI/litellm/pull/43351">#43351</a></li> <li>fix(params): keep <em>litellm</em>* kwargs out of provider request bodies by construction by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588754340" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43221" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43221/hovercard" href="https://github.com/BerriAI/litellm/pull/43221">#43221</a></li> <li>test: remove substring guard test_default_api_base by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597805747" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43355" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43355/hovercard" href="https://github.com/BerriAI/litellm/pull/43355">#43355</a></li> <li>ci: cut CircleCI wall time without loosening test isolation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597425910" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43347" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43347/hovercard" href="https://github.com/BerriAI/litellm/pull/43347">#43347</a></li> <li>fix(cost-map): correct azure gpt-4o-mini tts, transcribe, alias and MAI-Image-2.5 prices by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597874542" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43357" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43357/hovercard" href="https://github.com/BerriAI/litellm/pull/43357">#43357</a></li> <li>fix(tests): stop VCR recording and replaying a test's own localhost upstream by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597299971" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43346" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43346/hovercard" href="https://github.com/BerriAI/litellm/pull/43346">#43346</a></li> <li>test(integration): group /v1/messages contracts under tests/integration/messages_endpoint by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597674675" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43352" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43352/hovercard" href="https://github.com/BerriAI/litellm/pull/43352">#43352</a></li> <li>fix(params): validate stream_chunk_size once, before any provider call by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588756384" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43222" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43222/hovercard" href="https://github.com/BerriAI/litellm/pull/43222">#43222</a></li> <li>fix(openai): exclude fine-tuned and custom gpt-5-chat aliases from gpt-5 reasoning path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5586182014" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43185" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43185/hovercard" href="https://github.com/BerriAI/litellm/pull/43185">#43185</a></li> <li>fix(langtrace): deliver spans to app.langtrace.ai/api/trace with x-api-key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5596099642" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43322" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43322/hovercard" href="https://github.com/BerriAI/litellm/pull/43322">#43322</a></li> <li>fix(caching): stand default cache points down when extra_body hides a direct client mark by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5596865683" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43341" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43341/hovercard" href="https://github.com/BerriAI/litellm/pull/43341">#43341</a></li> <li>fix(mcp): report reachability without stored credentials by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589515874" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43240" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43240/hovercard" href="https://github.com/BerriAI/litellm/pull/43240">#43240</a></li> <li>fix(mcp): align hub publication status and controls by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589529036" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43241" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43241/hovercard" href="https://github.com/BerriAI/litellm/pull/43241">#43241</a></li> <li>chore(cost-map): sync openrouter prices for deepseek, minimax, qwen and glm rows by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598432567" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43384" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43384/hovercard" href="https://github.com/BerriAI/litellm/pull/43384">#43384</a></li> <li>chore(cost-map): drop stale cache hit field from openrouter deepseek-v4-pro-0813 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598532700" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43389" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43389/hovercard" href="https://github.com/BerriAI/litellm/pull/43389">#43389</a></li> <li>fix(responses): stream guardrail pre-call block as SSE with a typed output item by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5543143471" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42507" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42507/hovercard" href="https://github.com/BerriAI/litellm/pull/42507">#42507</a></li> <li>feat(e2e): read management routes back from the control plane replicas by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598255887" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43373" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43373/hovercard" href="https://github.com/BerriAI/litellm/pull/43373">#43373</a></li> <li>feat(rust): add the openai_like chat config foundation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598332247" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43379" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43379/hovercard" href="https://github.com/BerriAI/litellm/pull/43379">#43379</a></li> <li>feat(router): opt in to prompt-cache cost routing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5589360072" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43232" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43232/hovercard" href="https://github.com/BerriAI/litellm/pull/43232">#43232</a></li> <li>feat(otel): add SigNoz preset for OpenTelemetry v2 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5592489019" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43296" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43296/hovercard" href="https://github.com/BerriAI/litellm/pull/43296">#43296</a></li> <li>feat(cli): reuse saved agent setup and add reconfigure by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598697648" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43392" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43392/hovercard" href="https://github.com/BerriAI/litellm/pull/43392">#43392</a></li> <li>fix(streaming): keep litellm Usage on text-completion usage chunks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5574540480" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43047" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43047/hovercard" href="https://github.com/BerriAI/litellm/pull/43047">#43047</a></li> <li>fix(vertex_ai): consider tools when validating context caching min tokens by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/agustin18/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/agustin18">@agustin18</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5595766589" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43319" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43319/hovercard" href="https://github.com/BerriAI/litellm/pull/43319">#43319</a></li> <li>fix(anthropic): drop thinking blocks with empty thinking text, not just missing signature by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shoemoney/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shoemoney">@shoemoney</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230128924" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38049" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38049/hovercard" href="https://github.com/BerriAI/litellm/pull/38049">#38049</a></li> <li>test(e2e): report batch cleanup leftovers as a plain UserWarning by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599392063" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43405" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43405/hovercard" href="https://github.com/BerriAI/litellm/pull/43405">#43405</a></li> <li>fix(tools): salvage concatenated JSON tool call arguments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/kumarpriyanshu09/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/kumarpriyanshu09">@kumarpriyanshu09</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590207599" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43260" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43260/hovercard" href="https://github.com/BerriAI/litellm/pull/43260">#43260</a></li> <li>fix(gemini): forward seed to the Gemini API instead of rejecting it by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/YaseenBashaT/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/YaseenBashaT">@YaseenBashaT</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5587153045" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43197" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43197/hovercard" href="https://github.com/BerriAI/litellm/pull/43197">#43197</a></li> <li>fix(vertex_ai): make Gemma fake streams work with traced Responses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stewartpark/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stewartpark">@stewartpark</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5579238397" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43147" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43147/hovercard" href="https://github.com/BerriAI/litellm/pull/43147">#43147</a></li> <li>fix(responses): emit the reasoning item on streaming /v1/responses for signature-only thinking by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599762720" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43414" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43414/hovercard" href="https://github.com/BerriAI/litellm/pull/43414">#43414</a></li> <li>fix(anthropic): forward the per-turn-control beta to Azure AI Foundry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599766870" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43415" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43415/hovercard" href="https://github.com/BerriAI/litellm/pull/43415">#43415</a></li> <li>test(vertex_ai): assert the usage the Gemma responses stream actually reports by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599799579" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43422" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43422/hovercard" href="https://github.com/BerriAI/litellm/pull/43422">#43422</a></li> <li>fix(bedrock): keep the provider status code on unprocessable image errors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599787328" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43416" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43416/hovercard" href="https://github.com/BerriAI/litellm/pull/43416">#43416</a></li> <li>fix(vertex_ai): stop importing the vertexai SDK in partner-model completion by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/anmolg1997/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/anmolg1997">@anmolg1997</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5531017903" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42274" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42274/hovercard" href="https://github.com/BerriAI/litellm/pull/42274">#42274</a></li> <li>fix(token_counter): count Gemini function_declarations tools by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599788947" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43417" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43417/hovercard" href="https://github.com/BerriAI/litellm/pull/43417">#43417</a></li> <li>refactor(types): replace Any with proven types in 5 files by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5593505907" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43304" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43304/hovercard" href="https://github.com/BerriAI/litellm/pull/43304">#43304</a></li> <li>chore(cost-map): update azure_ai/grok-4.6 input price from Azure pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5602699217" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43440" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43440/hovercard" href="https://github.com/BerriAI/litellm/pull/43440">#43440</a></li> <li>chore(cost-map): add azure_ai/MAI-Cyber-1-Flash by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5604120092" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43446" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43446/hovercard" href="https://github.com/BerriAI/litellm/pull/43446">#43446</a></li> <li>refactor(rust): share anthropic types, request helpers, and streaming contracts across crates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5600253263" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43426" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43426/hovercard" href="https://github.com/BerriAI/litellm/pull/43426">#43426</a></li> <li>feat(rust): expand gateway configuration parsing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606252481" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43460" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43460/hovercard" href="https://github.com/BerriAI/litellm/pull/43460">#43460</a></li> <li>refactor(rust): share call lifecycle across route-owned inference by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606252752" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43461" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43461/hovercard" href="https://github.com/BerriAI/litellm/pull/43461">#43461</a></li> <li>feat(rust): add the HTTP host driver by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606252996" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43462" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43462/hovercard" href="https://github.com/BerriAI/litellm/pull/43462">#43462</a></li> <li>build(rust): package the gateway container by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606255658" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43471" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43471/hovercard" href="https://github.com/BerriAI/litellm/pull/43471">#43471</a></li> <li>refactor(rust): use shared execution in gateway inference by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606253245" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43463" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43463/hovercard" href="https://github.com/BerriAI/litellm/pull/43463">#43463</a></li> <li>fix(cost-map): add deprecation_date to together_ai Salesforce/Llama-Rank-V1 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5607458682" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43507" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43507/hovercard" href="https://github.com/BerriAI/litellm/pull/43507">#43507</a></li> <li>feat(rust): support the HTTP Responses API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606253681" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43464" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43464/hovercard" href="https://github.com/BerriAI/litellm/pull/43464">#43464</a></li> <li>fix(cost-map): sync openrouter prices from the models API by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5607456269" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43506" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43506/hovercard" href="https://github.com/BerriAI/litellm/pull/43506">#43506</a></li> <li>fix(cost-map): set together_ai gpt-oss-20b and gemma-4-31B-it deprecation_date to 2026-09-15 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5607627848" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43509" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43509/hovercard" href="https://github.com/BerriAI/litellm/pull/43509">#43509</a></li> <li>feat(rust): add litellm-db and litellm-db-testing workspace scaffolding by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5607250956" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43504" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43504/hovercard" href="https://github.com/BerriAI/litellm/pull/43504">#43504</a></li> <li>feat(rust): connect Python inference bindings to shared routes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606253938" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43465" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43465/hovercard" href="https://github.com/BerriAI/litellm/pull/43465">#43465</a></li> <li>feat(rust): add structured route lifecycle tracing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606254198" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43466" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43466/hovercard" href="https://github.com/BerriAI/litellm/pull/43466">#43466</a></li> <li>feat(rust): separate gateway authentication and authorization by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606254435" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43467" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43467/hovercard" href="https://github.com/BerriAI/litellm/pull/43467">#43467</a></li> <li>feat(rust): add virtual key storage contracts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606254864" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43468" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43468/hovercard" href="https://github.com/BerriAI/litellm/pull/43468">#43468</a></li> <li>feat(rust): add gateway UI login and sessions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606255143" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43469" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43469/hovercard" href="https://github.com/BerriAI/litellm/pull/43469">#43469</a></li> <li>feat(rust): add the MCP gateway by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5606255411" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43470" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43470/hovercard" href="https://github.com/BerriAI/litellm/pull/43470">#43470</a></li> <li>refactor(rust): remove delivery routing abstraction by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5608838776" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43514" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43514/hovercard" href="https://github.com/BerriAI/litellm/pull/43514">#43514</a></li> <li>feat(azure): add mistral ocr pricing and azure max output limits by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5609938653" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43530" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43530/hovercard" href="https://github.com/BerriAI/litellm/pull/43530">#43530</a></li> <li>refactor: clean up fresh tech debt from 2026-09-27 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5611356043" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43538" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43538/hovercard" href="https://github.com/BerriAI/litellm/pull/43538">#43538</a></li> <li>refactor(types): replace Any with proven types in 8 files by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5612942927" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43551" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43551/hovercard" href="https://github.com/BerriAI/litellm/pull/43551">#43551</a></li> <li>test(rust): enforce shared upstream error contract in wheel checks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5609192806" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43520" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43520/hovercard" href="https://github.com/BerriAI/litellm/pull/43520">#43520</a></li> <li>fix(proxy): log key owner identity on expired key auth failures by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5576915505" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43105" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43105/hovercard" href="https://github.com/BerriAI/litellm/pull/43105">#43105</a></li> <li>fix(cost-map): registry audit 2026-09-28, openai deep-research shutdown dates, azure deepseek v4.1 flash direct price, vertex gemini 3.8 live avatar price, drop azure_ai/muse-spark-1.3 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5615185895" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43566" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43566/hovercard" href="https://github.com/BerriAI/litellm/pull/43566">#43566</a></li> <li>security(proxy): keep team callback credentials out of the stored request body by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588546441" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43217" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43217/hovercard" href="https://github.com/BerriAI/litellm/pull/43217">#43217</a></li> <li>feat(model_prices): add claude-sonnet-5-5 model pricing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/krrish-berri-2/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/krrish-berri-2">@krrish-berri-2</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619112837" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43586" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43586/hovercard" href="https://github.com/BerriAI/litellm/pull/43586">#43586</a></li> <li>test(integration): pin org-admin status codes in the team-admin matrix by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619601861" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43592" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43592/hovercard" href="https://github.com/BerriAI/litellm/pull/43592">#43592</a></li> <li>refactor(guardrails): fix agent 365 to the production endpoint and log the opt-in fail_open at error level by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5586571124" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43189" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43189/hovercard" href="https://github.com/BerriAI/litellm/pull/43189">#43189</a></li> <li>fix(model_prices): correct Claude Sonnet 5.5 capabilities and provider keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619134439" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43587" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43587/hovercard" href="https://github.com/BerriAI/litellm/pull/43587">#43587</a></li> <li>test(unit): stop test modules from putting their own directory on sys.path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599793516" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43421" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43421/hovercard" href="https://github.com/BerriAI/litellm/pull/43421">#43421</a></li> <li>refactor(rust): centralize host execution and compose callbacks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5608853908" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43515" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43515/hovercard" href="https://github.com/BerriAI/litellm/pull/43515">#43515</a></li> <li>fix(proxy): unregister logging callbacks removed from the stored config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5600541761" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43428" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43428/hovercard" href="https://github.com/BerriAI/litellm/pull/43428">#43428</a></li> <li>chore(cost-map): take azure limits for deepseek-v4-flash-0731 and v3.2-speciale by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619862603" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43597" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43597/hovercard" href="https://github.com/BerriAI/litellm/pull/43597">#43597</a></li> <li>revert: "feat(proxy): server-side Team Usage export beyond the top-N key cap (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5571897617" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42996" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42996/hovercard" href="https://github.com/BerriAI/litellm/pull/42996">#42996</a>)" by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yassin-berriai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yassin-berriai">@yassin-berriai</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598324666" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43376" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43376/hovercard" href="https://github.com/BerriAI/litellm/pull/43376">#43376</a></li> <li>fix(cost-map): add web search flag and model page source to anthropic claude-sonnet-5-5 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619078745" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43584" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43584/hovercard" href="https://github.com/BerriAI/litellm/pull/43584">#43584</a></li> <li>refactor(mcp): consolidate hub publication predicate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598826048" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43394" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43394/hovercard" href="https://github.com/BerriAI/litellm/pull/43394">#43394</a></li> <li>fix(provider): accept 2xx status codes in unified_access_group create by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Louis-Vauterin/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Louis-Vauterin">@Louis-Vauterin</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5538756153" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42461" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42461/hovercard" href="https://github.com/BerriAI/litellm/pull/42461">#42461</a></li> <li>fix(panw_prisma_airs): honor experimental_use_latest_role_message_only on every request shape by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5536860335" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42447" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42447/hovercard" href="https://github.com/BerriAI/litellm/pull/42447">#42447</a></li> <li>fix(cost-map): add Vertex batch cache prices to vertex_ai/claude-sonnet-5-5 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5620012722" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43602" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43602/hovercard" href="https://github.com/BerriAI/litellm/pull/43602">#43602</a></li> <li>revert: "feat(usage): search team keys beyond the top-N in the Team usage view (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5562088591" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42857" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42857/hovercard" href="https://github.com/BerriAI/litellm/pull/42857">#42857</a>)" by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yassin-berriai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yassin-berriai">@yassin-berriai</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598324970" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43377" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43377/hovercard" href="https://github.com/BerriAI/litellm/pull/43377">#43377</a></li> <li>feat(providers): add Prism provider (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436602150" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40914" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40914/hovercard" href="https://github.com/BerriAI/litellm/pull/40914">#40914</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5510089781" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41961" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41961/hovercard" href="https://github.com/BerriAI/litellm/pull/41961">#41961</a></li> <li>test(integration): credential canary suite harness by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5592806818" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43300" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43300/hovercard" href="https://github.com/BerriAI/litellm/pull/43300">#43300</a></li> <li>feat(bedrock): add xai grok-4.7 pricing and sync llama, mistral large 2407 and minimax m2.5 prices by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5621250379" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43623" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43623/hovercard" href="https://github.com/BerriAI/litellm/pull/43623">#43623</a></li> <li>ci: sync the weekly release cycle with Linear releases by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622316944" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43636" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43636/hovercard" href="https://github.com/BerriAI/litellm/pull/43636">#43636</a></li> <li>feat(cache): select Rust caching through explicit cache objects by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619990490" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43601" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43601/hovercard" href="https://github.com/BerriAI/litellm/pull/43601">#43601</a></li> <li>test(integration): credential canary slots for MCP and pass-through credentials by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5594218797" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43308" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43308/hovercard" href="https://github.com/BerriAI/litellm/pull/43308">#43308</a></li> <li>test(integration): stored-config credential canary slots by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5594236247" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43309" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43309/hovercard" href="https://github.com/BerriAI/litellm/pull/43309">#43309</a></li> <li>fix(guardrails): preserve Presidio output selection and restoration by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599048593" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43401" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43401/hovercard" href="https://github.com/BerriAI/litellm/pull/43401">#43401</a></li> <li>fix(ui): rename All Models tab to Deployed Models and model filters to All Proxy Models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622371957" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43638" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43638/hovercard" href="https://github.com/BerriAI/litellm/pull/43638">#43638</a></li> <li>feat(mcp): scan and pin upstream tool descriptions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5591389174" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43283" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43283/hovercard" href="https://github.com/BerriAI/litellm/pull/43283">#43283</a></li> <li>feat(cost-map): add bedrock_mantle rows for claude opus 5.5 and sonnet 5.5 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5623317921" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43647" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43647/hovercard" href="https://github.com/BerriAI/litellm/pull/43647">#43647</a></li> <li>chore(codeowners): drop UI, migration, and CODEOWNERS self owners by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5623698752" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43653" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43653/hovercard" href="https://github.com/BerriAI/litellm/pull/43653">#43653</a></li> <li>feat(fireworks_ai): route and list the auto, auto-instant and firerouter routers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622795103" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43641" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43641/hovercard" href="https://github.com/BerriAI/litellm/pull/43641">#43641</a></li> <li>feat: add model leaderboard page by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ishaan-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ishaan-berri">@ishaan-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5623432753" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43649" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43649/hovercard" href="https://github.com/BerriAI/litellm/pull/43649">#43649</a></li> <li>fix(google_genai): preserve proxy_server_request in completion adapter by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hsm207/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hsm207">@hsm207</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5610360071" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43536" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43536/hovercard" href="https://github.com/BerriAI/litellm/pull/43536">#43536</a></li> <li>fix(otel): send cache and reasoning tokens in langfuse usage_details by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ankit373/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ankit373">@ankit373</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5613243019" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43553" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43553/hovercard" href="https://github.com/BerriAI/litellm/pull/43553">#43553</a></li> <li>fix(vertex_ai): forward the per-turn-control beta for per-message output_config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/DeviaVir/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/DeviaVir">@DeviaVir</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5613717875" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43558" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43558/hovercard" href="https://github.com/BerriAI/litellm/pull/43558">#43558</a></li> <li>fix(cost-map): add tool calling and reasoning flags, correct max output for nebius DeepSeek-V4.1-Flash by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Flexomatic81/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Flexomatic81">@Flexomatic81</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619258064" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43588" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43588/hovercard" href="https://github.com/BerriAI/litellm/pull/43588">#43588</a></li> <li>fix(proxy): resolve model_group_alias in the zero-cost budget predicate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fedaeho/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fedaeho">@fedaeho</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5608598611" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43512" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43512/hovercard" href="https://github.com/BerriAI/litellm/pull/43512">#43512</a></li> <li>refactor: clean up fresh tech debt from 2026-09-28 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5627285925" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43674" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43674/hovercard" href="https://github.com/BerriAI/litellm/pull/43674">#43674</a></li> <li>refactor(types): replace Any with proven types in 7 files by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5629032986" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43704" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43704/hovercard" href="https://github.com/BerriAI/litellm/pull/43704">#43704</a></li> <li>docs(security): point readers to the security announcements mailing list signup by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5631028696" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43713" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43713/hovercard" href="https://github.com/BerriAI/litellm/pull/43713">#43713</a></li> <li>refactor(rust): add shared llms wire type derives by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5633138826" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43730" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43730/hovercard" href="https://github.com/BerriAI/litellm/pull/43730">#43730</a></li> <li>fix(router): stream /v1/messages lifecycle frames live when no fallback can take over by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619938609" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43600" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43600/hovercard" href="https://github.com/BerriAI/litellm/pull/43600">#43600</a></li> <li>feat(cost-map): add baseten DeepSeek-V4.1-Flash-Fast by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5633462437" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43735" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43735/hovercard" href="https://github.com/BerriAI/litellm/pull/43735">#43735</a></li> <li>feat(guardrails): send a configured gateway_name from noma_v2 to Noma by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/itaimodi/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/itaimodi">@itaimodi</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5627553511" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43678" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43678/hovercard" href="https://github.com/BerriAI/litellm/pull/43678">#43678</a></li> <li>chore(cost-map): add openai gpt-6.1-sol from the pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5634213075" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43738" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43738/hovercard" href="https://github.com/BerriAI/litellm/pull/43738">#43738</a></li> <li>test(integration): callback credential canary slots C1-C3 and D5 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622074069" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43630" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43630/hovercard" href="https://github.com/BerriAI/litellm/pull/43630">#43630</a></li> <li>test(integration): request-path credential canary slots D1-D4 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5594208856" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43307" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43307/hovercard" href="https://github.com/BerriAI/litellm/pull/43307">#43307</a></li> <li>test(integration): sweep proxy logs, metrics, a Datadog intake and the Logs drawer for credential canaries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5594175496" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43306" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43306/hovercard" href="https://github.com/BerriAI/litellm/pull/43306">#43306</a></li> <li>chore(cost-map): add azure and openrouter gpt-6.1-sol rows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5634793473" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43744" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43744/hovercard" href="https://github.com/BerriAI/litellm/pull/43744">#43744</a></li> <li>test(proxy): classify every credential-bearing param for the canary suite by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5592615927" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43298" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43298/hovercard" href="https://github.com/BerriAI/litellm/pull/43298">#43298</a></li> <li>fix(cost-map): lower fireworks up-to-4b size tier to the pricing page price by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5634385545" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43740" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43740/hovercard" href="https://github.com/BerriAI/litellm/pull/43740">#43740</a></li> <li>fix(cost_calculator): bill chat per-second pricing once with a new cost_per_second field by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5620974014" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43614" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43614/hovercard" href="https://github.com/BerriAI/litellm/pull/43614">#43614</a></li> <li>chore(cost-map): add openai gpt-6-astra ultrafast tier prices from the pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5634904175" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43745" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43745/hovercard" href="https://github.com/BerriAI/litellm/pull/43745">#43745</a></li> <li>fix(autorouter): compare historical and new savings consistently by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597461040" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43348" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43348/hovercard" href="https://github.com/BerriAI/litellm/pull/43348">#43348</a></li> <li>fix(model-prices): align Azure, Bedrock, Copilot, Gemini, Groq, OpenAI and OpenRouter entries with official docs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619917918" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43598" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43598/hovercard" href="https://github.com/BerriAI/litellm/pull/43598">#43598</a></li> <li>fix(guardrails): enable explicit PANW MCP output scanning by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577099291" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43109" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43109/hovercard" href="https://github.com/BerriAI/litellm/pull/43109">#43109</a></li> <li>refactor(rust): orchestrate Messages route execution by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5632681532" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43719" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43719/hovercard" href="https://github.com/BerriAI/litellm/pull/43719">#43719</a></li> <li>fix(streaming): keep the served service_tier on streamed chunks and spend rows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5562730129" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42870" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42870/hovercard" href="https://github.com/BerriAI/litellm/pull/42870">#42870</a></li> <li>feat(bedrock): add openai gpt-6.1-sol global and base rows by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5635983327" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43758" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43758/hovercard" href="https://github.com/BerriAI/litellm/pull/43758">#43758</a></li> <li>perf(router): fetch cooldown state and usage counters in one Redis round trip by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5595893271" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43320" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43320/hovercard" href="https://github.com/BerriAI/litellm/pull/43320">#43320</a></li> <li>perf(proxy): hold one spend counter batch across admission and across post-call accounting by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598188183" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43369" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43369/hovercard" href="https://github.com/BerriAI/litellm/pull/43369">#43369</a></li> <li>perf(responses): run aresponses through the async wrapper so the cache is read once by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5637247325" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43769" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43769/hovercard" href="https://github.com/BerriAI/litellm/pull/43769">#43769</a></li> <li>fix(router): bind Claude Code background sessions to their auto-router by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5637097037" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43767" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43767/hovercard" href="https://github.com/BerriAI/litellm/pull/43767">#43767</a></li> <li>feat(bedrock): add openai.gpt-6.1-sol us geo cris and Mantle rows by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5636399116" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43763" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43763/hovercard" href="https://github.com/BerriAI/litellm/pull/43763">#43763</a></li> <li>fix(proxy): recover session key owners from daily spend for usage attribution by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5622882106" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43642" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43642/hovercard" href="https://github.com/BerriAI/litellm/pull/43642">#43642</a></li> <li>chore(cost-map): take azure context limits from models-sold-directly by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5636045411" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43759" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43759/hovercard" href="https://github.com/BerriAI/litellm/pull/43759">#43759</a></li> <li>perf(proxy): one request-scoped Redis pipeline for auth, spend, rate-limit and routing reads by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599399405" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43407" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43407/hovercard" href="https://github.com/BerriAI/litellm/pull/43407">#43407</a></li> <li>fix(mcp): scope OpenAPI listings to the exact server prefix and drop upstream OAuth metadata when a server is saved by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5620482532" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43608" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43608/hovercard" href="https://github.com/BerriAI/litellm/pull/43608">#43608</a></li> <li>perf(proxy): one post-call Redis pipeline per backend for spend, rate-limit, routing and response-cache writes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5638606203" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43779" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43779/hovercard" href="https://github.com/BerriAI/litellm/pull/43779">#43779</a></li> <li>fix(bedrock): set gpt-6.1-sol max output tokens to 131072 by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5638805467" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43782" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43782/hovercard" href="https://github.com/BerriAI/litellm/pull/43782">#43782</a></li> <li>perf(proxy): refresh auth management objects through the request Redis pipeline by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5638309856" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43776" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43776/hovercard" href="https://github.com/BerriAI/litellm/pull/43776">#43776</a></li> <li>feat(agents): add identity storage and validation contracts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5632728694" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43720" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43720/hovercard" href="https://github.com/BerriAI/litellm/pull/43720">#43720</a></li> <li>chore: bump litellm-enterprise 0.1.71 -> 0.1.72, litellm-proxy-extras 0.4.102 -> 0.4.103, litellm 1.104.0 -> 1.105.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639373376" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43789" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43789/hovercard" href="https://github.com/BerriAI/litellm/pull/43789">#43789</a></li> <li>fix(auth): give UI/CLI session tokens their own AES-GCM context and header-safe shape by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639387794" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43790" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43790/hovercard" href="https://github.com/BerriAI/litellm/pull/43790">#43790</a></li> <li>chore(deps): bump pyjwt, moment and brace-expansion to clear osv-scan by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639517438" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43792" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43792/hovercard" href="https://github.com/BerriAI/litellm/pull/43792">#43792</a></li> <li>fix(ui): surface x-litellm-call-id in Logs search, table and drawer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5535979447" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42436" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42436/hovercard" href="https://github.com/BerriAI/litellm/pull/42436">#42436</a></li> <li>fix(proxy): look up hashed key names with two spend log rows per key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5623923791" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43656" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43656/hovercard" href="https://github.com/BerriAI/litellm/pull/43656">#43656</a></li> <li>fix(cost-map): add deprecation_date to two together_ai nvidia rows by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5640724951" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43809" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43809/hovercard" href="https://github.com/BerriAI/litellm/pull/43809">#43809</a></li> <li>test(ci): refresh retired OpenAI tool-call models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5627464944" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43676" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43676/hovercard" href="https://github.com/BerriAI/litellm/pull/43676">#43676</a></li> <li>fix(ui): keep MCP permissions visible after key, team and MCP server saves by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5640729430" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43810" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43810/hovercard" href="https://github.com/BerriAI/litellm/pull/43810">#43810</a></li> <li>test(ci): repair MCP Responses and budget fixtures by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639181592" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43788" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43788/hovercard" href="https://github.com/BerriAI/litellm/pull/43788">#43788</a></li> <li>test(bedrock): accept regional aliases that inherit Converse routing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639092401" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43785" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43785/hovercard" href="https://github.com/BerriAI/litellm/pull/43785">#43785</a></li> <li>fix(params): categorize internal param appropriately to prevent leaking into request by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shrey-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shrey-berri">@shrey-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5639022979" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43783" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43783/hovercard" href="https://github.com/BerriAI/litellm/pull/43783">#43783</a></li> <li>perf(router): honour the cooldown read interval in the routing prefetch by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5641511430" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43815" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43815/hovercard" href="https://github.com/BerriAI/litellm/pull/43815">#43815</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/daqiangganjun/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/daqiangganjun">@daqiangganjun</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5241642491" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38172" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38172/hovercard" href="https://github.com/BerriAI/litellm/pull/38172">#38172</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/4refael/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/4refael">@4refael</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5501263624" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41826" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41826/hovercard" href="https://github.com/BerriAI/litellm/pull/41826">#41826</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/agustin18/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/agustin18">@agustin18</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5595766589" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43319" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43319/hovercard" href="https://github.com/BerriAI/litellm/pull/43319">#43319</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shoemoney/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shoemoney">@shoemoney</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5230128924" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38049" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38049/hovercard" href="https://github.com/BerriAI/litellm/pull/38049">#38049</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/YaseenBashaT/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/YaseenBashaT">@YaseenBashaT</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5587153045" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43197" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43197/hovercard" href="https://github.com/BerriAI/litellm/pull/43197">#43197</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/stewartpark/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/stewartpark">@stewartpark</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5579238397" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43147" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43147/hovercard" href="https://github.com/BerriAI/litellm/pull/43147">#43147</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/hsm207/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/hsm207">@hsm207</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5610360071" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43536" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43536/hovercard" href="https://github.com/BerriAI/litellm/pull/43536">#43536</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ankit373/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ankit373">@ankit373</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5613243019" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43553" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43553/hovercard" href="https://github.com/BerriAI/litellm/pull/43553">#43553</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/DeviaVir/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/DeviaVir">@DeviaVir</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5613717875" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43558" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43558/hovercard" href="https://github.com/BerriAI/litellm/pull/43558">#43558</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Flexomatic81/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Flexomatic81">@Flexomatic81</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5619258064" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43588" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43588/hovercard" href="https://github.com/BerriAI/litellm/pull/43588">#43588</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/fedaeho/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/fedaeho">@fedaeho</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5608598611" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43512" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43512/hovercard" href="https://github.com/BerriAI/litellm/pull/43512">#43512</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.104.0-dev.2...v1.105.0-dev.1"><tt>v1.104.0-dev.2...v1.105.0-dev.1</tt></a></p> litellm-dispatcher[bot] tag:github.com,2008:Repository/671269505/v1.104.0-rc.2 2026-09-30T00:59:57Z

v1.104.0-rc.2

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.2</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.104.0-rc.2/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.104.0-rc.2/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.2</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.104.0-rc.1...v1.104.0-rc.2"><tt>v1.104.0-rc.1...v1.104.0-rc.2</tt></a></p> yuneng-berri tag:github.com,2008:Repository/671269505/v1.103.1 2026-09-30T00:59:43Z

v1.103.1

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.1</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.1/cosign.pub \ ghcr.io/berriai/litellm:v1.103.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.1/cosign.pub \ ghcr.io/berriai/litellm:v1.103.1</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.103.0...v1.103.1"><tt>v1.103.0...v1.103.1</tt></a></p> yuneng-berri tag:github.com,2008:Repository/671269505/v1.102.2 2026-09-30T00:58:27Z

v1.102.2

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.102.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.102.2</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.102.2/cosign.pub \ ghcr.io/berriai/litellm:v1.102.2"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.102.2/cosign.pub \ ghcr.io/berriai/litellm:v1.102.2</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.102.1...v1.102.2"><tt>v1.102.1...v1.102.2</tt></a></p> yuneng-berri tag:github.com,2008:Repository/671269505/v1.101.3 2026-09-30T00:58:12Z

v1.101.3

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.101.3"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.101.3</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.101.3/cosign.pub \ ghcr.io/berriai/litellm:v1.101.3"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.101.3/cosign.pub \ ghcr.io/berriai/litellm:v1.101.3</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.101.2...v1.101.3"><tt>v1.101.2...v1.101.3</tt></a></p> yuneng-berri tag:github.com,2008:Repository/671269505/v1.100.4 2026-09-30T00:56:11Z

v1.100.4

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.100.4"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.100.4</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.100.4/cosign.pub \ ghcr.io/berriai/litellm:v1.100.4"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.100.4/cosign.pub \ ghcr.io/berriai/litellm:v1.100.4</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.100.3...v1.100.4"><tt>v1.100.3...v1.100.4</tt></a></p> yuneng-berri tag:github.com,2008:Repository/671269505/v1.104.0-rc.1 2026-09-28T08:01:07Z

v1.104.0-rc.1

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.104.0-rc.1/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.104.0-rc.1/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>test(e2e): cover Azure code_interpreter container files by native id with a service-account key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577615016" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43122" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43122/hovercard" href="https://github.com/BerriAI/litellm/pull/43122">#43122</a></li> <li>fix(router): await budget redis pipeline before sync reads (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4846643424" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/32618" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/32618/hovercard" href="https://github.com/BerriAI/litellm/pull/32618">#32618</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577797567" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43125" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43125/hovercard" href="https://github.com/BerriAI/litellm/pull/43125">#43125</a></li> <li>chore(cost-map): add openai cached image input prices from the pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578726487" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43143" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43143/hovercard" href="https://github.com/BerriAI/litellm/pull/43143">#43143</a></li> <li>feat(langfuse)!: migrate the sdk callback to langfuse v4 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5138392653" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36741" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36741/hovercard" href="https://github.com/BerriAI/litellm/pull/36741">#36741</a></li> <li>fix(key_management): count team unified access group MCP servers when validating key MCP grants by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5462032255" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41231" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41231/hovercard" href="https://github.com/BerriAI/litellm/pull/41231">#41231</a></li> <li>fix(ui): group cost optimization cache leakage by model group by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5572571328" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43008" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43008/hovercard" href="https://github.com/BerriAI/litellm/pull/43008">#43008</a></li> <li>fix(presidio): mask streamed /v1/messages output when the first upstream read is a keepalive, a data-less ping, or a split utf8 character by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5573242625" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43023" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43023/hovercard" href="https://github.com/BerriAI/litellm/pull/43023">#43023</a></li> <li>test: backport stale and state-leaking test fixes to rc/1.104.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590493058" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43266" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43266/hovercard" href="https://github.com/BerriAI/litellm/pull/43266">#43266</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590520203" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43267" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43267/hovercard" href="https://github.com/BerriAI/litellm/pull/43267">#43267</a></li> <li>chore: backport CI fixes, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588044077" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43206" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43206/hovercard" href="https://github.com/BerriAI/litellm/pull/43206">#43206</a> and Rust changes to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5596665399" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43338" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43338/hovercard" href="https://github.com/BerriAI/litellm/pull/43338">#43338</a></li> <li>fix(s3_v2): backport <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5573143500" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43022" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43022/hovercard" href="https://github.com/BerriAI/litellm/pull/43022">#43022</a> to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597766034" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43354" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43354/hovercard" href="https://github.com/BerriAI/litellm/pull/43354">#43354</a></li> <li>chore: rebuild Admin UI bundle for rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598240490" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43372" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43372/hovercard" href="https://github.com/BerriAI/litellm/pull/43372">#43372</a></li> <li>chore: backport CircleCI speedups (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597425910" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43347" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43347/hovercard" href="https://github.com/BerriAI/litellm/pull/43347">#43347</a>) and cost-map fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5569123636" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42951" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42951/hovercard" href="https://github.com/BerriAI/litellm/pull/42951">#42951</a>) to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598151528" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43366" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43366/hovercard" href="https://github.com/BerriAI/litellm/pull/43366">#43366</a></li> <li>revert(usage): remove the top-N key cap, its follow-ups and the daily global spend rollup code from rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598462756" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43385" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43385/hovercard" href="https://github.com/BerriAI/litellm/pull/43385">#43385</a></li> <li>fix(streaming): backport text-completion usage chunk fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5574540480" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43047" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43047/hovercard" href="https://github.com/BerriAI/litellm/pull/43047">#43047</a>) to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599050848" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43402" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43402/hovercard" href="https://github.com/BerriAI/litellm/pull/43402">#43402</a></li> <li>test(e2e): report batch cleanup leftovers as a plain UserWarning on rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599392222" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43406" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43406/hovercard" href="https://github.com/BerriAI/litellm/pull/43406">#43406</a></li> <li>test(e2e): skip the LangSmith batch serialization e2e on rc/1.104.0 until CI has a LangSmith key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599792965" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43418" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43418/hovercard" href="https://github.com/BerriAI/litellm/pull/43418">#43418</a></li> <li>test(unit): stop test modules from putting their own directory on sys.path on rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599793279" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43420" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43420/hovercard" href="https://github.com/BerriAI/litellm/pull/43420">#43420</a></li> <li>fix(proxy): unregister logging callbacks removed from the stored config on rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5600929966" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43432" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43432/hovercard" href="https://github.com/BerriAI/litellm/pull/43432">#43432</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.104.0-dev.2...v1.104.0-rc.1"><tt>v1.104.0-dev.2...v1.104.0-rc.1</tt></a></p> litellm-dispatcher[bot] tag:github.com,2008:Repository/671269505/v1.103.0 2026-09-28T05:43:48Z

v1.103.0

<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.0"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.0</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.0"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.103.0/cosign.pub \ ghcr.io/berriai/litellm:v1.103.0</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>fix(responses): translate the reasoning object into a chat-completion reasoning effort by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshgarnett/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshgarnett">@joshgarnett</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5103898945" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36363" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36363/hovercard" href="https://github.com/BerriAI/litellm/pull/36363">#36363</a></li> <li>fix(proxy): bound tool and guardrail index create_many by the spend-log statement budgets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5409490214" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40561" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40561/hovercard" href="https://github.com/BerriAI/litellm/pull/40561">#40561</a></li> <li>fix(mcp): require admission for delegated OAuth by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436826688" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40923" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40923/hovercard" href="https://github.com/BerriAI/litellm/pull/40923">#40923</a></li> <li>fix(logging): log one bounded summary for a burst of timed-out LoggingWorker callbacks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436452698" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40912" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40912/hovercard" href="https://github.com/BerriAI/litellm/pull/40912">#40912</a></li> <li>fix(fireworks): resolve short model names to long cost map keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437097598" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40929" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40929/hovercard" href="https://github.com/BerriAI/litellm/pull/40929">#40929</a></li> <li>ci: remove main branch source guard by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5379761505" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40172" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40172/hovercard" href="https://github.com/BerriAI/litellm/pull/40172">#40172</a></li> <li>chore(ci): promote internal staging to main by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437924523" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40942" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40942/hovercard" href="https://github.com/BerriAI/litellm/pull/40942">#40942</a></li> <li>fix(spend_logs): store litellm_call_id and match it in request_id lookups by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5307861146" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39068" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39068/hovercard" href="https://github.com/BerriAI/litellm/pull/39068">#39068</a></li> <li>fix(auth): refresh lite login session token grants from the live user and team rows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5419257363" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40657" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40657/hovercard" href="https://github.com/BerriAI/litellm/pull/40657">#40657</a></li> <li>feat(bedrock): support file delete and list for S3-backed managed files by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5354458908" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39836" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39836/hovercard" href="https://github.com/BerriAI/litellm/pull/39836">#39836</a></li> <li>fix(proxy): gate the webhook test alert on proxy admins by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5430260765" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40814" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40814/hovercard" href="https://github.com/BerriAI/litellm/pull/40814">#40814</a></li> <li>fix(ui): hide admin write-form tabs on the models page from view-only admins by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5290312666" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38867" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38867/hovercard" href="https://github.com/BerriAI/litellm/pull/38867">#38867</a></li> <li>fix(anthropic-adapter): surface mid-stream provider errors as Anthropic error events by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4889511886" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/33352" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/33352/hovercard" href="https://github.com/BerriAI/litellm/pull/33352">#33352</a></li> <li>docs(github): add an Affected release section to the PR template by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5417214436" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40618" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40618/hovercard" href="https://github.com/BerriAI/litellm/pull/40618">#40618</a></li> <li>docs(e2e): ban unit tests under tests/e2e by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yassin-berriai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yassin-berriai">@yassin-berriai</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4920125272" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/33852" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/33852/hovercard" href="https://github.com/BerriAI/litellm/pull/33852">#33852</a></li> <li>fix(router): preserve Azure Entra ID params in reusable credentials by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5435575950" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40889" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40889/hovercard" href="https://github.com/BerriAI/litellm/pull/40889">#40889</a></li> <li>docs(user endpoints): remove unsupported soft_budget param from user docstrings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shivamrawat1/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shivamrawat1">@shivamrawat1</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5125870108" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36585" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36585/hovercard" href="https://github.com/BerriAI/litellm/pull/36585">#36585</a></li> <li>feat(friendli): auto-sync Friendli model metadata into price registry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/Lee-Si-Yoon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/Lee-Si-Yoon">@Lee-Si-Yoon</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5067908343" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/35918" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/35918/hovercard" href="https://github.com/BerriAI/litellm/pull/35918">#35918</a></li> <li>build(deps): bump smol-toml to 1.8.0 to clear <a title="GHSA-7w5x-hrqm-74c2" data-hovercard-type="advisory" data-hovercard-url="/advisories/GHSA-7w5x-hrqm-74c2/hovercard" href="https://github.com/advisories/GHSA-7w5x-hrqm-74c2">GHSA-7w5x-hrqm-74c2</a> in osv-scan by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5405413808" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40478" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40478/hovercard" href="https://github.com/BerriAI/litellm/pull/40478">#40478</a></li> <li>fix(bedrock_mantle): price GovCloud regions from the regional cost row and accept region-prefixed model names by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5354736401" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39846" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39846/hovercard" href="https://github.com/BerriAI/litellm/pull/39846">#39846</a></li> <li>chore(ci): remerge internal staging by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437951014" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40943" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40943/hovercard" href="https://github.com/BerriAI/litellm/pull/40943">#40943</a></li> <li>test(auth): freeze the cache clock in auth prefetch tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439397460" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40996" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40996/hovercard" href="https://github.com/BerriAI/litellm/pull/40996">#40996</a></li> <li>feat(jwt): allow virtual_key_claim_field per issuer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436988942" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40927" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40927/hovercard" href="https://github.com/BerriAI/litellm/pull/40927">#40927</a></li> <li>fix(cost): bill cached realtime audio tokens at the audio cache-read rate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5417832093" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40627" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40627/hovercard" href="https://github.com/BerriAI/litellm/pull/40627">#40627</a></li> <li>perf(logging): skip correlation contextvar stamping when request_correlation_in_logs is off by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5447294195" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41054" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41054/hovercard" href="https://github.com/BerriAI/litellm/pull/41054">#41054</a></li> <li>feat(pricing): add azure gpt-chat-latest rates and drop retired friendliai llama-3.1 entries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5438535550" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40976" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40976/hovercard" href="https://github.com/BerriAI/litellm/pull/40976">#40976</a></li> <li>build(deps): re-suppress <a title="GHSA-h7x2-h6g9-p789" data-hovercard-type="advisory" data-hovercard-url="/advisories/GHSA-h7x2-h6g9-p789/hovercard" href="https://github.com/advisories/GHSA-h7x2-h6g9-p789">GHSA-h7x2-h6g9-p789</a> in osv-scan on main, mlflow still has no fixed release by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453217359" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41104" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41104/hovercard" href="https://github.com/BerriAI/litellm/pull/41104">#41104</a></li> <li>fix(otel): cap per-index OpenInference message attributes span-wide by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5409585038" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40562" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40562/hovercard" href="https://github.com/BerriAI/litellm/pull/40562">#40562</a></li> <li>feat(proxy): add general_settings.allowed_file_extensions for /v1/files uploads by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453322565" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41106" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41106/hovercard" href="https://github.com/BerriAI/litellm/pull/41106">#41106</a></li> <li>fix(proxy): forward provider request id headers on mapped error responses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436975046" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40925" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40925/hovercard" href="https://github.com/BerriAI/litellm/pull/40925">#40925</a></li> <li>fix(router): name the all-deployments-in-cooldown error on 429 responses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439319982" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40995" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40995/hovercard" href="https://github.com/BerriAI/litellm/pull/40995">#40995</a></li> <li>fix(ui): show the team alias on the model info page and in its raw JSON by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439249223" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40992" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40992/hovercard" href="https://github.com/BerriAI/litellm/pull/40992">#40992</a></li> <li>feat(proxy): honor LITELLM_DISABLE_ACCESS_LOG_PATHS to drop noisy uvicorn access log lines by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5452082305" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41096" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41096/hovercard" href="https://github.com/BerriAI/litellm/pull/41096">#41096</a></li> <li>fix(prometheus): label pre-call rate limit failures with the resolved api_provider by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5447599135" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41059" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41059/hovercard" href="https://github.com/BerriAI/litellm/pull/41059">#41059</a></li> <li>perf(proxy): serialize /model/info listing once with orjson by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453927690" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41114" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41114/hovercard" href="https://github.com/BerriAI/litellm/pull/41114">#41114</a></li> <li>fix(utils): stop wrapper_async submitting the sync success handler twice by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453929317" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41115" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41115/hovercard" href="https://github.com/BerriAI/litellm/pull/41115">#41115</a></li> <li>fix(redis): log a timeout streak once per interval instead of one line per cache call by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5430369848" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40817" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40817/hovercard" href="https://github.com/BerriAI/litellm/pull/40817">#40817</a></li> <li>fix(router): record flat retry attempts and cap retries from attempted_retries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437178165" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40930" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40930/hovercard" href="https://github.com/BerriAI/litellm/pull/40930">#40930</a></li> <li>refactor(prometheus): source PROXY_LLM_PROVIDER_FALLBACK from litellm.constants by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454297025" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41118" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41118/hovercard" href="https://github.com/BerriAI/litellm/pull/41118">#41118</a></li> <li>fix(proxy): hide default credentials login hint when UI_PASSWORD is set by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453469890" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41107" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41107/hovercard" href="https://github.com/BerriAI/litellm/pull/41107">#41107</a></li> <li>fix(cli): show routed models and session stats for LLM API keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453964421" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41116" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41116/hovercard" href="https://github.com/BerriAI/litellm/pull/41116">#41116</a></li> <li>fix(bedrock/realtime): propagate deferred Nova Sonic stream failures to the router by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5447955766" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41064" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41064/hovercard" href="https://github.com/BerriAI/litellm/pull/41064">#41064</a></li> <li>fix(proxy): keep org admins' own team memberships in other orgs visible on team list by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5451317437" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41086" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41086/hovercard" href="https://github.com/BerriAI/litellm/pull/41086">#41086</a></li> <li>feat(model_info): provider-scoped fill_missing_for_providers backfill from fallback generalization rules by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5451885685" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41093" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41093/hovercard" href="https://github.com/BerriAI/litellm/pull/41093">#41093</a></li> <li>fix(auth): load team membership once per request and skip prisma on an L1 hit by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453191701" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41102" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41102/hovercard" href="https://github.com/BerriAI/litellm/pull/41102">#41102</a></li> <li>refactor(harness): expand independent trace coverage by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454370824" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41120" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41120/hovercard" href="https://github.com/BerriAI/litellm/pull/41120">#41120</a></li> <li>fix(proxy): release max_parallel_requests slot when a realtime session ends without LLM callbacks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453703547" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41113" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41113/hovercard" href="https://github.com/BerriAI/litellm/pull/41113">#41113</a></li> <li>fix(router): cool down team deployments on 429 when a sibling serves the same public model by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439247219" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40991" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40991/hovercard" href="https://github.com/BerriAI/litellm/pull/40991">#40991</a></li> <li>fix(ui): move tags typed into key metadata JSON into the Tags field by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5443410324" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41023" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41023/hovercard" href="https://github.com/BerriAI/litellm/pull/41023">#41023</a></li> <li>fix(ui): let team admins grant a team all proxy models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5381133744" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40196" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40196/hovercard" href="https://github.com/BerriAI/litellm/pull/40196">#40196</a></li> <li>chore(lint): graduate 12 rules from the strict-gate ratchet by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/HUAHAODIA/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/HUAHAODIA">@HUAHAODIA</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5446333689" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41048" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41048/hovercard" href="https://github.com/BerriAI/litellm/pull/41048">#41048</a></li> <li>test: add dedicated CircleCI integration contract foundation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5448239647" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41066" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41066/hovercard" href="https://github.com/BerriAI/litellm/pull/41066">#41066</a></li> <li>fix(utils): keep litellm params out of provider request bodies by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5442833193" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41018" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41018/hovercard" href="https://github.com/BerriAI/litellm/pull/41018">#41018</a></li> <li>fix(openai): keep extra_headers out of the chat request body on the httpx handler path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455329702" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41141" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41141/hovercard" href="https://github.com/BerriAI/litellm/pull/41141">#41141</a></li> <li>test: cover persisted updates and warmed authorization policies by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5448631468" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41070" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41070/hovercard" href="https://github.com/BerriAI/litellm/pull/41070">#41070</a></li> <li>fix(proxy): resolve x-litellm-call-id from response metadata when routes omit call_id by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5447503187" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41056" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41056/hovercard" href="https://github.com/BerriAI/litellm/pull/41056">#41056</a></li> <li>chore(prices): sync Vertex AI prices: 14 models by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5438090842" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40955" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40955/hovercard" href="https://github.com/BerriAI/litellm/pull/40955">#40955</a></li> <li>ci(codeql): exclude noisy Python quality queries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455445811" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41142" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41142/hovercard" href="https://github.com/BerriAI/litellm/pull/41142">#41142</a></li> <li>feat(proxy): predict prompt-cache costs across deployments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5435409934" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40877" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40877/hovercard" href="https://github.com/BerriAI/litellm/pull/40877">#40877</a></li> <li>fix(prompt_security): keep polling file sanitization through non-terminal statuses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454674772" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41131" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41131/hovercard" href="https://github.com/BerriAI/litellm/pull/41131">#41131</a></li> <li>fix(health): skip background health check DB writes when the latest-row read fails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455491549" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41145" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41145/hovercard" href="https://github.com/BerriAI/litellm/pull/41145">#41145</a></li> <li>feat(model_armor): logging_only mode scans completed streams after delivery by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5422459249" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40702" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40702/hovercard" href="https://github.com/BerriAI/litellm/pull/40702">#40702</a></li> <li>fix(bedrock guardrails): derive contextual grounding source and query from plain messages by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454763288" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41132" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41132/hovercard" href="https://github.com/BerriAI/litellm/pull/41132">#41132</a></li> <li>fix(cli): drop enum.StrEnum so the CLI imports on Python 3.10 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5446258395" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41046" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41046/hovercard" href="https://github.com/BerriAI/litellm/pull/41046">#41046</a></li> <li>fix(responses): route mid-stream error events through exception_type so content_policy_fallbacks fire by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439215366" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40988" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40988/hovercard" href="https://github.com/BerriAI/litellm/pull/40988">#40988</a></li> <li>fix(cost): bill gemini-embedding-2 per token and stop double charging audio by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456120969" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41157" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41157/hovercard" href="https://github.com/BerriAI/litellm/pull/41157">#41157</a></li> <li>test: bind management E2E callers and isolate JWT actors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5435831135" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40892" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40892/hovercard" href="https://github.com/BerriAI/litellm/pull/40892">#40892</a></li> <li>fix(headroom): protect cache_control-marked rows anywhere in history by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rad-p44/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rad-p44">@rad-p44</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5392754151" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40315" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40315/hovercard" href="https://github.com/BerriAI/litellm/pull/40315">#40315</a></li> <li>test: add strict stateless provider replay identity by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455822448" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41149" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41149/hovercard" href="https://github.com/BerriAI/litellm/pull/41149">#41149</a></li> <li>fix(ci): test checked-out model pricing in unit jobs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457325954" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41181" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41181/hovercard" href="https://github.com/BerriAI/litellm/pull/41181">#41181</a></li> <li>fix(guardrails): write per-message guardrail rewrites back onto Responses input items by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437776973" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40939" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40939/hovercard" href="https://github.com/BerriAI/litellm/pull/40939">#40939</a></li> <li>fix(proxy): log the provider usage on deferred /v1/messages calls and price cache writes without a creation rate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456710189" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41172" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41172/hovercard" href="https://github.com/BerriAI/litellm/pull/41172">#41172</a></li> <li>fix(guardrails): record not_run evaluation when scoping leaves nothing to scan by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5306670523" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39050" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39050/hovercard" href="https://github.com/BerriAI/litellm/pull/39050">#39050</a></li> <li>fix(responses): preserve provider affinity by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AaronHowell/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AaronHowell">@AaronHowell</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5384902691" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40228" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40228/hovercard" href="https://github.com/BerriAI/litellm/pull/40228">#40228</a></li> <li>fix(sdk): keep body and proxy headers on BadRequestError mapped from a litellm_proxy 400 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439290159" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40994" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40994/hovercard" href="https://github.com/BerriAI/litellm/pull/40994">#40994</a></li> <li>fix(responses): hoist Codex additional_tools input items into the chat bridge tools by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439219558" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40989" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40989/hovercard" href="https://github.com/BerriAI/litellm/pull/40989">#40989</a></li> <li>fix(router): honor team and key provider weights by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5449008739" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41072" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41072/hovercard" href="https://github.com/BerriAI/litellm/pull/41072">#41072</a></li> <li>test(e2e): verify streamed answers and tool continuation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5458092644" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41194" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41194/hovercard" href="https://github.com/BerriAI/litellm/pull/41194">#41194</a></li> <li>fix(cli): label router costs and simplify the routed-model header by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457605729" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41186" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41186/hovercard" href="https://github.com/BerriAI/litellm/pull/41186">#41186</a></li> <li>test(spend): reconcile concurrent requests and daily activity by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457680424" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41188" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41188/hovercard" href="https://github.com/BerriAI/litellm/pull/41188">#41188</a></li> <li>fix(guardrails): scan the Anthropic top-level system prompt and tool_use arguments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439115230" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40984" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40984/hovercard" href="https://github.com/BerriAI/litellm/pull/40984">#40984</a></li> <li>fix(router): count num_retries_per_request across fallback hops by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457948196" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41191" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41191/hovercard" href="https://github.com/BerriAI/litellm/pull/41191">#41191</a></li> <li>fix(bedrock): grant rerank, retrieve, agent, and agentcore actions in the web identity session policy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456609151" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41168" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41168/hovercard" href="https://github.com/BerriAI/litellm/pull/41168">#41168</a></li> <li>fix(vertex-live): bill Gemini Live sessions end to end (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5163190804" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/37075" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/37075/hovercard" href="https://github.com/BerriAI/litellm/pull/37075">#37075</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436643701" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40915" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40915/hovercard" href="https://github.com/BerriAI/litellm/pull/40915">#40915</a></li> <li>fix(health): resolve litellm_credential_name in realtime health checks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456727355" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41173" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41173/hovercard" href="https://github.com/BerriAI/litellm/pull/41173">#41173</a></li> <li>feat(proxy): unified custom_key_policy hook for key generate, update and regenerate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436794097" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40921" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40921/hovercard" href="https://github.com/BerriAI/litellm/pull/40921">#40921</a></li> <li>fix(proxy): enforce custom_key_update policy on /key/regenerate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5421730062" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40695" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40695/hovercard" href="https://github.com/BerriAI/litellm/pull/40695">#40695</a></li> <li>fix(router): preserve session model choice within each complexity tier by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456807038" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41174" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41174/hovercard" href="https://github.com/BerriAI/litellm/pull/41174">#41174</a></li> <li>test(pricing): let synced GovCloud Bedrock rows cite the AWS price list by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5465096399" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41263" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41263/hovercard" href="https://github.com/BerriAI/litellm/pull/41263">#41263</a></li> <li>docs(github): ask for interactive coding-tool proof in the PR template by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5464732800" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41257" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41257/hovercard" href="https://github.com/BerriAI/litellm/pull/41257">#41257</a></li> <li>feat(proxy): add POST /management/v1/users/bulk for batched user and team membership creation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5444076635" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41028" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41028/hovercard" href="https://github.com/BerriAI/litellm/pull/41028">#41028</a></li> <li>fix(credentials): answer 409 on a credential name collision, make Terraform adoption opt-in by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436731824" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40917" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40917/hovercard" href="https://github.com/BerriAI/litellm/pull/40917">#40917</a></li> <li>feat(proxy): add POST /management/v1/users/bulk_delete and POST /management/v1/teams/{team_id}/members/bulk_delete by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5445380398" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41039" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41039/hovercard" href="https://github.com/BerriAI/litellm/pull/41039">#41039</a></li> <li>fix(proxy): list directly assigned team models in model access errors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5464726245" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41256" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41256/hovercard" href="https://github.com/BerriAI/litellm/pull/41256">#41256</a></li> <li>feat(auto-router): allow opted-in team members to manage their routers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456928251" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41175" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41175/hovercard" href="https://github.com/BerriAI/litellm/pull/41175">#41175</a></li> <li>build(rust-bridge): add typed _native stub and validate it with mypy.stubtest by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457317814" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41180" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41180/hovercard" href="https://github.com/BerriAI/litellm/pull/41180">#41180</a></li> <li>feat(guardrails): add new upstream presidio pii entities including german set by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/MvdB/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/MvdB">@MvdB</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142490288" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36775" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36775/hovercard" href="https://github.com/BerriAI/litellm/pull/36775">#36775</a></li> <li>fix(responses): filter bridged kwargs like the native Responses path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455469813" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41144" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41144/hovercard" href="https://github.com/BerriAI/litellm/pull/41144">#41144</a></li> <li>test(e2e): cover the reliability retry, cooldown, fallback, and routing-strategy cells by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5355157945" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39857" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39857/hovercard" href="https://github.com/BerriAI/litellm/pull/39857">#39857</a></li> <li>fix(anthropic): add the per-turn-control beta when a message carries output_config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457752555" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41189" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41189/hovercard" href="https://github.com/BerriAI/litellm/pull/41189">#41189</a></li> <li>fix(router): bind per-request routing_strategy override selectors to the request's callbacks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457234149" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41178" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41178/hovercard" href="https://github.com/BerriAI/litellm/pull/41178">#41178</a></li> <li>feat(proxy): bind JWT claims to registered agents via agent_id_jwt_field by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5436166555" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40904" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40904/hovercard" href="https://github.com/BerriAI/litellm/pull/40904">#40904</a></li> <li>fix(proxy): enforce organization budgets when max_budget is 0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yassin-berriai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yassin-berriai">@yassin-berriai</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5465947824" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41271" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41271/hovercard" href="https://github.com/BerriAI/litellm/pull/41271">#41271</a></li> <li>fix(alerting): send llm_exceptions Slack alert for 5xx HTTPException and ProxyException by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454527947" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41125" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41125/hovercard" href="https://github.com/BerriAI/litellm/pull/41125">#41125</a></li> <li>fix(headroom): protect the cached prefix through the last cache_control breakpoint by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456270518" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41161" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41161/hovercard" href="https://github.com/BerriAI/litellm/pull/41161">#41161</a></li> <li>fix(utils): cache custom HuggingFace tokenizers across /utils/token_counter requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5460033774" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41216" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41216/hovercard" href="https://github.com/BerriAI/litellm/pull/41216">#41216</a></li> <li>fix(router): keep weighted routing when a deployment id equals a model_name by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456111127" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41156" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41156/hovercard" href="https://github.com/BerriAI/litellm/pull/41156">#41156</a></li> <li>feat(router): add capability classifier as Fuse foundation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5465934421" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41270" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41270/hovercard" href="https://github.com/BerriAI/litellm/pull/41270">#41270</a></li> <li>fix(proxy): keep access-group raw SQL writes on the writer while writer_unavailable is stale by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5466628561" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41283" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41283/hovercard" href="https://github.com/BerriAI/litellm/pull/41283">#41283</a></li> <li>fix(prometheus): count 401 auth failures in litellm_proxy_failed_requests_metric by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456677631" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41170" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41170/hovercard" href="https://github.com/BerriAI/litellm/pull/41170">#41170</a></li> <li>test: drop tests that pin vendor facts and add the CLAUDE.md rule by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5465879485" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41269" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41269/hovercard" href="https://github.com/BerriAI/litellm/pull/41269">#41269</a></li> <li>fix(proxy): run the remaining inline token counts off the event loop by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5389651000" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40262" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40262/hovercard" href="https://github.com/BerriAI/litellm/pull/40262">#40262</a></li> <li>fix(proxy): log blocked streaming guardrail responses as failures, not success by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5380757342" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40191" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40191/hovercard" href="https://github.com/BerriAI/litellm/pull/40191">#40191</a></li> <li>feat(proxy): add tpd_limit (tokens per day) for batch submissions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439430307" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40997" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40997/hovercard" href="https://github.com/BerriAI/litellm/pull/40997">#40997</a></li> <li>fix(proxy): reconcile budget reservation before enqueuing spend to the DB by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5392425030" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40310" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40310/hovercard" href="https://github.com/BerriAI/litellm/pull/40310">#40310</a></li> <li>fix(xai): stop sending web_search_options to xAI's retired Live Search path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5251556114" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38278" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38278/hovercard" href="https://github.com/BerriAI/litellm/pull/38278">#38278</a></li> <li>feat(terraform): add tpm_limit, rpm_limit, budget_duration, allowed_models to litellm_team_member_add by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5280756866" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38682" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38682/hovercard" href="https://github.com/BerriAI/litellm/pull/38682">#38682</a></li> <li>fix(rerank): bill Vertex search_units from input records and give every rerank response a unique id by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5015500369" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/35180" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/35180/hovercard" href="https://github.com/BerriAI/litellm/pull/35180">#35180</a></li> <li>fix(router): stop counting caller-set timeout 408s toward deployment cooldown by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5462015844" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41230" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41230/hovercard" href="https://github.com/BerriAI/litellm/pull/41230">#41230</a></li> <li>feat(router): add Fuse V2 classifier after capability forecasting by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5465959042" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41272" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41272/hovercard" href="https://github.com/BerriAI/litellm/pull/41272">#41272</a></li> <li>fix(proxy): keep client User-Agent on auth failure spend logs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467238539" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41291" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41291/hovercard" href="https://github.com/BerriAI/litellm/pull/41291">#41291</a></li> <li>fix(proxy): reset budgets by decrementing pre-reset spend instead of zeroing rows by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5466473134" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41279" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41279/hovercard" href="https://github.com/BerriAI/litellm/pull/41279">#41279</a></li> <li>fix(xai): honor nested web_search filters on the xAI Responses API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5251301110" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38268" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38268/hovercard" href="https://github.com/BerriAI/litellm/pull/38268">#38268</a></li> <li>fix(router): stop registering a caller-supplied credential as a router deployment by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yassin-berriai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yassin-berriai">@yassin-berriai</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467163402" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41289" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41289/hovercard" href="https://github.com/BerriAI/litellm/pull/41289">#41289</a></li> <li>fix(router): accept custom_provider_map providers before the first completion call by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467691292" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41300" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41300/hovercard" href="https://github.com/BerriAI/litellm/pull/41300">#41300</a></li> <li>fix(proxy): return 400 instead of 500 for lone surrogate escapes in request body by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467670155" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41297" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41297/hovercard" href="https://github.com/BerriAI/litellm/pull/41297">#41297</a></li> <li>fix(langsmith): keep events appended during an in-flight flush instead of clearing them by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467137158" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41288" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41288/hovercard" href="https://github.com/BerriAI/litellm/pull/41288">#41288</a></li> <li>fix(logging): track spend for streams a deployment hook converted to non-streaming by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456691413" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41171" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41171/hovercard" href="https://github.com/BerriAI/litellm/pull/41171">#41171</a></li> <li>fix(bedrock): sanitize client tool_call ids to Bedrock toolUseId constraints by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5435103740" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40872" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40872/hovercard" href="https://github.com/BerriAI/litellm/pull/40872">#40872</a></li> <li>fix(passthrough): attribute Vertex passthrough successes to the resolved router deployment by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467831231" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41307" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41307/hovercard" href="https://github.com/BerriAI/litellm/pull/41307">#41307</a></li> <li>feat(ui): persist Models table search, filters, sort and page in the URL by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467670053" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41296" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41296/hovercard" href="https://github.com/BerriAI/litellm/pull/41296">#41296</a></li> <li>fix(jwt-auth): scope JWT key mappings by issuer to prevent cross-issuer collisions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yassin-berriai/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yassin-berriai">@yassin-berriai</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5466534412" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41281" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41281/hovercard" href="https://github.com/BerriAI/litellm/pull/41281">#41281</a></li> <li>feat(openai): add openai_system_messages_first to put system messages first for prompt caching by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467773798" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41304" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41304/hovercard" href="https://github.com/BerriAI/litellm/pull/41304">#41304</a></li> <li>feat(ui): add custom request headers to the API Playground by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467922916" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41309" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41309/hovercard" href="https://github.com/BerriAI/litellm/pull/41309">#41309</a></li> <li>feat(cli): sync Codex /model picker from proxy /v1/models in lite codex by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5405223501" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40476" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40476/hovercard" href="https://github.com/BerriAI/litellm/pull/40476">#40476</a></li> <li>chore: bump litellm-enterprise 0.1.67 -> 0.1.68, litellm-proxy-extras 0.4.97 -> 0.4.98, litellm 1.102.0 -> 1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468208678" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41321" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41321/hovercard" href="https://github.com/BerriAI/litellm/pull/41321">#41321</a></li> <li>feat: add aihubmix provider pricing entries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/IToSSc/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/IToSSc">@IToSSc</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457267984" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41179" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41179/hovercard" href="https://github.com/BerriAI/litellm/pull/41179">#41179</a></li> <li>feat(auto-router): add per-model Fast mode toggle by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5466543705" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41282" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41282/hovercard" href="https://github.com/BerriAI/litellm/pull/41282">#41282</a></li> <li>fix(proxy): include litellm_call_id in LLM API exception logs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5459160706" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41205" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41205/hovercard" href="https://github.com/BerriAI/litellm/pull/41205">#41205</a></li> <li>fix(proxy): keep yaml pass-through endpoints visible to auth after db overlay by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467757379" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41303" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41303/hovercard" href="https://github.com/BerriAI/litellm/pull/41303">#41303</a></li> <li>fix(proxy): resolve router_settings.model_group_alias before key/team model auth by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467919040" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41308" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41308/hovercard" href="https://github.com/BerriAI/litellm/pull/41308">#41308</a></li> <li>fix(ui): block usage export and flag the range when a spend page fails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467559626" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41294" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41294/hovercard" href="https://github.com/BerriAI/litellm/pull/41294">#41294</a></li> <li>fix(vertex_ai): bill Gemini Omni Interactions usage and Veo sampleCount on passthrough by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468231892" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41322" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41322/hovercard" href="https://github.com/BerriAI/litellm/pull/41322">#41322</a></li> <li>fix(proxy): honor LITELLM_LOG for uvicorn and proxy extras loggers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467810967" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41306" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41306/hovercard" href="https://github.com/BerriAI/litellm/pull/41306">#41306</a></li> <li>fix(cost): price native Responses WebSocket turns at their returned service_tier by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468139089" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41318" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41318/hovercard" href="https://github.com/BerriAI/litellm/pull/41318">#41318</a></li> <li>fix(proxy): key model rpm/tpm override takes precedence over team model limit by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467737215" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41302" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41302/hovercard" href="https://github.com/BerriAI/litellm/pull/41302">#41302</a></li> <li>fix(proxy): track per-member organization spend by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5464723925" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41255" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41255/hovercard" href="https://github.com/BerriAI/litellm/pull/41255">#41255</a></li> <li>feat(proxy): add /nvidia_nim passthrough route for NIM object detection and OCR /v1/infer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468037541" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41316" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41316/hovercard" href="https://github.com/BerriAI/litellm/pull/41316">#41316</a></li> <li>feat(model_info): add provider-neutral Gemini 2.5+ chat baseline fallback generalization by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468165310" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41320" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41320/hovercard" href="https://github.com/BerriAI/litellm/pull/41320">#41320</a></li> <li>fix(spend): sum multi-round session duration in logs UI by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5032479878" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/35388" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/35388/hovercard" href="https://github.com/BerriAI/litellm/pull/35388">#35388</a></li> <li>feat(router): limit unlicensed Capability and Fuse v2 routers to one each by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468407718" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41326" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41326/hovercard" href="https://github.com/BerriAI/litellm/pull/41326">#41326</a></li> <li>fix(guardrails): resolve caller identity from metadata buckets in custom code guardrail by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454595454" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41126" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41126/hovercard" href="https://github.com/BerriAI/litellm/pull/41126">#41126</a></li> <li>fix(e2e): onboard dashboard users through invitations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468158783" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41319" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41319/hovercard" href="https://github.com/BerriAI/litellm/pull/41319">#41319</a></li> <li>feat(guardrails): add Microsoft Agent 365 MCP tool-call guardrail by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5249124011" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38241" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38241/hovercard" href="https://github.com/BerriAI/litellm/pull/38241">#38241</a></li> <li>test: drop remaining tests that pin cost-map vendor facts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467679273" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41298" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41298/hovercard" href="https://github.com/BerriAI/litellm/pull/41298">#41298</a></li> <li>feat(ui): show average response time per model in usage model activity by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467986963" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41313" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41313/hovercard" href="https://github.com/BerriAI/litellm/pull/41313">#41313</a></li> <li>fix(proxy): preserve Anthropic pricing modifiers in router savings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468994162" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41341" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41341/hovercard" href="https://github.com/BerriAI/litellm/pull/41341">#41341</a></li> <li>feat(guardrails): support pre_call and during_call modes for llm_as_a_judge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5454637377" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41128" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41128/hovercard" href="https://github.com/BerriAI/litellm/pull/41128">#41128</a></li> <li>fix(gemini): propagate the provider's modelVersion to the response model by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468872515" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41338" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41338/hovercard" href="https://github.com/BerriAI/litellm/pull/41338">#41338</a></li> <li>fix(fireworks-ai): bill cache-write, reasoning and audio tokens via the shared cost calculator by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468872728" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41339" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41339/hovercard" href="https://github.com/BerriAI/litellm/pull/41339">#41339</a></li> <li>feat(guardrails): singulr v2 API contract with logging_only, pre_mcp_call and post_mcp_call by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468586390" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41329" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41329/hovercard" href="https://github.com/BerriAI/litellm/pull/41329">#41329</a></li> <li>ci(image-scan): ignore zlib <a title="CVE-2026-85091" data-hovercard-type="advisory" data-hovercard-url="/advisories/GHSA-g5fp-32jq-cfw2/hovercard" href="https://github.com/advisories/GHSA-g5fp-32jq-cfw2">CVE-2026-85091</a> until Wolfi ships the fix by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469290222" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41353" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41353/hovercard" href="https://github.com/BerriAI/litellm/pull/41353">#41353</a></li> <li>feat(e2e): reuse exact provider responses for 24 hours by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469080263" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41346" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41346/hovercard" href="https://github.com/BerriAI/litellm/pull/41346">#41346</a></li> <li>fix(xai): keep 'instructions' on the xAI Responses API so system messages survive web search by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5249956045" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/38254" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/38254/hovercard" href="https://github.com/BerriAI/litellm/pull/38254">#38254</a></li> <li>feat(ui): configure capability and Fuse v2 classifiers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468036206" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41315" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41315/hovercard" href="https://github.com/BerriAI/litellm/pull/41315">#41315</a></li> <li>fix(anthropic): tolerate message_delta events without usage when streaming by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468871939" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41336" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41336/hovercard" href="https://github.com/BerriAI/litellm/pull/41336">#41336</a></li> <li>test(router): ignore deployment-selection logs in the fallback log assertion by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469627136" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41358" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41358/hovercard" href="https://github.com/BerriAI/litellm/pull/41358">#41358</a></li> <li>test(proxy): assert budget resets decrement the cleared spend by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469642745" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41359" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41359/hovercard" href="https://github.com/BerriAI/litellm/pull/41359">#41359</a></li> <li>fix(e2e): expect models filters to persist after reload by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469119399" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41348" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41348/hovercard" href="https://github.com/BerriAI/litellm/pull/41348">#41348</a></li> <li>fix(e2e): record cookie-setting provider responses and keep prompt-caching tests live by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469866313" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41366" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41366/hovercard" href="https://github.com/BerriAI/litellm/pull/41366">#41366</a></li> <li>fix(responses): recount tokens when a streamed response completes without usage by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468872284" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41337" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41337/hovercard" href="https://github.com/BerriAI/litellm/pull/41337">#41337</a></li> <li>fix(ui): simplify Capability and Fuse advanced routing options by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5470049043" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41371" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41371/hovercard" href="https://github.com/BerriAI/litellm/pull/41371">#41371</a></li> <li>fix(mcp): authorize JWT OAuth credential persistence by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468010421" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41314" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41314/hovercard" href="https://github.com/BerriAI/litellm/pull/41314">#41314</a></li> <li>feat(router): stream shadow traffic and fan out silent_model to multiple targets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469940669" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41368" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41368/hovercard" href="https://github.com/BerriAI/litellm/pull/41368">#41368</a></li> <li>perf(content_filter): scan a bounded window per streamed chunk by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5473293817" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41407" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41407/hovercard" href="https://github.com/BerriAI/litellm/pull/41407">#41407</a></li> <li>fix(proxy): hide model allowlist from client-facing model access denied errors by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467933698" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41310" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41310/hovercard" href="https://github.com/BerriAI/litellm/pull/41310">#41310</a></li> <li>feat(http): opt-in outbound HTTP/2 for httpx clients by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5465561712" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41268" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41268/hovercard" href="https://github.com/BerriAI/litellm/pull/41268">#41268</a></li> <li>refactor(rust): remove gateway, config, router, realtime, and Rust trace-parity instrumentation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5476895005" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41432" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41432/hovercard" href="https://github.com/BerriAI/litellm/pull/41432">#41432</a></li> <li>fix(guardrails): don't add post_call output scan for MCP-only Presidio modes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5410926683" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40571" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40571/hovercard" href="https://github.com/BerriAI/litellm/pull/40571">#40571</a></li> <li>chore(prices): sync Azure, Azure AI, Gemini, OpenAI, Bedrock, Together AI, Fireworks and Vertex prices: 278 models, 59 new, 30 deprecated by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5456075740" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41154" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41154/hovercard" href="https://github.com/BerriAI/litellm/pull/41154">#41154</a></li> <li>fix(rag): forward retrieval_filter from retrieval_config to vector store search by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4962794321" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/34427" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/34427/hovercard" href="https://github.com/BerriAI/litellm/pull/34427">#34427</a></li> <li>refactor(rust): extract auth and cache crates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478336902" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41464" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41464/hovercard" href="https://github.com/BerriAI/litellm/pull/41464">#41464</a></li> <li>fix(proxy): default litellm_trace_id to the OTel server span trace id by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5471568945" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41386" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41386/hovercard" href="https://github.com/BerriAI/litellm/pull/41386">#41386</a></li> <li>chore(codeowners): add ryan and kerry as owners of the cost map by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468777611" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41333" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41333/hovercard" href="https://github.com/BerriAI/litellm/pull/41333">#41333</a></li> <li>fix(responses): guard empty-choices chunks in the Responses API streaming bridge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4964401179" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/34455" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/34455/hovercard" href="https://github.com/BerriAI/litellm/pull/34455">#34455</a></li> <li>chore(prices): sync Google Gemini prices: 22 models by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478044518" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41457" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41457/hovercard" href="https://github.com/BerriAI/litellm/pull/41457">#41457</a></li> <li>fix(bedrock): forward userContext in Knowledge Base Retrieve requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478682731" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41475" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41475/hovercard" href="https://github.com/BerriAI/litellm/pull/41475">#41475</a></li> <li>ci(rust): split rust jobs, use nextest and Swatinem/rust-cache by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478903140" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41480" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41480/hovercard" href="https://github.com/BerriAI/litellm/pull/41480">#41480</a></li> <li>fix(fireworks_ai): flatten dict-form reasoning_effort to its effort string by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468850657" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41335" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41335/hovercard" href="https://github.com/BerriAI/litellm/pull/41335">#41335</a></li> <li>fix(proxy): never forward the LiteLLM virtual key to Anthropic on the /anthropic passthrough by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468950560" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41340" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41340/hovercard" href="https://github.com/BerriAI/litellm/pull/41340">#41340</a></li> <li>fix(proxy): rename AWS Secrets Manager secret when key alias changes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478475833" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41468" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41468/hovercard" href="https://github.com/BerriAI/litellm/pull/41468">#41468</a></li> <li>feat(otel): promote nested request metadata keys to litellm.metadata.* span attributes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478257318" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41462" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41462/hovercard" href="https://github.com/BerriAI/litellm/pull/41462">#41462</a></li> <li>fix(proxy): sync AWS Secrets Manager on body-less key regenerate and key alias changes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478134001" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41458" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41458/hovercard" href="https://github.com/BerriAI/litellm/pull/41458">#41458</a></li> <li>fix(http_handler): keep a handler alive while a response it issued is still reading by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/max-sixty/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/max-sixty">@max-sixty</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4992184868" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/34829" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/34829/hovercard" href="https://github.com/BerriAI/litellm/pull/34829">#34829</a></li> <li>fix(bedrock): make prompt caching work on the Nova InvokeModel route by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469005182" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41343" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41343/hovercard" href="https://github.com/BerriAI/litellm/pull/41343">#41343</a></li> <li>ci(migrations): flag defaulted ADD COLUMN on request-log tables by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478184552" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41460" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41460/hovercard" href="https://github.com/BerriAI/litellm/pull/41460">#41460</a></li> <li>feat(prometheus): add customer (end_user) budget gauges by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478568068" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41472" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41472/hovercard" href="https://github.com/BerriAI/litellm/pull/41472">#41472</a></li> <li>fix(otel): drop None metric and event attributes before OTLP export by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5145444480" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36815" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36815/hovercard" href="https://github.com/BerriAI/litellm/pull/36815">#36815</a></li> <li>fix(anthropic): carry the served model from message_start onto stream chunks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5477838671" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41446" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41446/hovercard" href="https://github.com/BerriAI/litellm/pull/41446">#41446</a></li> <li>fix(models): rolling registry audit: Gemini latest aliases, Nova cache pricing, OpenRouter/Together sync, Mistral GLM 5.3, Azure snapshots, Grok caching by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5453607830" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41112" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41112/hovercard" href="https://github.com/BerriAI/litellm/pull/41112">#41112</a></li> <li>fix(router): count TPM/RPM usage before building rate-limit headers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478662718" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41474" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41474/hovercard" href="https://github.com/BerriAI/litellm/pull/41474">#41474</a></li> <li>feat(guardrails): release buffered stream chunks after each passing scan by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5475800190" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41425" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41425/hovercard" href="https://github.com/BerriAI/litellm/pull/41425">#41425</a></li> <li>fix!: re-check budget on router fallback targets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/runjivu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/runjivu">@runjivu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5470921175" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41379" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41379/hovercard" href="https://github.com/BerriAI/litellm/pull/41379">#41379</a></li> <li>refactor(ocr): move file preparation from the python bridge into litellm-core by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480019740" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41489" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41489/hovercard" href="https://github.com/BerriAI/litellm/pull/41489">#41489</a></li> <li>feat(s3): add s3_log_prompts_only option to log prompts without responses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468428989" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41327" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41327/hovercard" href="https://github.com/BerriAI/litellm/pull/41327">#41327</a></li> <li>feat(team): team-level model_max_budget with key-level overrides by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468659135" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41330" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41330/hovercard" href="https://github.com/BerriAI/litellm/pull/41330">#41330</a></li> <li>feat(keys): filter /key/list by active, expired, revoked or deleted status and serve deleted keys from /key/info by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467938717" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41311" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41311/hovercard" href="https://github.com/BerriAI/litellm/pull/41311">#41311</a></li> <li>feat(proxy): expose lifetime total_spend on virtual keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5472842219" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41403" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41403/hovercard" href="https://github.com/BerriAI/litellm/pull/41403">#41403</a></li> <li>fix(proxy): release completed max-parallel slots promptly by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/elifozdamar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/elifozdamar">@elifozdamar</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5432256523" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40843" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40843/hovercard" href="https://github.com/BerriAI/litellm/pull/40843">#40843</a></li> <li>feat(ui): accept ssh clone urls when registering a skill by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5033628563" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/35418" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/35418/hovercard" href="https://github.com/BerriAI/litellm/pull/35418">#35418</a></li> <li>fix(prices): dedupe Nova cache_read_input_token_cost keys left by a text merge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480386911" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41496" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41496/hovercard" href="https://github.com/BerriAI/litellm/pull/41496">#41496</a></li> <li>fix(otel): propagate W3C trace context on HTTP and WebSocket passthrough by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5419777323" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40669" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40669/hovercard" href="https://github.com/BerriAI/litellm/pull/40669">#40669</a></li> <li>fix(proxy): remove duplicate user budget hook that 429'd zero-cost models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469030804" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41345" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41345/hovercard" href="https://github.com/BerriAI/litellm/pull/41345">#41345</a></li> <li>test(logging): pick this test's own records out of the shared log batch by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5479812947" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41487" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41487/hovercard" href="https://github.com/BerriAI/litellm/pull/41487">#41487</a></li> <li>test(together_ai): move request-shape checks to the mapped file, drop the live ones by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469664832" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41360" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41360/hovercard" href="https://github.com/BerriAI/litellm/pull/41360">#41360</a></li> <li>feat(ui): shared URL-state layer for tables and tabs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468662710" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41331" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41331/hovercard" href="https://github.com/BerriAI/litellm/pull/41331">#41331</a></li> <li>feat(e2e): make the provider cache reusable across builds and mount Bedrock behind it by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5472776418" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41402" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41402/hovercard" href="https://github.com/BerriAI/litellm/pull/41402">#41402</a></li> <li>fix(mcp): fail closed on missing upstream credentials by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469803130" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41364" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41364/hovercard" href="https://github.com/BerriAI/litellm/pull/41364">#41364</a></li> <li>feat(rust): scaffold Redis cache crate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480650150" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41501" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41501/hovercard" href="https://github.com/BerriAI/litellm/pull/41501">#41501</a></li> <li>fix(dashscope): forward reasoning_effort to the provider by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5196865410" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/37506" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/37506/hovercard" href="https://github.com/BerriAI/litellm/pull/37506">#37506</a></li> <li>fix(proxy): carry litellm_call_id through endpoint specific error logs and failure responses by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469555913" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41356" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41356/hovercard" href="https://github.com/BerriAI/litellm/pull/41356">#41356</a></li> <li>fix(proxy): retry rate-limit fallbacks from a pristine request snapshot by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5415244025" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40596" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40596/hovercard" href="https://github.com/BerriAI/litellm/pull/40596">#40596</a></li> <li>fix(gemini): map minimal thinking to low for Gemini 3.7 and 3.8 Flash by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5458784535" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41201" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41201/hovercard" href="https://github.com/BerriAI/litellm/pull/41201">#41201</a></li> <li>fix(proxy): stop forwarding LiteLLM credential headers on Bedrock agent-runtime passthrough by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480816596" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41504" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41504/hovercard" href="https://github.com/BerriAI/litellm/pull/41504">#41504</a></li> <li>fix(streaming): estimate interrupted Anthropic stream usage from reasoning_content by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480753829" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41503" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41503/hovercard" href="https://github.com/BerriAI/litellm/pull/41503">#41503</a></li> <li>fix(azure_ai): route Responses API to native /openai/v1/responses for Foundry Models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4920206662" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/33856" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/33856/hovercard" href="https://github.com/BerriAI/litellm/pull/33856">#33856</a></li> <li>fix(proxy): show all model groups to proxy admins in /model_group/info by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5451965568" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41094" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41094/hovercard" href="https://github.com/BerriAI/litellm/pull/41094">#41094</a></li> <li>feat(proxy): let proxy admins choose which team fields team admins may edit by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5362034501" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39996" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39996/hovercard" href="https://github.com/BerriAI/litellm/pull/39996">#39996</a></li> <li>fix(bedrock): neutralize orphaned tool blocks instead of raising or injecting a dummy tool (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4749194509" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/31400" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/31400/hovercard" href="https://github.com/BerriAI/litellm/pull/31400">#31400</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481099563" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41513" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41513/hovercard" href="https://github.com/BerriAI/litellm/pull/41513">#41513</a></li> <li>feat(ui): persist organizations and projects list, detail tab and key table state in the URL by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5477833887" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41445" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41445/hovercard" href="https://github.com/BerriAI/litellm/pull/41445">#41445</a></li> <li>fix(bedrock_mantle): accept and forward verbosity on gpt-5.x chat completions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480981048" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41509" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41509/hovercard" href="https://github.com/BerriAI/litellm/pull/41509">#41509</a></li> <li>test: cover database transactions and persisted accounting by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5449022303" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41073" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41073/hovercard" href="https://github.com/BerriAI/litellm/pull/41073">#41073</a></li> <li>test: provider wire contracts, streaming and recovery by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5449442763" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41075" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41075/hovercard" href="https://github.com/BerriAI/litellm/pull/41075">#41075</a></li> <li>fix(mcp): count admin static headers as api_key credential slots by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481103203" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41514" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41514/hovercard" href="https://github.com/BerriAI/litellm/pull/41514">#41514</a></li> <li>ci: auto-merge provider-info-sync PRs when CI, Greptile and Bugbot are clean by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480318351" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41494" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41494/hovercard" href="https://github.com/BerriAI/litellm/pull/41494">#41494</a></li> <li>feat(rust): add standalone framing crate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480584082" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41500" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41500/hovercard" href="https://github.com/BerriAI/litellm/pull/41500">#41500</a></li> <li>fix(proxy): enforce tag budgets for tags added by guardrails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5432119000" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40842" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40842/hovercard" href="https://github.com/BerriAI/litellm/pull/40842">#40842</a></li> <li>fix(utils): run post-call deployment hook on converted chat streams by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480321277" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41495" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41495/hovercard" href="https://github.com/BerriAI/litellm/pull/41495">#41495</a></li> <li>fix(e2e): bind provider-cache recordings to the deployment's test, not the serving process by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481285670" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41520" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41520/hovercard" href="https://github.com/BerriAI/litellm/pull/41520">#41520</a></li> <li>test: add extension and browser integration contracts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5449911205" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41078" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41078/hovercard" href="https://github.com/BerriAI/litellm/pull/41078">#41078</a></li> <li>fix(logging): scan each log record once and collapse base64 payloads before the secret regex by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437458675" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40934" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40934/hovercard" href="https://github.com/BerriAI/litellm/pull/40934">#40934</a></li> <li>fix(spend_tracking): attribute router-rejected requests to the model group provider by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480891020" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41507" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41507/hovercard" href="https://github.com/BerriAI/litellm/pull/41507">#41507</a></li> <li>feat(router): discover token limits for hosted OpenAI-compatible models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480933859" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41508" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41508/hovercard" href="https://github.com/BerriAI/litellm/pull/41508">#41508</a></li> <li>feat(proxy): let team admins edit rpm_limit and max_budget when enabled by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481413664" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41525" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41525/hovercard" href="https://github.com/BerriAI/litellm/pull/41525">#41525</a></li> <li>fix(otel): fit per-index OpenInference messages to the span's remaining attribute budget by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480442685" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41498" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41498/hovercard" href="https://github.com/BerriAI/litellm/pull/41498">#41498</a></li> <li>test(aws): verify rotated secret value by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481372033" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41524" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41524/hovercard" href="https://github.com/BerriAI/litellm/pull/41524">#41524</a></li> <li>test(e2e): read a deleted key back as deleted, not as a 404 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482317512" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41551" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41551/hovercard" href="https://github.com/BerriAI/litellm/pull/41551">#41551</a></li> <li>fix(otel v2): map the caller's Langfuse user, session and tags onto the root and generation spans by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455320294" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41140" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41140/hovercard" href="https://github.com/BerriAI/litellm/pull/41140">#41140</a></li> <li>test: fix seven tests left stale by <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467938717" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41311" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41311/hovercard" href="https://github.com/BerriAI/litellm/pull/41311">#41311</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468872284" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41337" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41337/hovercard" href="https://github.com/BerriAI/litellm/pull/41337">#41337</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5362034501" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39996" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39996/hovercard" href="https://github.com/BerriAI/litellm/pull/39996">#39996</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467933698" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41310" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41310/hovercard" href="https://github.com/BerriAI/litellm/pull/41310">#41310</a>, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467163402" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41289" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41289/hovercard" href="https://github.com/BerriAI/litellm/pull/41289">#41289</a> and <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468036206" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41315" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41315/hovercard" href="https://github.com/BerriAI/litellm/pull/41315">#41315</a> by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481464335" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41527" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41527/hovercard" href="https://github.com/BerriAI/litellm/pull/41527">#41527</a></li> <li>test(budgets): cover management null handling by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483014135" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41563" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41563/hovercard" href="https://github.com/BerriAI/litellm/pull/41563">#41563</a></li> <li>test(e2e): drop the auto-router select "opens below" spec by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483460151" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41568" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41568/hovercard" href="https://github.com/BerriAI/litellm/pull/41568">#41568</a></li> <li>fix(guardrails): stream Prompt Security post_call redactions in incremental_diff mode by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482637538" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41558" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41558/hovercard" href="https://github.com/BerriAI/litellm/pull/41558">#41558</a></li> <li>fix(guardrails): give post-call scans the scoped request conversation and tools by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5460461795" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41220" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41220/hovercard" href="https://github.com/BerriAI/litellm/pull/41220">#41220</a></li> <li>feat(openrouter): add stealth/union-alpha to the model cost map by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5484281229" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41576" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41576/hovercard" href="https://github.com/BerriAI/litellm/pull/41576">#41576</a></li> <li>test(management): cover project authorization lifecycle by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483670067" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41573" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41573/hovercard" href="https://github.com/BerriAI/litellm/pull/41573">#41573</a></li> <li>feat(rust): map Anthropic Messages transformations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481604060" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41531" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41531/hovercard" href="https://github.com/BerriAI/litellm/pull/41531">#41531</a></li> <li>fix(e2e): clear the three standing errors in the scheduled Buildkite suite by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5490501757" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41616" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41616/hovercard" href="https://github.com/BerriAI/litellm/pull/41616">#41616</a></li> <li>refactor(rust_bridge): declarative route catalog and shared runtime selection by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478892663" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41479" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41479/hovercard" href="https://github.com/BerriAI/litellm/pull/41479">#41479</a></li> <li>fix(mock_completion): keep the resolved provider so router custom pricing resolves for azure_ai deployments by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5490860335" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41623" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41623/hovercard" href="https://github.com/BerriAI/litellm/pull/41623">#41623</a></li> <li>fix(mcp): restrict health discovery to virtual key grants by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5490140133" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41609" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41609/hovercard" href="https://github.com/BerriAI/litellm/pull/41609">#41609</a></li> <li>fix(mcp): preserve request-selected guardrails during tool execution by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5490606733" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41619" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41619/hovercard" href="https://github.com/BerriAI/litellm/pull/41619">#41619</a></li> <li>refactor(ocr): mirror Python provider layout and preserve tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yujonglee-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yujonglee-berri">@yujonglee-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482215516" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41550" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41550/hovercard" href="https://github.com/BerriAI/litellm/pull/41550">#41550</a></li> <li>test(fireworks_ai): stop pinning vision support on minimax-m3 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5491521443" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41627" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41627/hovercard" href="https://github.com/BerriAI/litellm/pull/41627">#41627</a></li> <li>perf(spend_tracking): index LiteLLM_SpendLogs by (api_key, startTime) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/etiennechabert/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/etiennechabert">@etiennechabert</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224469164" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/37983" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/37983/hovercard" href="https://github.com/BerriAI/litellm/pull/37983">#37983</a></li> <li>fix(proxy): reject non-string model with 400 and log its spend as unknown-model by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5491910221" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41633" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41633/hovercard" href="https://github.com/BerriAI/litellm/pull/41633">#41633</a></li> <li>test(together_ai): stop pinning successor deprecation status by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5491929735" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41635" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41635/hovercard" href="https://github.com/BerriAI/litellm/pull/41635">#41635</a></li> <li>chore(prices): sync Together AI prices: 6 models, 6 deprecated [sync failed: Google Gemini] by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483583799" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41570" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41570/hovercard" href="https://github.com/BerriAI/litellm/pull/41570">#41570</a></li> <li>fix(budgets): page end-user cache invalidation after a budget reset by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480004731" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41488" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41488/hovercard" href="https://github.com/BerriAI/litellm/pull/41488">#41488</a></li> <li>chore: bump litellm-proxy-extras 0.4.98 -> 0.4.99 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492207432" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41659" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41659/hovercard" href="https://github.com/BerriAI/litellm/pull/41659">#41659</a></li> <li>fix(tests): resolve the integration support package without run.py's PYTHONPATH by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5470121567" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41373" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41373/hovercard" href="https://github.com/BerriAI/litellm/pull/41373">#41373</a></li> <li>fix(ui): keep untimed guardrail entries on the request lifecycle by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5470332208" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41374" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41374/hovercard" href="https://github.com/BerriAI/litellm/pull/41374">#41374</a></li> <li>fix(anthropic-bridge): convert mid-conversation system turns to user turns on /v1/messages to chat completions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480302799" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41493" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41493/hovercard" href="https://github.com/BerriAI/litellm/pull/41493">#41493</a></li> <li>fix(bedrock): support aws-sdk-bedrock-runtime 0.10/0.11 in Bedrock Realtime by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481921694" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41542" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41542/hovercard" href="https://github.com/BerriAI/litellm/pull/41542">#41542</a></li> <li>feat(cli): deprecate the litellm-proxy entrypoint in favour of lite by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492741827" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41673" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41673/hovercard" href="https://github.com/BerriAI/litellm/pull/41673">#41673</a></li> <li>fix(scim): align pagination <code>count</code> validation with RFC 7644 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zachbernstein-sdx/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zachbernstein-sdx">@zachbernstein-sdx</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5477793235" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41444" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41444/hovercard" href="https://github.com/BerriAI/litellm/pull/41444">#41444</a></li> <li>fix(bedrock): never emit Converse cachePoint for OpenAI-family models by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5475116510" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41419" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41419/hovercard" href="https://github.com/BerriAI/litellm/pull/41419">#41419</a></li> <li>fix(images): stop forwarding the raw image[] and mask[] form keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5333831602" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39512" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39512/hovercard" href="https://github.com/BerriAI/litellm/pull/39512">#39512</a></li> <li>feat(management_v1): bulk update team member budgets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5491863341" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41632" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41632/hovercard" href="https://github.com/BerriAI/litellm/pull/41632">#41632</a></li> <li>refactor(rust): extract provider translations by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493460453" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41690" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41690/hovercard" href="https://github.com/BerriAI/litellm/pull/41690">#41690</a></li> <li>feat(cli): rename lite autoroute up/down to start/stop, keeping the old names as deprecated aliases by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492717533" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41672" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41672/hovercard" href="https://github.com/BerriAI/litellm/pull/41672">#41672</a></li> <li>fix(responses): keep the addressed response id off bridged provider requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493395154" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41689" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41689/hovercard" href="https://github.com/BerriAI/litellm/pull/41689">#41689</a></li> <li>fix(license): let a wildcard allowed_features license grant the auto_router feature by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493209084" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41684" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41684/hovercard" href="https://github.com/BerriAI/litellm/pull/41684">#41684</a></li> <li>fix(ui): list every provider in the cache leakage by-model table by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5435213975" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40875" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40875/hovercard" href="https://github.com/BerriAI/litellm/pull/40875">#40875</a></li> <li>fix(team): keep a forked member budget's reset window and audit bulk member budget writes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493345330" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41686" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41686/hovercard" href="https://github.com/BerriAI/litellm/pull/41686">#41686</a></li> <li>feat(proxy): add TypeSafe AI Jev evaluate passthrough with registry-priced spend tracking by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5489749144" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41607" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41607/hovercard" href="https://github.com/BerriAI/litellm/pull/41607">#41607</a></li> <li>test(e2e): cover bedrock batch file upload and create in the us-gov-west-1 partition by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481750049" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41536" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41536/hovercard" href="https://github.com/BerriAI/litellm/pull/41536">#41536</a></li> <li>feat(grafana): add all-metrics dashboard and fix stale dashboard_v2 gauges by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5484711648" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41578" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41578/hovercard" href="https://github.com/BerriAI/litellm/pull/41578">#41578</a></li> <li>fix(cost): price Azure PTU spillover requests at standard token rates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483578595" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41569" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41569/hovercard" href="https://github.com/BerriAI/litellm/pull/41569">#41569</a></li> <li>build(deps): bump soupsieve to 2.9.2 to clear the osv-scan advisories by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493886297" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41703" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41703/hovercard" href="https://github.com/BerriAI/litellm/pull/41703">#41703</a></li> <li>fix(fireworks_ai): restore supports_vision on minimax-m3 in the cost map by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493795163" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41699" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41699/hovercard" href="https://github.com/BerriAI/litellm/pull/41699">#41699</a></li> <li>feat(policy_engine): explicit priority for policy attachment execution order by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483584095" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41571" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41571/hovercard" href="https://github.com/BerriAI/litellm/pull/41571">#41571</a></li> <li>feat(router): add TypeSafe Jev as a complexity router classifier by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5490464486" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41615" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41615/hovercard" href="https://github.com/BerriAI/litellm/pull/41615">#41615</a></li> <li>ci(auto-merge): stop requiring Greptile and Bugbot on price sync pull requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492914365" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41678" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41678/hovercard" href="https://github.com/BerriAI/litellm/pull/41678">#41678</a></li> <li>fix(ui): persist disabling cache control injection points on model update by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5418386511" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40632" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40632/hovercard" href="https://github.com/BerriAI/litellm/pull/40632">#40632</a></li> <li>fix(bedrock): gate Invoke tool search on the model map for Opus 4.8 and gen 5 Claude by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493844651" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41702" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41702/hovercard" href="https://github.com/BerriAI/litellm/pull/41702">#41702</a></li> <li>fix(proxy): propagate db model renames to key, team, org, project and user model allowlists by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493667109" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41694" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41694/hovercard" href="https://github.com/BerriAI/litellm/pull/41694">#41694</a></li> <li>test: delete unit-test assertions that pin cost-map prices, limits and deprecation dates by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5477777876" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41443" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41443/hovercard" href="https://github.com/BerriAI/litellm/pull/41443">#41443</a></li> <li>chore(tests): remove commented-out hf, petals and vertex ai completion blocks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492149244" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41640" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41640/hovercard" href="https://github.com/BerriAI/litellm/pull/41640">#41640</a></li> <li>chore(openai): drop commented-out legacy cost_per_token implementation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492151030" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41641" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41641/hovercard" href="https://github.com/BerriAI/litellm/pull/41641">#41641</a></li> <li>chore(proxy): delete deprecated unused litellm/proxy/_logging.py by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492154076" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41642" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41642/hovercard" href="https://github.com/BerriAI/litellm/pull/41642">#41642</a></li> <li>chore(proxy): remove unreferenced performance_utils profiling module by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492154515" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41643" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41643/hovercard" href="https://github.com/BerriAI/litellm/pull/41643">#41643</a></li> <li>test(streaming): remove commented-out retired-provider streaming tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492166062" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41648" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41648/hovercard" href="https://github.com/BerriAI/litellm/pull/41648">#41648</a></li> <li>refactor(langfuse): remove unreachable langfuse v1 logging path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492171057" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41652" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41652/hovercard" href="https://github.com/BerriAI/litellm/pull/41652">#41652</a></li> <li>test: remove 15 fully commented-out test files that collect no tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492187147" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41654" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41654/hovercard" href="https://github.com/BerriAI/litellm/pull/41654">#41654</a></li> <li>chore(tests): remove fully commented-out proxy test files and their CI entries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492209628" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41660" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41660/hovercard" href="https://github.com/BerriAI/litellm/pull/41660">#41660</a></li> <li>refactor(prometheus): remove unreferenced metric validators and pretty printers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492210780" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41661" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41661/hovercard" href="https://github.com/BerriAI/litellm/pull/41661">#41661</a></li> <li>chore(streaming): remove retired ai21/maritalk/baseten/azure raw-bytes handlers and dead palm completion code by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492234142" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41662" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41662/hovercard" href="https://github.com/BerriAI/litellm/pull/41662">#41662</a></li> <li>refactor(vertex_ai): remove constant-False is_using_v1beta1_features stub and its dead call sites by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492304488" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41665" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41665/hovercard" href="https://github.com/BerriAI/litellm/pull/41665">#41665</a></li> <li>fix(passthrough): keep target URL query when client sends no query params by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5477922540" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41448" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41448/hovercard" href="https://github.com/BerriAI/litellm/pull/41448">#41448</a></li> <li>fix(responses): drop top_p for gpt-5 reasoning models when drop_params is set by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5478538940" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41469" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41469/hovercard" href="https://github.com/BerriAI/litellm/pull/41469">#41469</a></li> <li>fix(ocr): keep a downloaded document inlined when callbacks intercept the request (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482215516" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41550" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41550/hovercard" href="https://github.com/BerriAI/litellm/pull/41550">#41550</a> follow-up) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494267314" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41719" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41719/hovercard" href="https://github.com/BerriAI/litellm/pull/41719">#41719</a></li> <li>fix(models): rolling registry audit: Azure retirement dates, Bedrock Mantle Grok 4.3 context window by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5488095771" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41597" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41597/hovercard" href="https://github.com/BerriAI/litellm/pull/41597">#41597</a></li> <li>test(logging): add azure_spillover to the GCS pub/sub spend-log golden by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494556046" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41729" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41729/hovercard" href="https://github.com/BerriAI/litellm/pull/41729">#41729</a></li> <li>fix(proxy): forward every method on the typesafe pass-through route by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494391694" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41723" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41723/hovercard" href="https://github.com/BerriAI/litellm/pull/41723">#41723</a></li> <li>test(cost_map): stop pinning supports_reasoning absent on the openrouter o1 entry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494807810" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41734" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41734/hovercard" href="https://github.com/BerriAI/litellm/pull/41734">#41734</a></li> <li>fix(model_prices): add cache-read pricing to Mistral chat models missing it by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494846020" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41736" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41736/hovercard" href="https://github.com/BerriAI/litellm/pull/41736">#41736</a></li> <li>refactor(rust): isolate legacy callback contract by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5495591708" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41752" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41752/hovercard" href="https://github.com/BerriAI/litellm/pull/41752">#41752</a></li> <li>test(cost_map): drop tests that pin provider-owned catalog values by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5495810236" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41763" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41763/hovercard" href="https://github.com/BerriAI/litellm/pull/41763">#41763</a></li> <li>test(e2e/ui): wait for the filtered budget list before clicking a row action by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5495726967" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41756" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41756/hovercard" href="https://github.com/BerriAI/litellm/pull/41756">#41756</a></li> <li>chore(prices): sync OpenRouter prices: 443 models, 191 new, 4 deprecated by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494526901" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41727" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41727/hovercard" href="https://github.com/BerriAI/litellm/pull/41727">#41727</a></li> <li>fix(batches): bill Bedrock Titan embedding batch lines from inputTextTokenCount by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5496009599" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41767" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41767/hovercard" href="https://github.com/BerriAI/litellm/pull/41767">#41767</a></li> <li>fix(proxy): persist only the keys a caller changed in save_config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5495343889" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41748" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41748/hovercard" href="https://github.com/BerriAI/litellm/pull/41748">#41748</a></li> <li>chore(prices): sync OpenRouter prices: 2 models, 1 deprecated by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5496215546" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41770" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41770/hovercard" href="https://github.com/BerriAI/litellm/pull/41770">#41770</a></li> <li>fix(proxy): run prompt injection heuristics off the event loop by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481914825" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41541" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41541/hovercard" href="https://github.com/BerriAI/litellm/pull/41541">#41541</a></li> <li>fix(proxy): evict jwt key mapping cache on user, team, org, and bulk key deletion by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494071562" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41707" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41707/hovercard" href="https://github.com/BerriAI/litellm/pull/41707">#41707</a></li> <li>refactor(ui): remove unused HelpLink and HelpIcon components by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492158434" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41644" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41644/hovercard" href="https://github.com/BerriAI/litellm/pull/41644">#41644</a></li> <li>chore(ui): remove orphaned ROLE_STYLES and RoleStyle from pretty messages view by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492158804" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41645" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41645/hovercard" href="https://github.com/BerriAI/litellm/pull/41645">#41645</a></li> <li>chore(ui): remove never-rendered GuardrailConfig mock component and its test by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492161304" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41646" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41646/hovercard" href="https://github.com/BerriAI/litellm/pull/41646">#41646</a></li> <li>chore(ui): remove unused NewBadge component and its test by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492161481" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41647" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41647/hovercard" href="https://github.com/BerriAI/litellm/pull/41647">#41647</a></li> <li>chore(ui): remove dead compareUI ModelSelector and its test by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492166106" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41649" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41649/hovercard" href="https://github.com/BerriAI/litellm/pull/41649">#41649</a></li> <li>refactor(ui): remove unused createCredentialFromModel helper and CredentialValues interface by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492168014" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41650" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41650/hovercard" href="https://github.com/BerriAI/litellm/pull/41650">#41650</a></li> <li>refactor(ui): drop unused cost-tracking barrel re-exports and response types by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492170623" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41651" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41651/hovercard" href="https://github.com/BerriAI/litellm/pull/41651">#41651</a></li> <li>refactor(ui): drop unused rolesAllowedToSeeUsage, viewOnlyRoles and isViewOnlyRole exports by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492183482" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41653" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41653/hovercard" href="https://github.com/BerriAI/litellm/pull/41653">#41653</a></li> <li>chore(ui): remove unused access-groups type interfaces by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492193256" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41655" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41655/hovercard" href="https://github.com/BerriAI/litellm/pull/41655">#41655</a></li> <li>refactor(ui): remove dead networking exports and orphaned Claude Code marketplace helpers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492196515" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41656" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41656/hovercard" href="https://github.com/BerriAI/litellm/pull/41656">#41656</a></li> <li>refactor(ui): remove dead useKeyList hook from key_list.tsx by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492199499" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41657" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41657/hovercard" href="https://github.com/BerriAI/litellm/pull/41657">#41657</a></li> <li>chore(ui): remove orphaned useDeleteProject hook and its test by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492203796" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41658" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41658/hovercard" href="https://github.com/BerriAI/litellm/pull/41658">#41658</a></li> <li>refactor(interactions): remove expired use_legacy_interactions_schema shim by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492266084" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41663" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41663/hovercard" href="https://github.com/BerriAI/litellm/pull/41663">#41663</a></li> <li>refactor(rust): align crates with Python package layering by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5501557094" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41829" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41829/hovercard" href="https://github.com/BerriAI/litellm/pull/41829">#41829</a></li> <li>chore(prices): sync OpenRouter prices: 15 models, 6 deprecated by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5496441681" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41772" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41772/hovercard" href="https://github.com/BerriAI/litellm/pull/41772">#41772</a></li> <li>refactor(proxy): make the config file win over the database by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5496720415" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41779" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41779/hovercard" href="https://github.com/BerriAI/litellm/pull/41779">#41779</a></li> <li>fix(ui): let admins change a model's team from the model edit page by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5422366532" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40700" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40700/hovercard" href="https://github.com/BerriAI/litellm/pull/40700">#40700</a></li> <li>fix(ui): show per-second pricing for video models instead of $0.00 token costs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5323489729" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39308" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39308/hovercard" href="https://github.com/BerriAI/litellm/pull/39308">#39308</a></li> <li>fix(cost): bill cache-read tokens at the input rate when the map has no cache-read rate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5501954176" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41832" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41832/hovercard" href="https://github.com/BerriAI/litellm/pull/41832">#41832</a></li> <li>fix(responses): honor nested additional_drop_params paths by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5425448642" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40730" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40730/hovercard" href="https://github.com/BerriAI/litellm/pull/40730">#40730</a></li> <li>feat(router): reject with 429 when a deployment's max_parallel_requests slots are all in use by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482513036" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41555" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41555/hovercard" href="https://github.com/BerriAI/litellm/pull/41555">#41555</a></li> <li>perf: defer fastapi and tiktoken BPE imports out of import litellm by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5485242473" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41585" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41585/hovercard" href="https://github.com/BerriAI/litellm/pull/41585">#41585</a></li> <li>feat(proxy): add Amazon Transcribe pass-through with completion-time job pricing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481210659" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41515" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41515/hovercard" href="https://github.com/BerriAI/litellm/pull/41515">#41515</a></li> <li>feat(proxy): per-key default budget for dynamically created customers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5491967163" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41636" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41636/hovercard" href="https://github.com/BerriAI/litellm/pull/41636">#41636</a></li> <li>feat(mcp): show live gateway sessions by AI client and user by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493502051" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41692" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41692/hovercard" href="https://github.com/BerriAI/litellm/pull/41692">#41692</a></li> <li>ci: replace the title-similarity duplicate bot with a Codex semantic check by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5437564657" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40935" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40935/hovercard" href="https://github.com/BerriAI/litellm/pull/40935">#40935</a></li> <li>feat(proxy): temporary budget increase for team members by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5490717856" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41620" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41620/hovercard" href="https://github.com/BerriAI/litellm/pull/41620">#41620</a></li> <li>feat(vault): add separate login and secret namespaces for HashiCorp Vault by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481845295" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41539" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41539/hovercard" href="https://github.com/BerriAI/litellm/pull/41539">#41539</a></li> <li>feat(vertex_ai): stream GCS batch output files from /v1/files/{id}/content by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5480823598" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41506" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41506/hovercard" href="https://github.com/BerriAI/litellm/pull/41506">#41506</a></li> <li>feat(a2a): reach Microsoft Foundry agents with Entra auth and versioned card discovery by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5481047234" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41511" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41511/hovercard" href="https://github.com/BerriAI/litellm/pull/41511">#41511</a></li> <li>fix(azure): strip litellm format field from file and image content parts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5466064516" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41275" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41275/hovercard" href="https://github.com/BerriAI/litellm/pull/41275">#41275</a></li> <li>ci: classify new issues into domain, provider, kind, priority and lift labels by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493681044" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41695" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41695/hovercard" href="https://github.com/BerriAI/litellm/pull/41695">#41695</a></li> <li>fix(router): validate routing_groups at save time and keep invalid DB groups from blocking SSO load by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469208707" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41351" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41351/hovercard" href="https://github.com/BerriAI/litellm/pull/41351">#41351</a></li> <li>fix(bedrock): send aws_session_tags on every STS call via one typed auth struct by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5406467249" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40500" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40500/hovercard" href="https://github.com/BerriAI/litellm/pull/40500">#40500</a></li> <li>fix(anthropic): register thinking-binding-controls-2026-08-01 in beta headers config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/clonylu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/clonylu">@clonylu</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5458866804" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41203" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41203/hovercard" href="https://github.com/BerriAI/litellm/pull/41203">#41203</a></li> <li>feat(guardrails): add TypeSafe Jev relevance-based compaction guardrail by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5495749351" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41757" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41757/hovercard" href="https://github.com/BerriAI/litellm/pull/41757">#41757</a></li> <li>feat(keys): let team service account keys use key management endpoints for their own team by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5429947869" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40807" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40807/hovercard" href="https://github.com/BerriAI/litellm/pull/40807">#40807</a></li> <li>test(docs): read only the first column of the router_settings reference table by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5503707856" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41860" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41860/hovercard" href="https://github.com/BerriAI/litellm/pull/41860">#41860</a></li> <li>fix(scim): accept entitlements and roles entries without a value on SCIM user PUT by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5501595181" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41830" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41830/hovercard" href="https://github.com/BerriAI/litellm/pull/41830">#41830</a></li> <li>perf(proxy): split aggregated usage query into key-free rollups and bounded top-N keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5467525754" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41293" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41293/hovercard" href="https://github.com/BerriAI/litellm/pull/41293">#41293</a></li> <li>chore(deps): bump anyio from 4.13.0 to 4.14.2 by <a class="user-mention notranslate" data-hovercard-type="organization" data-hovercard-url="/orgs/dependabot/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dependabot">@dependabot</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5503025559" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41846" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41846/hovercard" href="https://github.com/BerriAI/litellm/pull/41846">#41846</a></li> <li>feat(proxy): limit repeated failed Admin UI sign-in attempts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5439050063" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40982" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40982/hovercard" href="https://github.com/BerriAI/litellm/pull/40982">#40982</a></li> <li>fix(proxy): make SettingsStore.clear() terminate when the config file owns a key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5503786424" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41862" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41862/hovercard" href="https://github.com/BerriAI/litellm/pull/41862">#41862</a></li> <li>feat(vscode): add LiteLLM language model provider extension by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5503909610" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41865" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41865/hovercard" href="https://github.com/BerriAI/litellm/pull/41865">#41865</a></li> <li>feat(mcp): let proxy admins force-close live MCP sessions and revoke stored user credentials by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494444000" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41725" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41725/hovercard" href="https://github.com/BerriAI/litellm/pull/41725">#41725</a></li> <li>feat(models): add qwen3.8 flash rows, fix Cohere embed v3 context, Bedrock Mantle and OpenRouter pricing by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5495655559" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41754" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41754/hovercard" href="https://github.com/BerriAI/litellm/pull/41754">#41754</a></li> <li>fix(azure): keep api-version query after vector store search path by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5471472497" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41384" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41384/hovercard" href="https://github.com/BerriAI/litellm/pull/41384">#41384</a></li> <li>fix(router): honor stream_timeout on the SDK-native passthrough route (/v1/messages, /converse) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504348405" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41875" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41875/hovercard" href="https://github.com/BerriAI/litellm/pull/41875">#41875</a></li> <li>fix(proxy): track team member spend when the member has no budget by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469136857" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41349" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41349/hovercard" href="https://github.com/BerriAI/litellm/pull/41349">#41349</a></li> <li>feat(proxy): add Azure AI Speech pass-through route by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482589414" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41557" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41557/hovercard" href="https://github.com/BerriAI/litellm/pull/41557">#41557</a></li> <li>fix(responses): stop managed Responses WebSocket from leaking litellm_params into provider request body by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4876202261" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/33101" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/33101/hovercard" href="https://github.com/BerriAI/litellm/pull/33101">#33101</a></li> <li>feat(rust): port exception_type to litellm-core-utils by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504309579" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41873" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41873/hovercard" href="https://github.com/BerriAI/litellm/pull/41873">#41873</a></li> <li>fix(ui): show internal user email in logs table and log detail drawer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5426074361" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40737" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40737/hovercard" href="https://github.com/BerriAI/litellm/pull/40737">#40737</a></li> <li>fix(router): report null cost for unpriced deployments instead of 0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5435433016" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40878" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40878/hovercard" href="https://github.com/BerriAI/litellm/pull/40878">#40878</a></li> <li>feat(azure_ai): support FLUX.2 flex images by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/emerzon/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/emerzon">@emerzon</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5330117042" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39424" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39424/hovercard" href="https://github.com/BerriAI/litellm/pull/39424">#39424</a></li> <li>fix(mistral): accept reasoning_effort on all models and drop client_metadata for Codex compatibility by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5447835729" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41062" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41062/hovercard" href="https://github.com/BerriAI/litellm/pull/41062">#41062</a></li> <li>feat(passthrough): deepgram streaming /v1/listen WebSocket passthrough with duration-based cost tracking by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5482478094" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41554" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41554/hovercard" href="https://github.com/BerriAI/litellm/pull/41554">#41554</a></li> <li>test(ocr): declarative provider x auth x input matrix, fix Rust 401 mapping by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504989163" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41884" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41884/hovercard" href="https://github.com/BerriAI/litellm/pull/41884">#41884</a></li> <li>fix(proxy): classify Azure Speech short audio behind a prefixed api base by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504927794" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41882" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41882/hovercard" href="https://github.com/BerriAI/litellm/pull/41882">#41882</a></li> <li>feat(proxy): add LiteLLM_DailyGlobalSpend key-free rollup for the usage dashboard by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468307828" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41324" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41324/hovercard" href="https://github.com/BerriAI/litellm/pull/41324">#41324</a></li> <li>fix(proxy): keep requested model guardrails and key disable_fallbacks on rate-limit fallback by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5497153626" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41783" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41783/hovercard" href="https://github.com/BerriAI/litellm/pull/41783">#41783</a></li> <li>fix(bedrock): carry s3_endpoint_url and s3_region_name into file content downloads by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5455250579" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41138" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41138/hovercard" href="https://github.com/BerriAI/litellm/pull/41138">#41138</a></li> <li>ci(duplicate-check): let Codex reach GitHub from its sandbox by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504967000" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41883" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41883/hovercard" href="https://github.com/BerriAI/litellm/pull/41883">#41883</a></li> <li>fix(proxy): resolve model_group_alias to its target for /v1/models metadata by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5479317585" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41483" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41483/hovercard" href="https://github.com/BerriAI/litellm/pull/41483">#41483</a></li> <li>fix(proxy): reset sibling tpm/rpm counters when the shared rate limit window rolls over by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5502491077" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41838" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41838/hovercard" href="https://github.com/BerriAI/litellm/pull/41838">#41838</a></li> <li>feat(ui): link MCP Servers page to the user's connected MCP servers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505313903" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41888" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41888/hovercard" href="https://github.com/BerriAI/litellm/pull/41888">#41888</a></li> <li>fix(proxy): name the blocking guardrail in x-litellm-applied-guardrails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5485064651" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41583" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41583/hovercard" href="https://github.com/BerriAI/litellm/pull/41583">#41583</a></li> <li>fix(responses): merge deployment litellm_params into native websocket response.create frames by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504875447" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41881" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41881/hovercard" href="https://github.com/BerriAI/litellm/pull/41881">#41881</a></li> <li>feat: honor eager_input_streaming on Bedrock and Anthropic Claude tools by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504259855" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41871" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41871/hovercard" href="https://github.com/BerriAI/litellm/pull/41871">#41871</a></li> <li>fix(otel): keep caller traceparent and tracestate on pass-through relays by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5497434591" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41786" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41786/hovercard" href="https://github.com/BerriAI/litellm/pull/41786">#41786</a></li> <li>ci: remove the dead Agent Shin triage workflows and scripts by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505797852" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41894" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41894/hovercard" href="https://github.com/BerriAI/litellm/pull/41894">#41894</a></li> <li>fix: set vertex gemma-4-26b-a4b-it-maas context window to 262144 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505280316" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41887" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41887/hovercard" href="https://github.com/BerriAI/litellm/pull/41887">#41887</a></li> <li>refactor(rust): formalize legacy callback contract by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505210339" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41885" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41885/hovercard" href="https://github.com/BerriAI/litellm/pull/41885">#41885</a></li> <li>fix(gemini): preserve candidates with finishReason and no content (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5405294515" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40477" data-hovercard-type="issue" data-hovercard-url="/BerriAI/litellm/issues/40477/hovercard" href="https://github.com/BerriAI/litellm/issues/40477">#40477</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505632879" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41892" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41892/hovercard" href="https://github.com/BerriAI/litellm/pull/41892">#41892</a></li> <li>fix(team): apply team_member_budget updates to members still on the team default by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469113814" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41347" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41347/hovercard" href="https://github.com/BerriAI/litellm/pull/41347">#41347</a></li> <li>fix(enterprise): resolve openai_moderations model at call time and default to omni-moderation-latest by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505943035" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41895" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41895/hovercard" href="https://github.com/BerriAI/litellm/pull/41895">#41895</a></li> <li>fix(proxy): track project spend and enforce project budgets additively by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5469334328" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41354" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41354/hovercard" href="https://github.com/BerriAI/litellm/pull/41354">#41354</a></li> <li>fix(proxy): refuse config-owned keys on POST /config/update by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504041225" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41868" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41868/hovercard" href="https://github.com/BerriAI/litellm/pull/41868">#41868</a></li> <li>test(integration): cover off-peak pricing on a live proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506308341" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41901" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41901/hovercard" href="https://github.com/BerriAI/litellm/pull/41901">#41901</a></li> <li>fix(proxy): requeue daily spend rows when the commit fails without the Redis buffer by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504643790" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41878" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41878/hovercard" href="https://github.com/BerriAI/litellm/pull/41878">#41878</a></li> <li>fix(responses): emit typed streaming failure events by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zoroyihan7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zoroyihan7">@zoroyihan7</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5386091715" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40243" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40243/hovercard" href="https://github.com/BerriAI/litellm/pull/40243">#40243</a></li> <li>fix(bedrock): clamp maxTokens to the 16-token minimum for OpenAI GPT and xAI Grok models on Converse by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5504214317" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41870" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41870/hovercard" href="https://github.com/BerriAI/litellm/pull/41870">#41870</a></li> <li>chore(model_info): backfill reseller Gemini entries from provider catalogs and prune retired ids by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506339849" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41902" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41902/hovercard" href="https://github.com/BerriAI/litellm/pull/41902">#41902</a></li> <li>feat(mcp): allowlist MCP client applications at the gateway by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492402288" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41667" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41667/hovercard" href="https://github.com/BerriAI/litellm/pull/41667">#41667</a></li> <li>fix(schema): classify off_peak_pricing as a structured object in the model prices schema generator by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5503060311" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41847" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41847/hovercard" href="https://github.com/BerriAI/litellm/pull/41847">#41847</a></li> <li>fix(rate_limiter): render the 429 reset time in UTC as labelled by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506532562" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41911" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41911/hovercard" href="https://github.com/BerriAI/litellm/pull/41911">#41911</a></li> <li>ci(issues): comment which release carries the fix when a pull request closes an issue by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506526414" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41910" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41910/hovercard" href="https://github.com/BerriAI/litellm/pull/41910">#41910</a></li> <li>feat(proxy): let team admins manage projects via team_admin_editable_team_fields by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506680938" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41916" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41916/hovercard" href="https://github.com/BerriAI/litellm/pull/41916">#41916</a></li> <li>fix(bedrock): sign batch retrieve and cancel with deployment credentials when AWS_BEARER_TOKEN_BEDROCK is set by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506365290" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41904" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41904/hovercard" href="https://github.com/BerriAI/litellm/pull/41904">#41904</a></li> <li>fix(websearch_interception): surface a failed search as a web_search_tool_result_error block and end the turn by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506416509" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41905" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41905/hovercard" href="https://github.com/BerriAI/litellm/pull/41905">#41905</a></li> <li>fix(cost_calc): default fireworks cached input to the documented 50% discount when the map has no cache-read rate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506707115" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41917" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41917/hovercard" href="https://github.com/BerriAI/litellm/pull/41917">#41917</a></li> <li>fix(timing): anchor response duration and overhead at proxy receive time by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505401664" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41891" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41891/hovercard" href="https://github.com/BerriAI/litellm/pull/41891">#41891</a></li> <li>feat(xai): add speech-to-text (Grok Voice Transcribe) via /v1/audio/transcriptions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506629848" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41914" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41914/hovercard" href="https://github.com/BerriAI/litellm/pull/41914">#41914</a></li> <li>feat(rust): add litellm-http client pool and inject it into the OCR route by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506022544" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41897" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41897/hovercard" href="https://github.com/BerriAI/litellm/pull/41897">#41897</a></li> <li>feat(vertex_ai): stream Chirp speech-to-text over /v1/realtime by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494322666" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41721" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41721/hovercard" href="https://github.com/BerriAI/litellm/pull/41721">#41721</a></li> <li>chore: consolidate CLAUDE.md into AGENTS.md by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5507182358" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41921" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41921/hovercard" href="https://github.com/BerriAI/litellm/pull/41921">#41921</a></li> <li>feat(proxy): serve the Claude Code gateway protocol under /claude_code_gateway by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4951988915" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/34267" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/34267/hovercard" href="https://github.com/BerriAI/litellm/pull/34267">#34267</a></li> <li>fix(responses): restore encrypted_content and apply affinity on the native WebSocket relay by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5505669330" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41893" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41893/hovercard" href="https://github.com/BerriAI/litellm/pull/41893">#41893</a></li> <li>feat(proxy): add RFC 8693 token exchange for IdP JWTs on the gateway token endpoint by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5479542793" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41485" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41485/hovercard" href="https://github.com/BerriAI/litellm/pull/41485">#41485</a></li> <li>fix(websearch): forward the deployment api_base to agentic follow-up calls on /v1/messages by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506799477" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41918" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41918/hovercard" href="https://github.com/BerriAI/litellm/pull/41918">#41918</a></li> <li>fix(proxy): parse role_permissions where it is read by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5507624694" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41924" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41924/hovercard" href="https://github.com/BerriAI/litellm/pull/41924">#41924</a></li> <li>fix(responses): announce message item before text events in the chat completions bridge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5483027333" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41564" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41564/hovercard" href="https://github.com/BerriAI/litellm/pull/41564">#41564</a></li> <li>fix(proxy): unpin cost-map pricing copied into model_info and report pricing overrides by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5502829989" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41843" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41843/hovercard" href="https://github.com/BerriAI/litellm/pull/41843">#41843</a></li> <li>feat(websearch): let the model emit objective + multi-query search shapes by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/adssoccer1/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/adssoccer1">@adssoccer1</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5399331127" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40399" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40399/hovercard" href="https://github.com/BerriAI/litellm/pull/40399">#40399</a></li> <li>fix(exceptions): keep internal_server_error as the public type of an upstream 500 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508056820" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41930" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41930/hovercard" href="https://github.com/BerriAI/litellm/pull/41930">#41930</a></li> <li>fix(proxy): dispatch llm_api_check moderation through during_call_hook by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5493214990" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41685" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41685/hovercard" href="https://github.com/BerriAI/litellm/pull/41685">#41685</a></li> <li>fix(policy_engine): deliver guardrail text rewrites on multi-choice, unfinished, and envelope-less streams by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508180915" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41933" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41933/hovercard" href="https://github.com/BerriAI/litellm/pull/41933">#41933</a></li> <li>fix(anthropic): keep cache_control for Gemini targets on /v1/messages and normalize Anthropic ttl units by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508589350" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41938" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41938/hovercard" href="https://github.com/BerriAI/litellm/pull/41938">#41938</a></li> <li>fix(guardrails): stop the Javelin api_version default leaking into Azure Content Safety by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508889824" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41941" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41941/hovercard" href="https://github.com/BerriAI/litellm/pull/41941">#41941</a></li> <li>fix(alerting): clarify budget threshold messages by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gaurav-pandey-zocdoc/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gaurav-pandey-zocdoc">@gaurav-pandey-zocdoc</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5310987863" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39102" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39102/hovercard" href="https://github.com/BerriAI/litellm/pull/39102">#39102</a></li> <li>fix(cost): carry image and video input tokens through the Responses usage bridge (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5148461611" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36887" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36887/hovercard" href="https://github.com/BerriAI/litellm/pull/36887">#36887</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5462580656" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41237" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41237/hovercard" href="https://github.com/BerriAI/litellm/pull/41237">#41237</a></li> <li>ci(unit): fail a hung test in 120s with a traceback instead of idling the shard to its step timeout by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509219510" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41948" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41948/hovercard" href="https://github.com/BerriAI/litellm/pull/41948">#41948</a></li> <li>refactor(types): replace Any with proven types in 6 files by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509183600" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41947" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41947/hovercard" href="https://github.com/BerriAI/litellm/pull/41947">#41947</a></li> <li>fix(proxy): register transcribe as a known provider for model grants by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5507764832" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41926" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41926/hovercard" href="https://github.com/BerriAI/litellm/pull/41926">#41926</a></li> <li>feat(batches): support Mistral files/batches and per-page OCR batch cost tracking (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5405565983" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40484" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40484/hovercard" href="https://github.com/BerriAI/litellm/pull/40484">#40484</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508232200" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41934" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41934/hovercard" href="https://github.com/BerriAI/litellm/pull/41934">#41934</a></li> <li>fix(utils): reject an untranslatable tool_choice with a 400 instead of a 500 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5462180200" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41234" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41234/hovercard" href="https://github.com/BerriAI/litellm/pull/41234">#41234</a></li> <li>fix(proxy): keep request metadata out of the cost tracking failure alert by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509378029" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41950" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41950/hovercard" href="https://github.com/BerriAI/litellm/pull/41950">#41950</a></li> <li>fix(masker): memoize shared nodes and fail closed past the depth cap by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509423433" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41952" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41952/hovercard" href="https://github.com/BerriAI/litellm/pull/41952">#41952</a></li> <li>fix(responses): drop tool_search and local_shell in the chat completions bridge by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509592016" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41953" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41953/hovercard" href="https://github.com/BerriAI/litellm/pull/41953">#41953</a></li> <li>fix(rag): resolve registry stores on /v1/rag/ingest and reject providers without ingestion by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508874791" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41940" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41940/hovercard" href="https://github.com/BerriAI/litellm/pull/41940">#41940</a></li> <li>fix(azure): send the resolved Entra ID token on image generation requests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/abhirup7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/abhirup7">@abhirup7</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5378177657" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40147" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40147/hovercard" href="https://github.com/BerriAI/litellm/pull/40147">#40147</a></li> <li>fix(proxy): keep the raw client model out of spend logs for rejections outside the router by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508981092" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41943" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41943/hovercard" href="https://github.com/BerriAI/litellm/pull/41943">#41943</a></li> <li>fix(cost): resolve dated openai/azure snapshots to their undated cost map entry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5475775762" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41423" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41423/hovercard" href="https://github.com/BerriAI/litellm/pull/41423">#41423</a></li> <li>fix(proxy): /key/bulk_update writes only the fields each item carries by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509328404" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41949" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41949/hovercard" href="https://github.com/BerriAI/litellm/pull/41949">#41949</a></li> <li>fix(cost): bill DeepSeek V4.1 Flash and V4 Pro at off-peak rates outside peak hours by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509805287" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41960" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41960/hovercard" href="https://github.com/BerriAI/litellm/pull/41960">#41960</a></li> <li>test(cost): point dated snapshot tests at a date the cost map cannot carry by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5511096690" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41971" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41971/hovercard" href="https://github.com/BerriAI/litellm/pull/41971">#41971</a></li> <li>fix(proxy): refuse runtime writes to config-owned settings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508131638" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41931" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41931/hovercard" href="https://github.com/BerriAI/litellm/pull/41931">#41931</a></li> <li>refactor(rust): centralize layered settings resolution by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5510926507" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41969" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41969/hovercard" href="https://github.com/BerriAI/litellm/pull/41969">#41969</a></li> <li>test(utils): isolate dated model fallback from pricing additions by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5511366099" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41975" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41975/hovercard" href="https://github.com/BerriAI/litellm/pull/41975">#41975</a></li> <li>test(response_metadata): anchor detailed-timing test on a fixed instant instead of wall clock by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5509183443" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41946" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41946/hovercard" href="https://github.com/BerriAI/litellm/pull/41946">#41946</a></li> <li>test(integration): literal request/response cost tracking suite on a test-owned cost map by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5468439990" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41328" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41328/hovercard" href="https://github.com/BerriAI/litellm/pull/41328">#41328</a></li> <li>chore(prices): sync Azure prices: 5 models, 5 deprecated by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5510521527" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41966" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41966/hovercard" href="https://github.com/BerriAI/litellm/pull/41966">#41966</a></li> <li>feat(ocr): add Rust-only Textract and sign provider requests after host hooks by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5511636162" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41977" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41977/hovercard" href="https://github.com/BerriAI/litellm/pull/41977">#41977</a></li> <li>refactor(rust): use typed pyo3 APIs instead of getattr/import strings by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5511895429" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41981" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41981/hovercard" href="https://github.com/BerriAI/litellm/pull/41981">#41981</a></li> <li>fix(router): enforce model tpm limits against shared redis usage across replicas by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506656021" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41915" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41915/hovercard" href="https://github.com/BerriAI/litellm/pull/41915">#41915</a></li> <li>feat(proxy): say when a stored setting is ignored because the config file owns it by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512175062" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41985" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41985/hovercard" href="https://github.com/BerriAI/litellm/pull/41985">#41985</a></li> <li>fix(otel v2): summarize embedding vectors as Langfuse observation output by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5511962028" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41982" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41982/hovercard" href="https://github.com/BerriAI/litellm/pull/41982">#41982</a></li> <li>fix(caching): scope automatic breakpoints to supported Claude transports by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5506931028" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41920" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41920/hovercard" href="https://github.com/BerriAI/litellm/pull/41920">#41920</a></li> <li>fix(proxy): return 400 instead of 500 for /v1/responses without input by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508743604" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41939" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41939/hovercard" href="https://github.com/BerriAI/litellm/pull/41939">#41939</a></li> <li>fix(llmguard): accept proxy async call types by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5497465551" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41787" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41787/hovercard" href="https://github.com/BerriAI/litellm/pull/41787">#41787</a></li> <li>fix(model_prices): drop anthropic deprecation floors and correct azure gpt-4.1-nano retirement date by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5510448479" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41964" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41964/hovercard" href="https://github.com/BerriAI/litellm/pull/41964">#41964</a></li> <li>fix(ui): show user attribution in Top Virtual Keys usage tables by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5425337395" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40729" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40729/hovercard" href="https://github.com/BerriAI/litellm/pull/40729">#40729</a></li> <li>chore(prices): sync OpenRouter prices: 172 models, 2 new by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5502008580" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41833" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41833/hovercard" href="https://github.com/BerriAI/litellm/pull/41833">#41833</a></li> <li>fix(ocr): set DeepSeek OCR sampling defaults by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512670711" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41992" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41992/hovercard" href="https://github.com/BerriAI/litellm/pull/41992">#41992</a></li> <li>ci: remove auto-merge-price-sync workflow, the Devin sync automation merges price PRs by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512682075" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41993" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41993/hovercard" href="https://github.com/BerriAI/litellm/pull/41993">#41993</a></li> <li>refactor(mcp): upgrade SDK2 while preserving legacy gateway behavior by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5494261563" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41718" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41718/hovercard" href="https://github.com/BerriAI/litellm/pull/41718">#41718</a></li> <li>revert(guardrails): drop the scoped request conversation and tools from post-call scans (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5460461795" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41220" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41220/hovercard" href="https://github.com/BerriAI/litellm/pull/41220">#41220</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512441960" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41986" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41986/hovercard" href="https://github.com/BerriAI/litellm/pull/41986">#41986</a></li> <li>chore(prices): sync OpenRouter prices: 2 models by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512841249" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41996" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41996/hovercard" href="https://github.com/BerriAI/litellm/pull/41996">#41996</a></li> <li>test(unified_google_tests): use the Vertex global endpoint and retry 429s with backoff by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512815103" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41995" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41995/hovercard" href="https://github.com/BerriAI/litellm/pull/41995">#41995</a></li> <li>fix(rust): refuse native routes in processes forked after the runtime started by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512474156" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41987" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41987/hovercard" href="https://github.com/BerriAI/litellm/pull/41987">#41987</a></li> <li>fix(terraform): unlink the registry docs entries that 404 on click by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/shivamrawat1/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/shivamrawat1">@shivamrawat1</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512985562" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42003" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42003/hovercard" href="https://github.com/BerriAI/litellm/pull/42003">#42003</a></li> <li>fix(otel v2): map Responses API output onto the Langfuse generation output by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512662677" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41991" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41991/hovercard" href="https://github.com/BerriAI/litellm/pull/41991">#41991</a></li> <li>test(e2e): stop the config suite locking itself out of the shared proxy by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5513150512" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42008" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42008/hovercard" href="https://github.com/BerriAI/litellm/pull/42008">#42008</a></li> <li>chore: bump litellm-enterprise 0.1.68 -> 0.1.69, litellm-proxy-extras 0.4.99 -> 0.4.100 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5513693268" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42025" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42025/hovercard" href="https://github.com/BerriAI/litellm/pull/42025">#42025</a></li> <li>fix(proxy): close the config-ownership gaps QA found in the settings store by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5513159924" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42009" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42009/hovercard" href="https://github.com/BerriAI/litellm/pull/42009">#42009</a></li> <li>fix(proxy): block project requests when max_budget is 0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/ryan-crabbe-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/ryan-crabbe-berri">@ryan-crabbe-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5512903926" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41997" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41997/hovercard" href="https://github.com/BerriAI/litellm/pull/41997">#41997</a></li> <li>fix(auth): inherit org alias, budget and rate limits for JWT and team-linked keys by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5492999313" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41681" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41681/hovercard" href="https://github.com/BerriAI/litellm/pull/41681">#41681</a></li> <li>feat(batches): run hosted_vllm batches inside LiteLLM by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5508921710" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41942" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41942/hovercard" href="https://github.com/BerriAI/litellm/pull/41942">#41942</a></li> <li>fix(proxy): forward stream response attributes through the hook boundary and merge logged applied_guardrails by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5513888657" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42027" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42027/hovercard" href="https://github.com/BerriAI/litellm/pull/42027">#42027</a></li> <li>feat(ui): configure web search interception from the Admin UI by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5513110798" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42007" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42007/hovercard" href="https://github.com/BerriAI/litellm/pull/42007">#42007</a></li> <li>fix(azure): drop tool_choice when the request has no tools (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5496917804" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41781" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41781/hovercard" href="https://github.com/BerriAI/litellm/pull/41781">#41781</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5514114546" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42031" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42031/hovercard" href="https://github.com/BerriAI/litellm/pull/42031">#42031</a></li> <li>fix(azure): tool choice without tools causes 400 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/dsteeley/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/dsteeley">@dsteeley</a> in <a href="https://github.com/BerriAI/litellm/pull/41781">https://github.com/BerriAI/litellm/pull/41781</a></li> <li>test(mcp): verify scoped execution and OAuth credential isolation by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/41731">https://github.com/BerriAI/litellm/pull/41731</a></li> <li>test(e2e): cover MCP OAuth SSO and cold restart persistence by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a href="https://github.com/BerriAI/litellm/pull/41909">https://github.com/BerriAI/litellm/pull/41909</a></li> <li>fix(proxy): estimate auto-router baseline costs from durable cache history by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/41177">https://github.com/BerriAI/litellm/pull/41177</a></li> <li>fix(auto-router): show heuristic v2 score estimates in routing details by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42001">https://github.com/BerriAI/litellm/pull/42001</a></li> <li>feat(router): add maintained Fuse model and harness presets by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/tin-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/tin-berri">@tin-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/41617">https://github.com/BerriAI/litellm/pull/41617</a></li> <li>refactor(rust): rename legacy callback adapter crate by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a href="https://github.com/BerriAI/litellm/pull/42037">https://github.com/BerriAI/litellm/pull/42037</a></li> <li>Revert "test(mcp): verify scoped execution and OAuth credential isolation" by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42039">https://github.com/BerriAI/litellm/pull/42039</a></li> <li>revert(e2e): remove MCP OAuth SSO and cold restart tests by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42040">https://github.com/BerriAI/litellm/pull/42040</a></li> <li>test(mcp): cover SDK redirect compatibility by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshua-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshua-berri">@joshua-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42033">https://github.com/BerriAI/litellm/pull/42033</a></li> <li>feat(ui): report whether the serving proxy has applied web search interception by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42042">https://github.com/BerriAI/litellm/pull/42042</a></li> <li>fix(test): unbreak the integration-cost and proxy_e2e_anthropic_messages CircleCI jobs on main by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a href="https://github.com/BerriAI/litellm/pull/42048">https://github.com/BerriAI/litellm/pull/42048</a></li> <li>chore(prices): sync OpenRouter prices: 2 models by @berriai-litellm-provider-info-sync[bot] in <a href="https://github.com/BerriAI/litellm/pull/42006">https://github.com/BerriAI/litellm/pull/42006</a></li> <li>feat(otel v2): opt-in llm_only span scope for Langfuse destinations and the operator Langfuse exporter by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a href="https://github.com/BerriAI/litellm/pull/41740">https://github.com/BerriAI/litellm/pull/41740</a></li> <li>test(e2e): point the Nova Sonic realtime test at nova-2-sonic by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42053">https://github.com/BerriAI/litellm/pull/42053</a></li> <li>fix(team): emit audit events for member_delete and role changes and carry the final roster on team create by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a href="https://github.com/BerriAI/litellm/pull/41840">https://github.com/BerriAI/litellm/pull/41840</a></li> <li>chore(prices): sync OpenRouter prices: 5 models by @berriai-litellm-provider-info-sync[bot] in <a href="https://github.com/BerriAI/litellm/pull/42058">https://github.com/BerriAI/litellm/pull/42058</a></li> <li>chore(prices): sync OpenRouter prices: 2 models by @berriai-litellm-provider-info-sync[bot] in <a href="https://github.com/BerriAI/litellm/pull/42063">https://github.com/BerriAI/litellm/pull/42063</a></li> <li>chore: rebuild Admin UI bundle from main (build kXnLzJ6ylsRPmgSkCkCKM) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42054">https://github.com/BerriAI/litellm/pull/42054</a></li> <li>test(mcp): migrate the mcp test helpers to the mcp 2.x MCPServer API by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42075">https://github.com/BerriAI/litellm/pull/42075</a></li> <li>test(logging): add autorouter estimate keys to the GCS pub/sub spend-log golden by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42076">https://github.com/BerriAI/litellm/pull/42076</a></li> <li>test(batches): skip the Bedrock GovCloud batch e2e until its secrets are provisioned by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42081">https://github.com/BerriAI/litellm/pull/42081</a></li> <li>fix(bedrock): backport the /v1/messages Invoke streaming pass-through to rc/1.103.0 (#42607) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/mateo-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/mateo-berri">@mateo-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/42658">https://github.com/BerriAI/litellm/pull/42658</a></li> <li>revert(usage): remove the top-N key cap and global spend rollup code from rc/1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43326">https://github.com/BerriAI/litellm/pull/43326</a></li> <li>fix(proxy): backport team member spend jsonb flush to rc/1.103.0 (#43029) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43323">https://github.com/BerriAI/litellm/pull/43323</a></li> <li>fix: backport five regression fixes to rc/1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43331">https://github.com/BerriAI/litellm/pull/43331</a></li> <li>chore: rebuild Admin UI bundle for rc/1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43328">https://github.com/BerriAI/litellm/pull/43328</a></li> <li>fix(jwt,otel): backport session conversation id and JWT team header selection to rc/1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43343">https://github.com/BerriAI/litellm/pull/43343</a></li> <li>fix(caching): stand default cache points down when extra_body hides a direct client mark by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43342">https://github.com/BerriAI/litellm/pull/43342</a></li> <li>test(integration): make rc/1.103.0 integration groups collect and pass again by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43382">https://github.com/BerriAI/litellm/pull/43382</a></li> <li>test(e2e): clear the two rc/1.103.0 e2e reds owned by upstream providers by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43388">https://github.com/BerriAI/litellm/pull/43388</a></li> <li>test(ci): fix the e2e and integration reds left on rc/1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43391">https://github.com/BerriAI/litellm/pull/43391</a></li> <li>fix(streaming): backport text-completion usage fix and e2e provider-flake tolerance to rc/1.103.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43400">https://github.com/BerriAI/litellm/pull/43400</a></li> <li>fix(proxy): unregister logging callbacks removed from the stored config by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a href="https://github.com/BerriAI/litellm/pull/43429">https://github.com/BerriAI/litellm/pull/43429</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/joshgarnett/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/joshgarnett">@joshgarnett</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5103898945" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36363" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36363/hovercard" href="https://github.com/BerriAI/litellm/pull/36363">#36363</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/HUAHAODIA/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/HUAHAODIA">@HUAHAODIA</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5446333689" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41048" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41048/hovercard" href="https://github.com/BerriAI/litellm/pull/41048">#41048</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/rad-p44/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/rad-p44">@rad-p44</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5392754151" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40315" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40315/hovercard" href="https://github.com/BerriAI/litellm/pull/40315">#40315</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/AaronHowell/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/AaronHowell">@AaronHowell</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5384902691" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40228" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40228/hovercard" href="https://github.com/BerriAI/litellm/pull/40228">#40228</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/MvdB/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/MvdB">@MvdB</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5142490288" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36775" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36775/hovercard" href="https://github.com/BerriAI/litellm/pull/36775">#36775</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/IToSSc/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/IToSSc">@IToSSc</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5457267984" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41179" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41179/hovercard" href="https://github.com/BerriAI/litellm/pull/41179">#41179</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/max-sixty/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/max-sixty">@max-sixty</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4992184868" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/34829" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/34829/hovercard" href="https://github.com/BerriAI/litellm/pull/34829">#34829</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/runjivu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/runjivu">@runjivu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5470921175" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41379" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41379/hovercard" href="https://github.com/BerriAI/litellm/pull/41379">#41379</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/elifozdamar/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/elifozdamar">@elifozdamar</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5432256523" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40843" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40843/hovercard" href="https://github.com/BerriAI/litellm/pull/40843">#40843</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/etiennechabert/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/etiennechabert">@etiennechabert</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5224469164" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/37983" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/37983/hovercard" href="https://github.com/BerriAI/litellm/pull/37983">#37983</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zachbernstein-sdx/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zachbernstein-sdx">@zachbernstein-sdx</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5477793235" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41444" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41444/hovercard" href="https://github.com/BerriAI/litellm/pull/41444">#41444</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/clonylu/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/clonylu">@clonylu</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5458866804" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41203" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41203/hovercard" href="https://github.com/BerriAI/litellm/pull/41203">#41203</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/zoroyihan7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/zoroyihan7">@zoroyihan7</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5386091715" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40243" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40243/hovercard" href="https://github.com/BerriAI/litellm/pull/40243">#40243</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/adssoccer1/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/adssoccer1">@adssoccer1</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5399331127" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40399" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40399/hovercard" href="https://github.com/BerriAI/litellm/pull/40399">#40399</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gaurav-pandey-zocdoc/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gaurav-pandey-zocdoc">@gaurav-pandey-zocdoc</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5310987863" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/39102" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/39102/hovercard" href="https://github.com/BerriAI/litellm/pull/39102">#39102</a></li> <li><a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/abhirup7/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/abhirup7">@abhirup7</a> made their first contribution in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5378177657" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/40147" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/40147/hovercard" href="https://github.com/BerriAI/litellm/pull/40147">#40147</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.102.0...v1.103.0"><tt>v1.102.0...v1.103.0</tt></a></p> yuneng-berri
<h2>Verify Docker Image Signature</h2> <p>All LiteLLM Docker images are signed with <a href="https://docs.sigstore.dev/cosign/overview/" rel="nofollow">cosign</a>. Every release is signed with the same key introduced in <a href="https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0">commit <code>0112e53</code></a>.</p> <p><strong>Verify using the pinned commit hash (recommended):</strong></p> <p>A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1</pre></div> <p><strong>Verify using the release tag (convenience):</strong></p> <p>Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:</p> <div class="highlight highlight-source-shell notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.104.0-rc.1/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1"><pre>cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.104.0-rc.1/cosign.pub \ ghcr.io/berriai/litellm:v1.104.0-rc.1</pre></div> <p>Expected output:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key"><pre class="notranslate"><code>The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key </code></pre></div> <hr> <h2>What's Changed</h2> <ul> <li>test(e2e): cover Azure code_interpreter container files by native id with a service-account key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577615016" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43122" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43122/hovercard" href="https://github.com/BerriAI/litellm/pull/43122">#43122</a></li> <li>fix(router): await budget redis pipeline before sync reads (internal copy of <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="4846643424" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/32618" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/32618/hovercard" href="https://github.com/BerriAI/litellm/pull/32618">#32618</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5577797567" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43125" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43125/hovercard" href="https://github.com/BerriAI/litellm/pull/43125">#43125</a></li> <li>chore(cost-map): add openai cached image input prices from the pricing page by @berriai-litellm-provider-info-sync[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5578726487" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43143" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43143/hovercard" href="https://github.com/BerriAI/litellm/pull/43143">#43143</a></li> <li>feat(langfuse)!: migrate the sdk callback to langfuse v4 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yucheng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yucheng-berri">@yucheng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5138392653" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/36741" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/36741/hovercard" href="https://github.com/BerriAI/litellm/pull/36741">#36741</a></li> <li>fix(key_management): count team unified access group MCP servers when validating key MCP grants by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5462032255" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/41231" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/41231/hovercard" href="https://github.com/BerriAI/litellm/pull/41231">#41231</a></li> <li>fix(ui): group cost optimization cache leakage by model group by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5572571328" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43008" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43008/hovercard" href="https://github.com/BerriAI/litellm/pull/43008">#43008</a></li> <li>fix(presidio): mask streamed /v1/messages output when the first upstream read is a keepalive, a data-less ping, or a split utf8 character by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/devin-ai-integration/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/devin-ai-integration">@devin-ai-integration</a>[bot] in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5573242625" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43023" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43023/hovercard" href="https://github.com/BerriAI/litellm/pull/43023">#43023</a></li> <li>test: backport stale and state-leaking test fixes to rc/1.104.0 (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590493058" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43266" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43266/hovercard" href="https://github.com/BerriAI/litellm/pull/43266">#43266</a>) by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5590520203" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43267" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43267/hovercard" href="https://github.com/BerriAI/litellm/pull/43267">#43267</a></li> <li>chore: backport CI fixes, <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5588044077" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43206" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43206/hovercard" href="https://github.com/BerriAI/litellm/pull/43206">#43206</a> and Rust changes to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5596665399" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43338" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43338/hovercard" href="https://github.com/BerriAI/litellm/pull/43338">#43338</a></li> <li>fix(s3_v2): backport <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5573143500" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43022" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43022/hovercard" href="https://github.com/BerriAI/litellm/pull/43022">#43022</a> to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597766034" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43354" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43354/hovercard" href="https://github.com/BerriAI/litellm/pull/43354">#43354</a></li> <li>chore: rebuild Admin UI bundle for rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598240490" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43372" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43372/hovercard" href="https://github.com/BerriAI/litellm/pull/43372">#43372</a></li> <li>chore: backport CircleCI speedups (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5597425910" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43347" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43347/hovercard" href="https://github.com/BerriAI/litellm/pull/43347">#43347</a>) and cost-map fixes (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5569123636" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/42951" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/42951/hovercard" href="https://github.com/BerriAI/litellm/pull/42951">#42951</a>) to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598151528" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43366" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43366/hovercard" href="https://github.com/BerriAI/litellm/pull/43366">#43366</a></li> <li>revert(usage): remove the top-N key cap, its follow-ups and the daily global spend rollup code from rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5598462756" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43385" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43385/hovercard" href="https://github.com/BerriAI/litellm/pull/43385">#43385</a></li> <li>fix(streaming): backport text-completion usage chunk fix (<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5574540480" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43047" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43047/hovercard" href="https://github.com/BerriAI/litellm/pull/43047">#43047</a>) to rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599050848" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43402" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43402/hovercard" href="https://github.com/BerriAI/litellm/pull/43402">#43402</a></li> <li>test(e2e): report batch cleanup leftovers as a plain UserWarning on rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599392222" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43406" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43406/hovercard" href="https://github.com/BerriAI/litellm/pull/43406">#43406</a></li> <li>test(e2e): skip the LangSmith batch serialization e2e on rc/1.104.0 until CI has a LangSmith key by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599792965" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43418" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43418/hovercard" href="https://github.com/BerriAI/litellm/pull/43418">#43418</a></li> <li>test(unit): stop test modules from putting their own directory on sys.path on rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5599793279" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43420" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43420/hovercard" href="https://github.com/BerriAI/litellm/pull/43420">#43420</a></li> <li>fix(proxy): unregister logging callbacks removed from the stored config on rc/1.104.0 by <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/yuneng-berri/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/yuneng-berri">@yuneng-berri</a> in <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="5600929966" data-permission-text="Title is private" data-url="https://github.com/BerriAI/litellm/issues/43432" data-hovercard-type="pull_request" data-hovercard-url="/BerriAI/litellm/pull/43432/hovercard" href="https://github.com/BerriAI/litellm/pull/43432">#43432</a></li> </ul> <p><strong>Full Changelog</strong>: <a class="commit-link" href="https://github.com/BerriAI/litellm/compare/v1.104.0-dev.2...v1.104.0-rc.1"><tt>v1.104.0-dev.2...v1.104.0-rc.1</tt></a></p> litellm-dispatcher[bot]