v1.35.0 #2095
mkmeral
announced in
Announcements
v1.35.0
#2095
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What's Changed
Features
Bedrock Service Tier Support — PR#1799
Amazon Bedrock now offers service tiers (Priority, Standard, Flex) that let you control the trade-off between latency and cost on a per-request basis.
BedrockModelaccepts a newservice_tierconfiguration field, consistent with how other Bedrock-specific features like guardrails are exposed. When not set, the field is omitted and Bedrock uses its default behavior.Valid values are
"default","priority", and"flex". If a model or region does not support the specified tier, Bedrock returns aValidationException.Bug Fixes
Sliding window conversation manager user-first enforcement — PR#2087: The sliding window could produce a trimmed conversation starting with an assistant message, causing
ValidationExceptionon providers that require user-first ordering (including Bedrock Nova). The trim-point validation now ensures the first remaining message always hasrole == "user". Also fixed a short-circuit logic bug in thetoolUseguard that let orphaned tool-use blocks slip through at window boundaries.MCP
_metaforwarding — PR#1918, PR#2081: Custom metadata per the MCP spec was silently dropped becauseMCPClientnever forwarded the_metafield toClientSession.call_tool(). Additionally, the OTEL instrumentation usedmodel_dump()instead ofmodel_dump(by_alias=True), serializing the field as"meta"instead of"_meta"and corrupting the payload. Both the directcall_tooland task-augmented execution paths now correctly forwardmeta.Tool exception propagation to OpenTelemetry spans — PR#2046: When a tool raised an exception, the original exception was dropped before reaching
end_tool_call_span, causing all tool spans to getStatusCode.OKeven on errors. Tool errors now correctly propagate withStatusCode.ERROR, preserving the original exception type and traceback for observability backends like Langfuse.Anthropic premature stream termination — PR#2047: The Anthropic provider crashed with
AttributeErrorwhen the stream terminated before the finalmessage_stopevent, because it accessedevent.message.usageon event types that lack a.messageattribute. Now uses the Anthropic SDK'sstream.get_final_message()to read accumulated usage from all received events, gracefully handling premature termination and empty streams.Anthropic Pydantic deprecation warnings — PR#2044: Fixed
message_stopevent handling to avoid Pydantic deprecation warnings.New Contributors
Full Changelog: v1.34.1...v1.35.0
This discussion was created from the release v1.35.0.
Beta Was this translation helpful? Give feedback.
All reactions