feat: Add sync streaming support for Anthropic instrumentation by vasantteja · Pull Request #4155 · open-telemetry/opentelemetry-python-contrib

vasantteja · 2026-02-01T16:30:36Z

Description

This PR adds sync streaming support for the Anthropic instrumentation. It enables telemetry capture for:

Messages.create(stream=True) - Streaming responses via the create method with stream parameter
Messages.stream() - The dedicated streaming method that returns a MessageStreamManager

Key changes:

Added StreamWrapper class to wrap Stream[RawMessageStreamEvent] and extract telemetry from streaming chunks
Added MessageStreamManagerWrapper to wrap MessageStreamManager context manager
Added MessageWrapper for non-streaming response telemetry extraction
Renamed MessageCreateParams to MessageRequestParams to reflect broader API coverage
Modified messages_create to use manual lifecycle management (start_llm/stop_llm) instead of context manager to support both streaming and non-streaming

Fixes #3949 partially.

Type of change

Please delete options that are not relevant.

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
This change requires a documentation update

How Has This Been Tested?

Added comprehensive tests for sync streaming functionality:

test_sync_messages_create_streaming - Tests streaming with context manager
test_sync_messages_create_streaming_iteration - Tests direct iteration without context manager
test_sync_messages_create_streaming_connection_error - Tests error handling for streaming
test_sync_messages_stream_basic - Tests Messages.stream() method
test_sync_messages_stream_with_params - Tests stream with additional parameters (temperature, top_p, top_k)
test_sync_messages_stream_token_usage - Tests token usage capture in streaming
test_sync_messages_stream_connection_error - Tests error handling for stream method

All tests use VCR cassettes for reproducible HTTP interaction replay.

Does This PR Require a Core Repo Change?

Yes. - Link to PR:
No.

Checklist:

See contributing.md for styleguide, changelog guidelines, and more.

Followed the style guidelines of this project
Changelogs have been updated
Unit tests have been added
Documentation has been updated

- Add support for Messages.create(stream=True) with StreamWrapper - Add support for Messages.stream() with MessageStreamManagerWrapper - Add MessageWrapper for non-streaming response telemetry - Rename MessageCreateParams to MessageRequestParams - Add comprehensive tests for sync streaming functionality

- Add type: ignore[arg-type] for Union type narrowing in messages_create - Add type: ignore[return-value] for wrapper return types - Add type: ignore[return-value] for __exit__ returning None

...opentelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/patch.py

...opentelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/utils.py

lmolkova · 2026-02-08T18:40:13Z

tagging @anirudha who was interested to review the PR :)

anirudha · 2026-02-08T18:57:11Z

Thanks. Taking a look today

…r handling - Introduce constants for provider name and cache token attributes. - Normalize stop reasons and aggregate cache token fields in MessageWrapper and StreamWrapper. - Enhance tests to validate input token aggregation and stop reason normalization. - Update cassettes for new request and response structures in streaming scenarios.

…d consistency - Simplify constant definitions and normalize function calls in utils.py. - Enhance test cases by removing unnecessary line breaks and improving formatting. - Ensure consistent usage of type hints and comments in test functions.

- Update the pylint directive to disable too-many-arguments warning for better clarity. - Maintain consistency in function signature and improve code readability.

anirudha

Tests all pass locally. Nice work overall — the wrapper separation is clean. One bug to fix (double finalize), rest are suggestions.

Note: conftest.py isn't in this diff so I can't leave a line comment, but scrub_response_headers is a no-op and all new cassettes leak anthropic-organization-id: 455ea6be-bd92-4199-83ec-0c6b39c5c169. Worth scrubbing that or adding it to filter_headers.

Also, the PR description says Fixes #3949 but async streaming isn't covered. Totally fine to scope this to sync only, but Fixes will auto-close the issue on merge. Maybe Partially addresses #3949 instead?

...opentelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/utils.py

...opentelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/patch.py

…tion - Update test cases to validate streaming behavior with various parameters, including token usage and stop reasons. - Introduce new cassettes for different scenarios, ensuring comprehensive coverage of streaming interactions. - Refactor existing tests for clarity and consistency in structure and assertions.

…ocals in test_stream_wrapper_finalize_idempotent function

…eja/opentelemetry-python-contrib into anthropic-sync-streaming

…Ds, timestamps, and token usage across various test cases. Refine content capture logic and ensure consistency in message formats, including adjustments to event data and headers for improved clarity and accuracy.

MikeGoldsmith

🚀

...ntelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/wrappers.py

...opentelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/patch.py

...instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/messages_extractors.py

…n code and tests

…oved type safety. Replace 'Any' with 'object' in several function signatures and class attributes. Introduce logging for error handling in MessagesStreamWrapper to enhance instrumentation reliability.

…eja/opentelemetry-python-contrib into anthropic-sync-streaming

… clarity and safety. Update function signatures to use specific types instead of 'object', including changes to parameters in extract_params, get_input_messages, and get_system_instruction. Refactor messages_create to ensure correct type handling for streaming and non-streaming responses. Additionally, streamline message handling in MessagesStreamWrapper for better performance and reliability.

…function signatures in `messages_extractors.py` and `wrappers.py` to include specific types, improving clarity and reliability. Introduce handling for `None` values in `get_input_messages` and `get_system_instruction`. Refactor `MessagesStreamWrapper` to better manage usage updates and ensure correct type handling for streaming responses. Add new test cases for aggregating cache tokens and handling streaming errors.

…. Simplify assertion statements by removing unnecessary parentheses, enhancing code clarity in cache token tests.

aabmass · 2026-02-26T17:49:14Z

util/opentelemetry-util-genai/src/opentelemetry/util/genai/utils.py

+        return False
+    if mode == ContentCapturingMode.EVENT_ONLY and not should_emit_event():
+        return False
+    return True


@DylanRussell do we have this util already?

@aabmass We don't have this in util. This is specifically used for understanding whether we should we do the work of converting messages/content blocks into structured parts. I couldn't see any function which is having same functionality as this one in util.

...instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/messages_extractors.py

...opentelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/utils.py

…equirements.oldest.txt for compatibility improvements.

…s for improved clarity and type safety. Update extract_usage_tokens function to return UsageTokens instead of a tuple, and adjust related invocations in MessageWrapper and MessagesStreamWrapper accordingly.

…ility improvements.

Cirilla-zmh

LGTM, thank you!

vasantteja requested a review from a team as a code owner February 1, 2026 16:30

github-actions bot assigned codefromthecrypt, karthikscale3, lmolkova, lzchen, nirga and vasantteja Feb 1, 2026

vasantteja removed their assignment Feb 1, 2026

Add changelog entry for sync streaming support

ea0bd94

github-actions bot assigned vasantteja Feb 1, 2026

Fix type checking errors with type: ignore comments

504d0df

- Add type: ignore[arg-type] for Union type narrowing in messages_create - Add type: ignore[return-value] for wrapper return types - Add type: ignore[return-value] for __exit__ returning None

vasantteja force-pushed the anthropic-sync-streaming branch from 99a2596 to 504d0df Compare February 1, 2026 16:57

vasantteja removed their assignment Feb 5, 2026

lmolkova reviewed Feb 8, 2026

View reviewed changes

github-actions bot assigned vasantteja Feb 9, 2026

vasantteja removed their assignment Feb 9, 2026

github-actions bot assigned vasantteja Feb 9, 2026

vasantteja removed their assignment Feb 9, 2026

Refactor argument handling in assert_span_attributes function

e6c83ac

- Update the pylint directive to disable too-many-arguments warning for better clarity. - Maintain consistency in function signature and improve code readability.

github-actions bot assigned vasantteja Feb 9, 2026

anirudha reviewed Feb 9, 2026

View reviewed changes

vasantteja added 4 commits February 8, 2026 23:18

Merge branch 'main' into anthropic-sync-streaming

a011520

Update test_sync_messages.py to disable pylint warning for too-many-l…

2851e4a

…ocals in test_stream_wrapper_finalize_idempotent function

Merge branch 'anthropic-sync-streaming' of https://github.com/vasantt…

3e5cbda

…eja/opentelemetry-python-contrib into anthropic-sync-streaming

github-actions bot assigned vasantteja Feb 19, 2026

MikeGoldsmith approved these changes Feb 19, 2026

View reviewed changes

nagkumar91 reviewed Feb 19, 2026

View reviewed changes

...ntelemetry-instrumentation-anthropic/src/opentelemetry/instrumentation/anthropic/wrappers.py Outdated Show resolved Hide resolved

aabmass reviewed Feb 19, 2026

View reviewed changes

vasantteja added 3 commits February 19, 2026 18:55

Merge branch 'main' into anthropic-sync-streaming

cdd95b1

Rename StreamWrapper to MessagesStreamWrapper and update references i…

1d1b7f5

…n code and tests

Merge branch 'main' into anthropic-sync-streaming

0793c46

github-actions bot assigned anirudha Feb 24, 2026

vasantteja added 3 commits February 24, 2026 21:11

Refactor type annotations in message extractors and wrappers for impr…

5effa69

…oved type safety. Replace 'Any' with 'object' in several function signatures and class attributes. Introduce logging for error handling in MessagesStreamWrapper to enhance instrumentation reliability.

Merge branch 'anthropic-sync-streaming' of https://github.com/vasantt…

89704d2

…eja/opentelemetry-python-contrib into anthropic-sync-streaming

tammy-baylis-swi added this to @xrmx's Python PR digest Feb 25, 2026

tammy-baylis-swi moved this to Approved PRs that need fixes in @xrmx's Python PR digest Feb 25, 2026

vasantteja added 3 commits February 25, 2026 19:11

Refactor assertions in test_sync_messages.py for improved readability…

d1bf3fe

…. Simplify assertion statements by removing unnecessary parentheses, enhancing code clarity in cache token tests.

Merge branch 'main' into anthropic-sync-streaming

138bfa0

tammy-baylis-swi moved this from Approved PRs that need fixes to Approved PRs in @xrmx's Python PR digest Feb 26, 2026

aabmass reviewed Feb 26, 2026

View reviewed changes

tammy-baylis-swi moved this from Approved PRs to Reviewed PRs that need fixes in @xrmx's Python PR digest Feb 26, 2026

tammy-baylis-swi moved this from Reviewed PRs that need fixes to Approved PRs that need fixes in @xrmx's Python PR digest Feb 26, 2026

vasantteja added 5 commits February 26, 2026 17:46

Merge branch 'main' into anthropic-sync-streaming

cc0a5b0

enforce strong typing system.

0dc8a9f

Update anthropic dependency version to 0.51.0 in pyproject.toml and r…

f62dd6d

…equirements.oldest.txt for compatibility improvements.

Refactor usage token extraction to utilize a new UsageTokens dataclas…

1bf7695

…s for improved clarity and type safety. Update extract_usage_tokens function to return UsageTokens instead of a tuple, and adjust related invocations in MessageWrapper and MessagesStreamWrapper accordingly.

Update anthropic dependency version in uv.lock to 0.51.0 for compatib…

3d2bd63

…ility improvements.

Cirilla-zmh approved these changes Feb 27, 2026

View reviewed changes

vasantteja removed their assignment Feb 27, 2026

Add tests for should_capture_content function in test_events_options.py.

cc8e4d1

github-actions bot assigned vasantteja Feb 27, 2026

Conversation

vasantteja commented Feb 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Type of change

How Has This Been Tested?

Does This PR Require a Core Repo Change?

Checklist:

Uh oh!

Uh oh!

Uh oh!

Uh oh!

lmolkova commented Feb 8, 2026

Uh oh!

anirudha commented Feb 8, 2026

Uh oh!

anirudha left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

MikeGoldsmith left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

aabmass Feb 26, 2026

Choose a reason for hiding this comment

Uh oh!

vasantteja Feb 27, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Cirilla-zmh left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

12 participants

vasantteja commented Feb 1, 2026 •

edited

Loading