feat(opentelemetry sink): add automatic native log and trace to OTLP conversion by szibis · Pull Request #24621 · vectordotdev/vector

szibis · 2026-02-09T16:36:11Z

Summary

Add automatic conversion from Vector's native flat log and trace formats to OTLP (OpenTelemetry Protocol) format in the opentelemetry sink's otlp codec.

Problem: Users currently need 50+ lines of complex VRL to manually build the nested OTLP structure (resourceLogs → scopeLogs → logRecords with KeyValue arrays), and trace events fail entirely when sent to the OTLP sink without passthrough mode.

Solution: The OTLP encoder now automatically detects native log and trace events and converts them to valid OTLP protobuf. Pre-formatted OTLP events continue to use passthrough encoding (backward compatible).

Scope

Signal	Native → OTLP	Passthrough (`use_otlp_decoding: true`)
Logs	✅ Auto-converts	✅ Passthrough
Traces	✅ Auto-converts	✅ Passthrough
Metrics	✅ Auto-converts (see #24897)	✅ Passthrough

Performance Impact (Logs)

Scenario	OLD (VRL + encode)	NEW (auto-convert)	Improvement
Single event	374 µs	340 µs	9% faster
Batch 100	2,886 µs	620 µs	4.7x faster
Batch throughput	58 MiB/s	269 MiB/s	4.7x higher

Architecture Comparison

%%{init: {'theme': 'base', 'themeVariables': { 'lineColor': '#000000', 'primaryTextColor': '#000000'}}}%%
flowchart TB
    subgraph OLD["OLD: 50 lines VRL"]
        direction LR
        O1[Source] ==> O2[VRL Transform]
        O2 ==> O3[OTLP Encoder]
        O3 ==> O4[Collector]
    end

    subgraph NEW["NEW: Zero VRL"]
        direction LR
        N1[Source] ==> N2[OTLP Encoder]
        N2 ==> N3[Collector]
    end

    OLD ==> NEW

    style O1 fill:#ffffff,stroke:#000000,stroke-width:2px,color:#000000
    style O2 fill:#cccccc,stroke:#000000,stroke-width:3px,color:#000000
    style O3 fill:#ffffff,stroke:#000000,stroke-width:2px,color:#000000
    style O4 fill:#ffffff,stroke:#000000,stroke-width:2px,color:#000000
    style N1 fill:#ffffff,stroke:#000000,stroke-width:2px,color:#000000
    style N2 fill:#999999,stroke:#000000,stroke-width:3px,color:#000000
    style N3 fill:#ffffff,stroke:#000000,stroke-width:2px,color:#000000

    linkStyle default stroke:#000000,stroke-width:2px

Before vs After Comparison

Capability	Before PR	After PR
Native logs → OTLP sink
`use_otlp_decoding: false` + `codec: otlp`	❌ encoding error	✅ auto-converts
Non-OTLP source (file/syslog) + `codec: otlp`	❌ encoding error	✅ auto-converts
`use_otlp_decoding: true` + `codec: otlp`	✅ passthrough	✅ passthrough
Manual VRL rebuild needed	❌ 50+ lines required	✅ not needed
Native traces → OTLP sink
Trace events + `codec: otlp`	❌ encoding error	✅ auto-converts
`use_otlp_decoding: true` + `codec: otlp`	✅ passthrough	✅ passthrough
Metrics → OTLP sink
`use_otlp_decoding: true` + `codec: otlp`	✅ passthrough	✅ passthrough
Native metrics + `codec: otlp`	❌ not supported	✅ auto-converts (see #24897)
Auto-conversion field mapping (logs)
`.message` → `body.stringValue`	❌ manual VRL	✅ automatic
`.severity_text` → `severityText`	❌ manual VRL	✅ automatic
`.severity_number` → `severityNumber`	❌ manual VRL	✅ automatic
`.attributes.*` → `logRecords[].attributes[]`	❌ manual VRL	✅ automatic
`.resources.*` → `resource.attributes[]`	❌ manual VRL	✅ automatic
`.trace_id` → `traceId`	❌ manual VRL	✅ automatic
`.span_id` → `spanId`	❌ manual VRL	✅ automatic
`.timestamp` → `timeUnixNano`	❌ manual VRL	✅ automatic
Severity inferred from text	❌	✅
Hex validation on trace/span IDs	❌	✅
Multiple timestamp formats	❌	✅
Auto-conversion field mapping (traces)
`.trace_id` → `traceId` (16 bytes)	❌ encoding error	✅ automatic
`.span_id` → `spanId` (8 bytes)	❌ encoding error	✅ automatic
`.parent_span_id` → `parentSpanId`	❌ encoding error	✅ automatic
`.name` → `name`	❌ encoding error	✅ automatic
`.kind` → `kind`	❌ encoding error	✅ automatic
`.start_time_unix_nano` / `.end_time_unix_nano`	❌ encoding error	✅ automatic
`.attributes.*` → `attributes[]`	❌ encoding error	✅ automatic
`.resources.*` → `resource.attributes[]`	❌ encoding error	✅ automatic
`.events` → `events[]` (span events)	❌ encoding error	✅ automatic
`.links` → `links[]` (span links)	❌ encoding error	✅ automatic
`.status` → `status` (message, code)	❌ encoding error	✅ automatic
Data integrity (native → OTLP)
String body	❌ fails	✅
Structured body (kvlist/array)	❌ fails	⚠️ stringified
String attributes	❌ fails	✅
Complex attributes (array/nested)	❌ fails	⚠️ best-effort
ResourceLogs batching	❌ fails	✅ 1:1 per event
ScopeLogs grouping	❌ fails	✅ 1:1 per event
Wire efficiency
Batching structure	❌ destroyed — 1 record per plog.Logs	✅ preserved — all records stay together
Wire payload size	❌ N × (resource + scope + 1 record)	✅ 1 × (resource + scope + N records)
Error handling
Missing fields	❌ crash/drop	✅ graceful defaults
Invalid trace_id hex	❌ crash/drop	✅ warning, field omitted
Unknown timestamp format	❌ crash/drop	✅ warning, uses 0
Performance
Single event throughput	N/A (failed)	✅ 9% faster than VRL
Batch throughput (100 events)	N/A (failed)	✅ 4.7× faster than VRL
Throughput (MiB/s)	58 (VRL workaround)	269

Vector configuration

Before (Complex VRL Required)

50+ lines of VRL transformation

sources:
  otel_source:
    type: opentelemetry
    grpc:
      address: 0.0.0.0:4317

transforms:
  build_otlp_structure:
    type: remap
    inputs: ["otel_source.logs"]
    source: |
      resource_attrs = []
      if exists(.resources) {
        for_each(object!(.resources)) -> |k, v| {
          resource_attrs = push(resource_attrs, {
            "key": k,
            "value": { "stringValue": to_string(v) ?? "" }
          })
        }
      }

      log_attrs = []
      if exists(.attributes) {
        for_each(object!(.attributes)) -> |k, v| {
          attr_value = if is_boolean(v) {
            { "boolValue": v }
          } else if is_integer(v) {
            { "intValue": to_string!(v) }
          } else if is_float(v) {
            { "doubleValue": v }
          } else {
            { "stringValue": to_string(v) ?? "" }
          }
          log_attrs = push(log_attrs, { "key": k, "value": attr_value })
        }
      }

      .resource_logs = [{
        "resource": { "attributes": resource_attrs },
        "scopeLogs": [{
          "scope": {
            "name": .scope.name ?? "",
            "version": .scope.version ?? ""
          },
          "logRecords": [{
            "timeUnixNano": to_string(to_unix_timestamp(.timestamp, unit: "nanoseconds")),
            "severityText": .severity_text ?? "INFO",
            "severityNumber": .severity_number ?? 9,
            "body": { "stringValue": .message ?? "" },
            "attributes": log_attrs,
            "traceId": .trace_id ?? "",
            "spanId": .span_id ?? ""
          }]
        }]
      }]

sinks:
  otel_out:
    type: opentelemetry
    inputs: ["build_otlp_structure"]
    endpoint: http://collector:4317
    encoding:
      codec: otlp

After (Zero VRL)

sources:
  otel_source:
    type: opentelemetry
    grpc:
      address: 0.0.0.0:4317
    # use_otlp_decoding: false (default)

sinks:
  otel_out:
    type: opentelemetry
    inputs: ["otel_source.logs"]
    endpoint: http://collector:4317
    encoding:
      codec: otlp  # Automatic conversion!

Traces (Zero VRL)

sources:
  otel_source:
    type: opentelemetry
    grpc:
      address: 0.0.0.0:4317

sinks:
  otel_out:
    type: opentelemetry
    inputs: ["otel_source.traces"]
    endpoint: http://collector:4317
    encoding:
      codec: otlp  # Native traces auto-converted to OTLP protobuf

Native Metrics (Auto-Convert via #24897)

sources:
  host_metrics:
    type: host_metrics

sinks:
  otel_out:
    type: opentelemetry
    inputs: ["host_metrics"]
    endpoint: http://collector:4317
    encoding:
      codec: otlp  # Native metrics auto-converted to OTLP protobuf (see #24897)

With Optional Enrichment

sources:
  otel_source:
    type: opentelemetry
    grpc:
      address: 0.0.0.0:4317

transforms:
  enrich:
    type: remap
    inputs: ["otel_source.logs"]
    source: |
      # Simple flat field access - no nested structure needed
      .attributes.processed_by = "vector"
      .resources."deployment.region" = "us-west-2"

sinks:
  otel_out:
    type: opentelemetry
    inputs: ["enrich"]
    endpoint: http://collector:4317
    encoding:
      codec: otlp

Supported Native Log Format

{
  "message": "User login successful",
  "timestamp": "2024-01-15T10:30:00Z",
  "severity_text": "INFO",
  "severity_number": 9,
  "trace_id": "0123456789abcdef0123456789abcdef",
  "span_id": "fedcba9876543210",
  "attributes": {
    "user_id": "user-12345",
    "duration_ms": 42.5
  },
  "resources": {
    "service.name": "auth-service"
  },
  "scope": {
    "name": "auth-module",
    "version": "1.0.0"
  }
}

Supported Native Trace Format

{
  "trace_id": "0123456789abcdef0123456789abcdef",
  "span_id": "fedcba9876543210",
  "parent_span_id": "abcdef0123456789",
  "name": "HTTP GET /api/users",
  "kind": 2,
  "start_time_unix_nano": 1705312200000000000,
  "end_time_unix_nano": 1705312200042000000,
  "attributes": {
    "http.method": "GET",
    "http.status_code": 200
  },
  "resources": {
    "service.name": "api-gateway"
  },
  "status": {
    "code": 1,
    "message": "OK"
  },
  "events": [
    {
      "name": "request.start",
      "time_unix_nano": 1705312200000000000,
      "attributes": { "component": "handler" }
    }
  ],
  "links": []
}

Log Field Mapping

Native Field	OTLP Field	Notes
`.message` / `.body` / `.msg`	`body.stringValue`	Auto-detected
`.timestamp`	`timeUnixNano`	chrono, epoch, RFC3339
`.severity_text`	`severityText`
`.severity_number`	`severityNumber`	Auto-inferred from text if missing
`.trace_id`	`traceId`	Hex string → 16 bytes
`.span_id`	`spanId`	Hex string → 8 bytes
`.attributes.*`	`attributes[]`	Object → KeyValue array
`.resources.*`	`resource.attributes[]`	Object → KeyValue array
`.scope.name`	`scope.name`	Instrumentation scope
`.scope.version`	`scope.version`	Instrumentation scope

Trace Field Mapping

Native Field	OTLP Field	Notes
`.trace_id`	`traceId`	Hex string → 16 bytes
`.span_id`	`spanId`	Hex string → 8 bytes
`.parent_span_id`	`parentSpanId`	Hex string → 8 bytes
`.name`	`name`	Span operation name
`.kind`	`kind`	SpanKind enum (0-5)
`.start_time_unix_nano`	`startTimeUnixNano`	Nanosecond timestamp
`.end_time_unix_nano`	`endTimeUnixNano`	Nanosecond timestamp
`.trace_state`	`traceState`	W3C trace state string
`.attributes.*`	`attributes[]`	Object → KeyValue array
`.resources.*`	`resource.attributes[]`	Object → KeyValue array
`.events[]`	`events[]`	Span events (name, time, attributes)
`.links[]`	`links[]`	Span links (trace_id, span_id, attributes)
`.status.code`	`status.code`	StatusCode enum
`.status.message`	`status.message`	Status description
`.dropped_attributes_count`	`droppedAttributesCount`
`.dropped_events_count`	`droppedEventsCount`
`.dropped_links_count`	`droppedLinksCount`

How did you test this PR?

Unit Tests

cargo test -p opentelemetry-proto  # 72+ tests (log + trace conversion)
cargo test -p codecs --test otlp   # 28 tests

Tests cover:

Basic encoding, error handling, type conversion, safe timestamp overflow handling
Logs: Timestamp formats, severity inference, message fallbacks, hex validation
Traces: Basic fields, timestamps, parent_span_id, trace_state, attributes, resources, status, events, links, dropped counts, invalid/wrong-length IDs, mixed valid/invalid fields
Roundtrip encode/decode for both signals
Validation edge cases (negative timestamps, severity clamping, ID length)

E2E Tests

cargo vdev test e2e opentelemetry-native

Docker Compose with telemetrygen validates:

Native logs convert to valid OTLP
Field preservation through pipeline
Custom attributes via VRL transforms
Correct event counting metrics

Benchmarks

cargo bench --bench codecs --features codecs-benches -- otlp_encoding

Change Type

Bug fix
New feature
Non-functional (chore, refactoring, docs)
Performance

Is this a breaking change?

Yes
No

Pre-formatted OTLP events (with resourceLogs/resourceSpans/resourceMetrics fields) continue using existing passthrough path. Native metric events return an explicit error with a clear message (same behavior as before for unsupported types).

Does this PR include user facing changes?

Yes. Please add a changelog fragment based on our guidelines.
No. A maintainer will apply the no-changelog label to this PR.

References

Issue/PR	Relationship
#22789	Directly related - Our codec-level approach provides the same outcome with simpler implementation
#24515	Solves - User requesting OTLP transform helper; this eliminates the need
#23971	Solves root cause - OTLP encoding failing; our encoder handles all formats
#22550	Complementary - Adds metrics support; our patterns can extend to metrics
#24897	Companion PR - Adds native metric → OTLP conversion (Counter, Gauge, Histogram, Summary, Distribution, Set)

Add conversion from Vector's native flat log format to OTLP protobuf: - Value → PBValue converters (inverse of existing PBValue → Value) - native_log_to_otlp_request() for full event conversion - Safe extraction helpers with graceful error handling - Hex validation for trace_id (16 bytes) and span_id (8 bytes) - Severity inference from severity_text when number missing - Support for multiple timestamp formats (chrono, epoch, RFC3339) - Pre-allocation and inline hints for performance

Detect native log format and automatically convert to OTLP when: - Event does not contain 'resourceLogs' field (pre-formatted OTLP) - Works with any Vector source (file, socket, otlp with flat decoding) Maintains backward compatibility: - Pre-formatted OTLP events (use_otlp_decoding: true) encode via passthrough - Native events get automatic conversion to valid OTLP protobuf This eliminates the need for 50+ lines of complex VRL transformation.

Add integration and E2E tests: Unit/Integration tests (lib/codecs/tests/otlp.rs): - Basic encoding functionality - Error handling (invalid types, missing fields, malformed hex) - Source compatibility (file, syslog, modified OTLP) - Timestamp handling (seconds, nanos, RFC3339, chrono) - Severity inference from text - Message field fallbacks (.message, .body, .msg, .log) - Roundtrip encode/decode verification E2E tests (tests/e2e/opentelemetry/native/): - Native logs convert to valid OTLP - Service name preservation through conversion - Log body, severity, timestamps preserved - Custom attributes via VRL transforms - Correct event counting metrics

Add comprehensive benchmarks comparing encoding approaches: 1. NEW: Native → auto-convert → encode (this PR) 2. OLD: VRL transform simulation → encode (what users had before) 3. OLD: Passthrough only (pre-formatted OTLP) Results show 4.7x throughput improvement for batch operations: - NEW batch: 288 MiB/s - OLD VRL: 61 MiB/s Single event is 7.4% faster than VRL approach.

- Changelog fragment for release notes - Comprehensive documentation with mermaid diagrams - Before/after configuration examples - Field mapping reference - Performance comparison tables

github-actions · 2026-02-09T16:41:35Z

All contributors have signed the CLA ✍️ ✅
_{Posted by the CLA Assistant Lite bot.}

szibis · 2026-02-09T16:42:53Z

I have read the CLA Document and I hereby sign the CLA

Fix check-spelling CI failure by adding two domain-specific terms: - kvlist: OpenTelemetry KeyValueList type - xychart: Mermaid diagram chart type

maycmlee

Hi, thanks for opening this PR! I'm the docs reviewer. Just some small doc suggestions and also a question about using version numbers.

docs/examples/otlp-native-conversion.md

Co-authored-by: May Lee <may.lee@datadoghq.com>

szibis · 2026-03-11T16:40:00Z

@pront this is PR #24897 that solves metrics based on this PR as a reference which should close the whole problem after both PR's merged.

pront

Hi @szibis, I will prioritize reviewing this PR.

lib/opentelemetry-proto/src/logs.rs

… encode Apply review feedback patterns from PR vectordotdev#24621: - Replace `as u64` with `u64::try_from().ok()` for timestamp conversion - Replace `as u64`/`as f64` with `u64::from()`/`f64::from()` for sample.rate - Remove unwrap() in Distribution bucket overflow guard, use saturating index clamping instead

…ecode path Replace bare 'u64 as i64' casts with i64::try_from().ok() in timestamp conversions for logs and spans decode paths. Values above i64::MAX (year 2262+) now gracefully fall back to current time or Value::Null instead of silently wrapping to negative timestamps. Also guards log record dropped_attributes_count with > 0 check to avoid inserting zero values, matching the scope dropped_attributes_count pattern. Fixes internal_log_rate_secs to internal_log_rate_limit (Vector convention).

kv_list_into_value was dropping KeyValue entries where kv.value was None (outer AnyValue wrapper missing). Now all entries are preserved as Null.

…elds in log conversion Add namespace-aware field extraction that checks both event root (Legacy namespace) and %metadata.opentelemetry.* (Vector namespace), ensuring round-trip compatibility for logs decoded with Vector namespace. Collect unrecognized event fields (e.g. user_id, request_id, hostname) into OTLP attributes instead of silently dropping them during native log-to-OTLP conversion.

…OTLP conversion Add 19 new tests covering: - Full OTLP field mapping (all fields set simultaneously) - Attribute value types (int, float, bool, array, nested object) - Body field priority (message > body > msg > log) - Structured object body → KvlistValue - Observed timestamp, flags, dropped_attributes_count - Scope with attributes - Remaining field dedup with explicit attributes - Null field filtering - All severity inference levels + case insensitivity - RFC3339 string and float timestamp parsing - Resource via alternative field names - Many custom fields from JSON/k8s sources - Vector namespace full metadata roundtrip

Mirror the log fix: collect unknown trace event fields (deployment_id, tenant, environment, etc.) as span attributes to prevent silent data loss during native→OTLP conversion. Add KNOWN_OTLP_SPAN_FIELDS list and collect_trace_remaining_fields helper. Include ingest_timestamp as known to avoid re-encoding the decode-path timestamp. Add 6 tests: unknown fields collected, known fields excluded, merge with explicit attributes, null filtering, type preservation, and ingest_timestamp exclusion.

…avior Fix scope.dropped_attributes_count: read from event/metadata instead of hard-coding 0, preserving round-trip fidelity. Add source_type and ingest_timestamp to known OTLP log fields to prevent Vector operational metadata from spilling into OTLP attributes. Document the automatic remaining-fields-to-attributes behavior in both the OtlpSerializer doc comments and the sink how_it_works section.

szibis · 2026-03-12T08:06:35Z

@pront I think this should goes first - Companion decode-side fix: #24905 adds decode for missing scope, schema_url, and resource.dropped_attributes_count fields across logs, traces, and metrics. This ensures the fields that this PR's encode path handles are actually populated by the decode side.

Extract scope.schema_url, resource schema_url, resource_dropped_attributes_count, and scope.dropped_attributes_count in the native-to-OTLP encode path. These fields are produced by the decode fix in vectordotdev#24905 — the encode now reads them when present and falls back to defaults (empty/0) when absent, ensuring full round-trip fidelity once vectordotdev#24905 merges while remaining backward-compatible before it does. Also fixes schema_url mapping: root "schema_url" now correctly maps to ResourceLogs/ResourceSpans.schema_url (resource level), while "scope.schema_url" maps to ScopeLogs/ScopeSpans.schema_url (scope level).

szibis added 5 commits February 9, 2026 17:08

docs: add changelog and examples for OTLP native conversion

2d0ea33

- Changelog fragment for release notes - Comprehensive documentation with mermaid diagrams - Before/after configuration examples - Field mapping reference - Performance comparison tables

szibis requested a review from a team as a code owner February 9, 2026 16:36

szibis requested a review from a team February 9, 2026 16:36

szibis requested a review from a team as a code owner February 9, 2026 16:36

szibis changed the title ~~Feat/otlp native auto conversion~~ feat(opentelemetry): add automatic native log to OTLP conversion in opentelemetry sink Feb 9, 2026

fix: add author to changelog fragment

80868ac

szibis changed the title ~~feat(opentelemetry): add automatic native log to OTLP conversion in opentelemetry sink~~ feat(opentelemetry sink): add automatic native log to OTLP conversion Feb 9, 2026

szibis added 2 commits February 9, 2026 18:03

chore: trigger CI rebuild

897200c

chore: retrigger CI

319e096

szibis mentioned this pull request Feb 9, 2026

Support OTLP transform for opentelemetry sink #24515

Open

evazorro self-assigned this Feb 9, 2026

evazorro added the editorial review label Feb 9, 2026

evazorro removed their assignment Feb 9, 2026

szibis added 2 commits February 10, 2026 12:26

Merge branch 'master' into feat/otlp-native-auto-conversion

1b00c27

chore: add kvlist and xychart to spelling allowlist

bd8fc2a

Fix check-spelling CI failure by adding two domain-specific terms: - kvlist: OpenTelemetry KeyValueList type - xychart: Mermaid diagram chart type

github-actions bot added the domain: ci Anything related to Vector's CI environment label Feb 10, 2026

thomasqueirozb added domain: codecs Anything related to Vector's codecs (encoding/decoding) sink: opentelemetry Anything `opentelemetry` sink related labels Feb 11, 2026

thomasqueirozb assigned pront Feb 11, 2026

maycmlee reviewed Feb 17, 2026

View reviewed changes

szibis and others added 2 commits February 17, 2026 21:16

Update otlp-native-conversion.md

a2df6b8

Co-authored-by: May Lee <may.lee@datadoghq.com>

Update otlp-native-conversion.md

5647afd

Co-authored-by: May Lee <may.lee@datadoghq.com>

github-actions bot removed the domain: codecs Anything related to Vector's codecs (encoding/decoding) label Feb 17, 2026

Update otlp-native-conversion.md

53d59cd

Co-authored-by: May Lee <may.lee@datadoghq.com>

szibis force-pushed the feat/otlp-native-auto-conversion branch from 6891644 to 9ba4ed1 Compare March 2, 2026 23:51

Merge branch 'master' into feat/otlp-native-auto-conversion

20beb85

szibis requested a review from pront March 2, 2026 23:54

Merge branch 'master' into feat/otlp-native-auto-conversion

842a22f

szibis mentioned this pull request Mar 11, 2026

feat(opentelemetry sink): add native metric to OTLP conversion #24897

Open

9 tasks

Merge branch 'master' into feat/otlp-native-auto-conversion

056bdd0

szibis mentioned this pull request Mar 11, 2026

Support sending OpenTelemetry metrics #17310

Open

pront reviewed Mar 11, 2026

View reviewed changes

lib/opentelemetry-proto/src/logs.rs Outdated Show resolved Hide resolved

lib/opentelemetry-proto/src/logs.rs Show resolved Hide resolved

szibis added 8 commits March 11, 2026 23:49

fix(opentelemetry): preserve KeyValue entries with None wrapper value

eee1267

kv_list_into_value was dropping KeyValue entries where kv.value was None (outer AnyValue wrapper missing). Now all entries are preserved as Null.

style(opentelemetry): rustfmt formatting

87aae8a

Merge branch 'master' into feat/otlp-native-auto-conversion

d18c139

This was referenced Mar 12, 2026

OpenTelemetry source: trace decode drops scope, schema_url fields #24904

Open

[opentelemetry source] Update mapping of OpenTelemetry log data model to LogEvent #15500

Open

fix(opentelemetry lib): decode missing scope, schema_url, and resource fields #24905

Open

szibis requested a review from pront March 12, 2026 17:20

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(opentelemetry sink): add automatic native log and trace to OTLP conversion#24621

feat(opentelemetry sink): add automatic native log and trace to OTLP conversion#24621
szibis wants to merge 59 commits intovectordotdev:masterfrom
szibis:feat/otlp-native-auto-conversion

szibis commented Feb 9, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Feb 9, 2026 •

edited

Loading

Uh oh!

szibis commented Feb 9, 2026

Uh oh!

maycmlee left a comment •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

szibis commented Mar 11, 2026

Uh oh!

pront left a comment

Uh oh!

Uh oh!

Uh oh!

szibis commented Mar 12, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

szibis commented Feb 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Scope

Performance Impact (Logs)

Architecture Comparison

Before vs After Comparison

Vector configuration

Before (Complex VRL Required)

After (Zero VRL)

Traces (Zero VRL)

Native Metrics (Auto-Convert via #24897)

With Optional Enrichment

Supported Native Log Format

Supported Native Trace Format

Log Field Mapping

Trace Field Mapping

How did you test this PR?

Unit Tests

E2E Tests

Benchmarks

Change Type

Is this a breaking change?

Does this PR include user facing changes?

References

Uh oh!

github-actions bot commented Feb 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

szibis commented Feb 9, 2026

Uh oh!

maycmlee left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

szibis commented Mar 11, 2026

Uh oh!

pront left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

szibis commented Mar 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

szibis commented Feb 9, 2026 •

edited

Loading

github-actions bot commented Feb 9, 2026 •

edited

Loading

maycmlee left a comment •

edited

Loading

szibis commented Mar 12, 2026 •

edited

Loading