Skip to content

[exporter/opensearch] Add pipeline option for ingest pipeline support#47228

Open
robertpaschedag wants to merge 6 commits intoopen-telemetry:mainfrom
robertpaschedag:opensearch_pipeline
Open

[exporter/opensearch] Add pipeline option for ingest pipeline support#47228
robertpaschedag wants to merge 6 commits intoopen-telemetry:mainfrom
robertpaschedag:opensearch_pipeline

Conversation

@robertpaschedag
Copy link
Copy Markdown

Description

Add an optional pipeline configuration parameter to the OpenSearch exporter. When set, the specified ingest pipeline ID is passed to the bulk indexer, causing all documents to be
processed by the pipeline before being indexed in OpenSearch.

Link to tracking issue

Fixes #47227

Testing

Testing was done manually by passing the pipeline option to a running opensearch instance. Passing the name of an ingest pipeline that does not exist, returns a permanent error (as expected). Also, a permanent error is returned, if there is no node in the cluster, that has the ingest node role assigned.

exporters:
  opensearch:
    http:
      endpoint: <endpoint>
      tls:
        ...
    pipeline: otel-ingest-pipeline

Documentation

- `pipeline` (optional): the ID of an [ingest pipeline](https://opensearch.org/docs/latest/ingest-pipelines/) to apply when indexing documents. When set, all documents sent via the bulk API will be processed by the specified pipeline before being indexed. The ingest pipeline must exist in the cluster and there must be a least one node with the `ingest` node role assigned.

Add an optional 'pipeline' configuration parameter to the OpenSearch
exporter. When set, the specified ingest pipeline ID is passed to the
bulk indexer, causing all documents to be
processed by the pipeline before being indexed in OpenSearch.

Closes open-telemetry#47227
@robertpaschedag robertpaschedag requested a review from a team as a code owner March 30, 2026 12:23
@linux-foundation-easycla
Copy link
Copy Markdown

linux-foundation-easycla bot commented Mar 30, 2026

CLA Signed

The committers listed above are authorized under a signed CLA.

@github-actions github-actions bot added the first-time contributor PRs made by new contributors label Mar 30, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Welcome, contributor! Thank you for your contribution to opentelemetry-collector-contrib.

Important reminders:

A maintainer will review your pull request soon. Thank you for helping make OpenTelemetry better!

@paulojmdias
Copy link
Copy Markdown
Member

/workflow-approve

@robertpaschedag
Copy link
Copy Markdown
Author

/rerun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Allow to specify an ingest pipeline to be used before writing documents

3 participants