Support sending resource and record attributes for logs with raw encoding in kafka exporter

[ViplavC]

Component(s)

exporter/kafka

Is your feature request related to a problem? Please describe.

I was trying to send windows event logs using kafka exporter to Azure Eventhub to a non OTLP supporting backend. Currently, kafka exporter supports the following encoding options for sending logs: otlp_proto, otlp_json and raw.

Since it's a non-OTLP supporting backend, the logs don't parse corrrectly. The only option that remains is using the raw encoding, but right now as it is stated in the documentation, it clearly states that record and resource attributes are discarded.

https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/exporter/kafkaexporter/README.md

It would be great if those resource and record attributes can be recorded. That will give additional context to the logs being captured and help in correlation purposes.

If there is any other workaround this currently, i would like to hear about it too.

Describe the solution you'd like

When encoding: raw is selected in kafka exporter, the record and resource attributes should be kept instead of discarded.

Describe alternatives you've considered

No response

Additional context

No response

[github-actions]

Pinging code owners:

• exporter/kafka: @pavolloffay @MovieStoreGuy

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[crobert-1]

@ViplavC Thanks for filing! I looked into this a bit and I think it would make sense to include resource and record attributes to the raw logs being exported.

I believe we could do something similar to what the text encoding extension does, and it should work as requested.

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• exporter/kafka: @pavolloffay @MovieStoreGuy

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• exporter/kafka: @pavolloffay @MovieStoreGuy

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been closed as inactive because it has been stale for 120 days with no activity.