[filebeat][elasticsearch] deprecation, server and slowlog filesets use the wrong subpipeline version #39802
Labels
Filebeat
Filebeat
Module:elasticsearch
Elasticsearch Beats modules
Team:Monitoring
Stack Monitoring team
Since stack version 8:
deprecation, server and slowlog have supported two log formats.
For version 7 of the stack we used a non-ECS JSON format and for version 8 it's a ECS JSON format.
If you look at the 3 pipelines for how they branch into the version 7 or version 8 sub-pipelines, it's all based on if the
ecs.version
is part of the incomingmessage
.Current pipeline code:
But this doesn't work because
ecs.version
isn't part of the ECS formattedmessage
that Elasticsearch is outputting.Compare this to what does work:
(since
ecs.version
is written to the root of the ingested document by theadd_fields
processor here).We should update these 3 pipelines to make sure that version 7 goes to the version 7 pipeline and version 8 goes to the version 8 pipeline correctly.
The text was updated successfully, but these errors were encountered: