Allow multiple patterns in parser transforms #1477
Labels
domain: parsing
Anything related to parsing within Vector
meta: good first issue
Anything that is good for new contributors.
meta: idea
Anything in the idea phase. Needs further discussion and consensus before work can begin.
needs: approval
Needs review & approval before work can begin.
needs: requirements
Needs a a list of requirements before work can be begin
type: enhancement
A value-adding code change that enhances its existing functionality.
We should think about making it easier to parse a variety of log formats in parsing transforms (
regex_parser
,grok_parser
, etc).Use case
An interesting use case is parsing common logs, such as a Ruby on Rails logs:
Where someone might want to define a set of regular expressions (or grok expressions) to parse all of these logs. It'd be neat to classify (namespace) these logs as well. For example:
Would produce events like:
The nested format is opinionated and something I've found helpful to avoid name conflicts in downstream storages. We could just as easily namespace the fields with a prefix (
http_request.method
).This would pair nicely with #1437.
The text was updated successfully, but these errors were encountered: