conntrack: tasks

[ronensc]

• Build Connection Hash
• Support Unidirectional and Bidirectional connections
• Output original flowlogs
• Remove expired connections and emit end connection records
• Integrate the conntrack module with pipeline as a new stage #243
• Update docs (conntrack: Add conntrack docs to README.md #291)
• Emit connection status/update records (conntrack: Add update reports for long connections #287)
• Configurable timeouts (for status and end connection records) by key-value selectors
• Config validation (conntrack: config validation #285)
• Error on name conflicts between aggregation fields and key fields
• Error if only one of fieldGroupARef fieldGroupBRef is defined
• Error if SplitAB: true for some aggregator and fieldGroupARef is not defined
• Error on duplicate FieldGroup names
• Error on unknown operation in outputFields
• Error on undefined fieldGroupRefs in hash section
• Operational metric for current connection count in memory (conntrack: Add operational metrics #255)
• Extend e2e test
• Remove the old connection tracking implementation from the transform stage (conntrack: Remove old implementation #294)
• Detect end connections by TCP flags #299
• conntrack: Allow configuring multiple hash IDs to connection records #352

Notes:

• flowDirection should be added to the connection hash to avoid aggregating duplicated data.
• k8s namespace fields should also be added to the connection hash so they appear in the connection record.