Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Filebeat] AWS cloudtrail module should handle Digest files #20943

Closed
leehinman opened this issue Sep 2, 2020 · 2 comments · Fixed by #21086
Closed

[Filebeat] AWS cloudtrail module should handle Digest files #20943

leehinman opened this issue Sep 2, 2020 · 2 comments · Fixed by #21086
Assignees
@leehinman
Labels
enhancement Filebeat Filebeat Team:Platforms Label for the Integrations - Platforms team

Comments

@leehinman
Copy link
Contributor

Describe the enhancement:

AWS Cloudtrail can be configured to create a digest of each cloudtrail
log file when it writes it. Filebeat should be able to ingest these
files.

https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-log-file-validation-intro.html
@leehinman leehinman added enhancement Filebeat Filebeat needs_backport PR is waiting to be backported to other branches. labels Sep 2, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Sep 2, 2020
@kaiyan-sheng kaiyan-sheng added Team:Platforms Label for the Integrations - Platforms team Team:SIEM labels Sep 14, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@elasticmachine
Copy link
Collaborator

Pinging @elastic/siem (Team:SIEM)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Sep 14, 2020
@leehinman leehinman self-assigned this Sep 14, 2020
leehinman added a commit to leehinman/beats that referenced this issue Sep 14, 2020
@leehinman
Add support for Cloudtrail digest files
6a7c864 
- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields

Closes elastic#20943
@leehinman leehinman mentioned this issue Sep 14, 2020
Merged
6 tasks
leehinman added a commit that referenced this issue Sep 15, 2020
@leehinman
[Filebeat] Add support for Cloudtrail digest files (#21086)
c9f7a99 
* Add support for Cloudtrail digest files

- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields
- add cloudtrail insight fields

Closes #20943
@leehinman leehinman mentioned this issue Sep 15, 2020
Merged
6 tasks
leehinman added a commit to leehinman/beats that referenced this issue Sep 15, 2020
@leehinman
[Filebeat] Add support for Cloudtrail digest files (elastic#21086)
ad82d30 
* Add support for Cloudtrail digest files

- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields
- add cloudtrail insight fields

Closes elastic#20943

(cherry picked from commit c9f7a99)
@leehinman leehinman mentioned this issue Sep 15, 2020
Merged
6 tasks
leehinman added a commit to leehinman/beats that referenced this issue Sep 15, 2020
@leehinman
[Filebeat] Add support for Cloudtrail digest files (elastic#21086)
b9618af 
* Add support for Cloudtrail digest files

- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields
- add cloudtrail insight fields

Closes elastic#20943

(cherry picked from commit c9f7a99)
leehinman added a commit that referenced this issue Sep 15, 2020
@leehinman
[Filebeat] Add support for Cloudtrail digest files (#21086) (#21088)
7407ad1 
* Add support for Cloudtrail digest files

- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields
- add cloudtrail insight fields

Closes #20943

(cherry picked from commit c9f7a99)
leehinman added a commit that referenced this issue Sep 15, 2020
@leehinman
[Filebeat] Add support for Cloudtrail digest files (#21086) (#21089)
48bd77b 
* Add support for Cloudtrail digest files

- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields
- add cloudtrail insight fields

Closes #20943

(cherry picked from commit c9f7a99)
@andrewkroh andrewkroh removed the needs_backport PR is waiting to be backported to other branches. label Dec 15, 2020
leweafan pushed a commit to leweafan/beats that referenced this issue Apr 28, 2023
@leehinman
[Filebeat] Add support for Cloudtrail digest files (elastic#21086) (e…
0da7f36 
…lastic#21089)

* Add support for Cloudtrail digest files

- allow file matching with file_selectors in s3 input
- update cloudtrail pipeline
- update cloudtrail config to use file_selectors
- add cloudtrail digest fields
- add cloudtrail insight fields

Closes elastic#20943

(cherry picked from commit 6e3cb57)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@leehinman leehinman

Labels
enhancement Filebeat Filebeat Team:Platforms Label for the Integrations - Platforms team
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Filebeat] Add support for Cloudtrail digest files leehinman/beats
4 participants
@andrewkroh @kaiyan-sheng @elasticmachine @leehinman