Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Rule Tuning] Ignore "Not Available" in o365.audit.UserId for Microsoft 365 Rules #4105

Merged
merged 5 commits into from
Sep 28, 2024

Conversation

terrancedejesus
Copy link
Contributor

@terrancedejesus terrancedejesus commented Sep 25, 2024

Pull Request

Issue link(s):

Summary - What I changed

  • Ignore Not Available in Microsoft 365 login rules for impossible activity and brute forcing
  • Included user only types from Entra ID regarding logins to ignore backend services

How To Test

Testing requires access to the data, however, below is a screenshot of matches from previous emulation. Note that both rules for impossible travel or rare logins are new terms and thresholds, therefore not replicable via Discover to show reduced volume.

Screenshot 2024-09-25 at 6 22 12 PM

Checklist

  • Added a label for the type of pr: bug, enhancement, schema, Rule: New, Rule: Deprecation, Rule: Tuning, Hunt: New, or Hunt: Tuning so guidelines can be generated
  • Added the meta:rapid-merge label if planning to merge within 24 hours
  • Secret and sensitive material has been managed correctly
  • Automated testing was updated or added to match the most common scenarios
  • Documentation and comments were added for features that require explanation

Contributor checklist

@protectionsmachine
Copy link
Collaborator

Rule: Tuning - Guidelines

These guidelines serve as a reminder set of considerations when tuning an existing rule.

Documentation and Context

  • Detailed description of the suggested changes.
  • Provide example JSON data or screenshots.
  • Provide evidence of reducing benign events mistakenly identified as threats (False Positives).
  • Provide evidence of enhancing detection of true threats that were previously missed (False Negatives).
  • Provide evidence of optimizing resource consumption and execution time of detection rules (Performance).
  • Provide evidence of specific environment factors influencing customized rule tuning (Contextual Tuning).
  • Provide evidence of improvements made by modifying sensitivity by changing alert triggering thresholds (Threshold Adjustments).
  • Provide evidence of refining rules to better detect deviations from typical behavior (Behavioral Tuning).
  • Provide evidence of improvements of adjusting rules based on time-based patterns (Temporal Tuning).
  • Provide reasoning of adjusting priority or severity levels of alerts (Severity Tuning).
  • Provide evidence of improving quality integrity of our data used by detection rules (Data Quality).
  • Ensure the tuning includes necessary updates to the release documentation and versioning.

Rule Metadata Checks

  • updated_date matches the date of tuning PR merged.
  • min_stack_version should support the widest stack versions.
  • name and description should be descriptive and not include typos.
  • query should be inclusive, not overly exclusive. Review to ensure the original intent of the rule is maintained.

Testing and Validation

  • Validate that the tuned rule's performance is satisfactory and does not negatively impact the stack.
  • Ensure that the tuned rule has a low false positive rate.

@terrancedejesus terrancedejesus marked this pull request as ready for review September 25, 2024 22:27
@terrancedejesus terrancedejesus merged commit ef4e433 into main Sep 28, 2024
9 checks passed
@terrancedejesus terrancedejesus deleted the rule-tuning-m365-impossible-travel branch September 28, 2024 22:13
protectionsmachine pushed a commit that referenced this pull request Sep 28, 2024
…soft 365 Rules (#4105)

* tuning M365 impossible travel activity rules

* added additional filters for user type logins

* adjusted updated date

Removed changes from:
- rules/integrations/o365/credential_access_microsoft_365_brute_force_user_account_attempt.toml

(selectively cherry picked from commit ef4e433)
protectionsmachine pushed a commit that referenced this pull request Sep 28, 2024
…soft 365 Rules (#4105)

* tuning M365 impossible travel activity rules

* added additional filters for user type logins

* adjusted updated date

Removed changes from:
- rules/integrations/o365/credential_access_microsoft_365_brute_force_user_account_attempt.toml

(selectively cherry picked from commit ef4e433)
protectionsmachine pushed a commit that referenced this pull request Sep 28, 2024
…soft 365 Rules (#4105)

* tuning M365 impossible travel activity rules

* added additional filters for user type logins

* adjusted updated date

Removed changes from:
- rules/integrations/o365/credential_access_microsoft_365_brute_force_user_account_attempt.toml

(selectively cherry picked from commit ef4e433)
protectionsmachine pushed a commit that referenced this pull request Sep 28, 2024
…soft 365 Rules (#4105)

* tuning M365 impossible travel activity rules

* added additional filters for user type logins

* adjusted updated date

(cherry picked from commit ef4e433)
protectionsmachine pushed a commit that referenced this pull request Sep 28, 2024
…soft 365 Rules (#4105)

* tuning M365 impossible travel activity rules

* added additional filters for user type logins

* adjusted updated date

(cherry picked from commit ef4e433)
protectionsmachine pushed a commit that referenced this pull request Sep 28, 2024
…soft 365 Rules (#4105)

* tuning M365 impossible travel activity rules

* added additional filters for user type logins

* adjusted updated date

(cherry picked from commit ef4e433)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants