Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ES Snapshot Promotion Failure] machine learning anomaly detection advanced job with categorization detector and default datafeed settings job creation displays details for the created job in the job list #71971

Closed
spalger opened this issue Jul 15, 2020 · 2 comments · Fixed by #72033
Closed

[ES Snapshot Promotion Failure] machine learning anomaly detection advanced job with categorization detector and default datafeed settings job creation displays details for the created job in the job list #71971

spalger opened this issue Jul 15, 2020 · 2 comments · Fixed by #72033
Assignees
@pheyos
Labels
blocker failed-es-promotion failed-test A test failure on a tracked branch, potentially flaky-test :ml skipped-test v7.10.0

Comments

@spalger
Copy link
Contributor

spalger commented Jul 15, 2020 •
edited
Loading

The ES Snapshot promotion failed with an ML test failure that looks legit, failing in exactly the same way in both attempts:

└- ✖ fail: machine learning anomaly detection advanced job with categorization detector and default datafeed settings job creation displays details for the created job in the job list
│       Error: Expected model size stats property 'total_by_field_count' to exist with value '994')
│       + expected - actual
│ 
│       -1,026
│       +994
│       
│       at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
│       at Assertion.eql (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:244:8)
│       at MlJobTable.assertJobRowDetailsCounts (test/functional/services/ml/job_table.ts:190:12)
│       at process._tickCallback (internal/process/next_tick.js:68:7)

image

Snapshot verification failures:

We also saw this test trigger a flaky failure in a PR recently, though it failed in a different way so I assume it was failing for a different reason:

Recent PR failure:

To ensure we get eyes on this soon and unblock the ES snapshot promotion I'm going to skip the tests in master and 7.x:

master: b87d742
7.x/7.10: da2d14b
@spalger spalger added blocker :ml failed-test A test failure on a tracked branch, potentially flaky-test skipped-test v7.10.0 failed-es-promotion labels Jul 15, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-test-triage (failed-test)

spalger added a commit that referenced this issue Jul 15, 2020
@spalger
skip flaky suite (#71971)
b87d742
spalger added a commit that referenced this issue Jul 15, 2020
@spalger
skip flaky suite (#71971)
da2d14b 
(cherry picked from commit b87d742)
@pheyos pheyos self-assigned this Jul 16, 2020
gmmorris added a commit to gmmorris/kibana that referenced this issue Jul 16, 2020
@gmmorris
Merge branch 'master' into alerting/consumer-based-rbac
a6989b5 
* master: (37 commits)
  [Lens] Handle failing existence check (elastic#70718)
  [Security Solution]Fix in-app links and popup window text (elastic#71403)
  [esArchiver] automatically retry if alias creation fails (elastic#71910)
  Move data stream index pattern creation test to xpack (elastic#71511)
  [Maps] Improve language for mvt card (elastic#71947)
  [Security][Detections] Unskip failing modal tests (elastic#71969)
  skip flaky suite (elastic#71987)
  skip flaky suite (elastic#71979)
  [Security Solution] [Detections] Revert "[Security Solution] [Detections] Fixes bug for determining when we hit max signals after filtering with lists (elastic#71768)" (elastic#71956)
  rename ilm policy to remove -default (elastic#71952)
  Adjust ordering of Management category apps to make Ingest Manager higher (elastic#71948)
  skip flaky suite (elastic#71971)
  skip flaky suite (elastic#71951)
  [kbn/optimizer] ignore compressed files when reporting stats (elastic#71940)
  skip flaky suite (elastic#71867)
  [ML] Fix new job with must_not saved search (elastic#71831)
  [Resolver] Fix bug where process detail panel doesn't show up (elastic#71754)
  Cleanup (elastic#71849)
  [Resolver] aria-level and aria-flowto support enhancements (elastic#71887)
  skip flaky suite (elastic#71304)
  ...
gmmorris added a commit to gmmorris/kibana that referenced this issue Jul 16, 2020
@gmmorris
Merge branch 'alerting/consumer-based-rbac' into alerting/management-…
47a4b93 
…feature-privileges

* alerting/consumer-based-rbac: (491 commits)
  [Lens] Handle failing existence check (elastic#70718)
  [Security Solution]Fix in-app links and popup window text (elastic#71403)
  [esArchiver] automatically retry if alias creation fails (elastic#71910)
  Move data stream index pattern creation test to xpack (elastic#71511)
  [Maps] Improve language for mvt card (elastic#71947)
  [Security][Detections] Unskip failing modal tests (elastic#71969)
  skip flaky suite (elastic#71987)
  skip flaky suite (elastic#71979)
  [Security Solution] [Detections] Revert "[Security Solution] [Detections] Fixes bug for determining when we hit max signals after filtering with lists (elastic#71768)" (elastic#71956)
  rename ilm policy to remove -default (elastic#71952)
  Adjust ordering of Management category apps to make Ingest Manager higher (elastic#71948)
  skip flaky suite (elastic#71971)
  skip flaky suite (elastic#71951)
  [kbn/optimizer] ignore compressed files when reporting stats (elastic#71940)
  skip flaky suite (elastic#71867)
  [ML] Fix new job with must_not saved search (elastic#71831)
  [Resolver] Fix bug where process detail panel doesn't show up (elastic#71754)
  Cleanup (elastic#71849)
  [Resolver] aria-level and aria-flowto support enhancements (elastic#71887)
  skip flaky suite (elastic#71304)
  ...
@pheyos pheyos mentioned this issue Jul 16, 2020
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pheyos pheyos

Labels
blocker failed-es-promotion failed-test A test failure on a tracked branch, potentially flaky-test :ml skipped-test v7.10.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[ML] Functional tests - remove by_field_count check for categorization jobs pheyos/kibana
3 participants
@spalger @pheyos @elasticmachine