Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kibana OOM; captureSpanStackTraces:true implicated #2453

Open
trentm opened this issue Nov 17, 2021 · 0 comments
Open

kibana OOM; captureSpanStackTraces:true implicated #2453

trentm opened this issue Nov 17, 2021 · 0 comments
Assignees
Labels
agent-nodejs Make available for APM Agents project planning. bug kibana stretch

Comments

@trentm
Copy link
Member

trentm commented Nov 17, 2021

Repro details: elastic/kibana#118560

This required (gleaned from some private chat) having APM enabled in Kibana with captureSpanStackTraces: true. That was accidentally set to true because the serverUrl was customized plus some complexity in how @kbn/apm-config-loader works.

  • Kibana: v7.15.1
  • APM agent version: v3.21.1, but likely happens back to v3.16.0 (which is the min version specified in Kibana v7.15.1's deps).

Ideas:

  • Straight-up leak; or
  • A combination of: (a) capturing stack traces is so slow, and (b) capturing results in retaining references that indirectly keep the ES response bodies referenced while capturing, and (c) there were enough ES queries going on that it got backed up and eventually sucked all memory.
@trentm trentm added the kibana label Nov 17, 2021
@github-actions github-actions bot added the agent-nodejs Make available for APM Agents project planning. label Nov 17, 2021
@AlexanderWert AlexanderWert added this to the 8.1 milestone Dec 6, 2021
@trentm trentm self-assigned this Dec 21, 2021
@estolfo estolfo removed this from the 8.1 milestone Jan 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
agent-nodejs Make available for APM Agents project planning. bug kibana stretch
Projects
None yet
Development

No branches or pull requests

3 participants