Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

dump memory snapshot to analyze OOMs #395

Merged
merged 9 commits into from
Jun 19, 2024
Merged

dump memory snapshot to analyze OOMs #395

merged 9 commits into from
Jun 19, 2024

Commits on Jun 12, 2024

  1. del logits=(bs, seq_len, vocab_size) to save 3.9G memory 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    6cd4853 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'pytorch:main' into memory

    @weifengpy
    weifengpy authored Jun 12, 2024
    Configuration menu
    Copy the full SHA
    ae76243 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. dump memory snapshot to analyze OOM 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    510e9f8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'pytorch:main' into memory

    @weifengpy
    weifengpy authored Jun 13, 2024
    Configuration menu
    Copy the full SHA
    76ab55d View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. avoid -1 iteration 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    87aaf9e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into memory

    @weifengpy
    weifengpy authored Jun 18, 2024
    Configuration menu
    Copy the full SHA
    48e8bc8 View commit details
    Browse the repository at this point in the history

  3. step from 1 and exit at OOM 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    e7a3b08 View commit details
    Browse the repository at this point in the history

  4. resolve merge conflict 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    0639da9 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. consistent naming with profiler trace 

    Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
    @weifengpy
    weifengpy committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    abec6fb View commit details
    Browse the repository at this point in the history