Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for larger models at a future block. #83

Merged
merged 13 commits into from
Mar 24, 2024
Merged

Support for larger models at a future block. #83

merged 13 commits into from
Mar 24, 2024

Commits on Mar 18, 2024

  1. Update model size on downloads based on block.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    5409309 View commit details
    Browse the repository at this point in the history

  2. Use optimizations at new block for inference.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    8c13811 View commit details
    Browse the repository at this point in the history

  3. Limit model types based on block.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    c8cb2b8 View commit details
    Browse the repository at this point in the history

  4. Run inference with sequence length based on block.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    e8206a7 View commit details
    Browse the repository at this point in the history

  5. Doc updates.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    9f8ae23 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. Fix docs + increase time for eval + adjust sample model parameters.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    c83a787 View commit details
    Browse the repository at this point in the history

  2. Refactor to use ModelParameters + pass sequence length.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    4957e80 View commit details
    Browse the repository at this point in the history

  3. Rename to Model Criteria for clarity.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    e520ff1 View commit details
    Browse the repository at this point in the history

  4. Update docs to point to correct line for ModelCriteria.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    d8af206 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. Update to use 6.9 params, 8192 seqeuence length, and block 2735661.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    99afe25 View commit details
    Browse the repository at this point in the history

  2. Update to 24 pages and add clarify TFLOPs required.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    56a3713 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2024

  1. Update documentation on vali requirements and flash-attn requirements.

    @Sid-Data-Universe
    Sid-Data-Universe committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    0f26862 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dev' into next_milestone

    @Sid-Data-Universe
    Sid-Data-Universe authored Mar 24, 2024
    Configuration menu
    Copy the full SHA
    fadbe82 View commit details
    Browse the repository at this point in the history