Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nightly #632

Merged
merged 133 commits into from
Jun 13, 2024
Merged

Nightly #632

merged 133 commits into from
Jun 13, 2024

Commits on May 19, 2024

  1. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    7df08c4 View commit details
    Browse the repository at this point in the history
  2. offload

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    ba5b6ce View commit details
    Browse the repository at this point in the history
  3. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    a07057e View commit details
    Browse the repository at this point in the history
  4. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    4be9063 View commit details
    Browse the repository at this point in the history
  5. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    3dc3d3f View commit details
    Browse the repository at this point in the history
  6. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    f1cc1e8 View commit details
    Browse the repository at this point in the history
  7. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    5cb531a View commit details
    Browse the repository at this point in the history
  8. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    6bd8e60 View commit details
    Browse the repository at this point in the history
  9. Update llama.py

    danielhanchen committed May 19, 2024
    Configuration menu
    Copy the full SHA
    d1d57ff View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Configuration menu
    Copy the full SHA
    7470f67 View commit details
    Browse the repository at this point in the history
  2. Update trainer.py

    danielhanchen committed May 20, 2024
    Configuration menu
    Copy the full SHA
    da9c1a6 View commit details
    Browse the repository at this point in the history
  3. Update trainer.py

    danielhanchen committed May 20, 2024
    Configuration menu
    Copy the full SHA
    2c68f56 View commit details
    Browse the repository at this point in the history
  4. Update trainer.py

    danielhanchen committed May 20, 2024
    Configuration menu
    Copy the full SHA
    217bf9d View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Update trainer.py

    danielhanchen committed May 21, 2024
    Configuration menu
    Copy the full SHA
    6e85384 View commit details
    Browse the repository at this point in the history
  2. is_bfloat16_supported

    danielhanchen committed May 21, 2024
    Configuration menu
    Copy the full SHA
    77f9c51 View commit details
    Browse the repository at this point in the history
  3. Update __init__.py

    danielhanchen committed May 21, 2024
    Configuration menu
    Copy the full SHA
    c0e1d27 View commit details
    Browse the repository at this point in the history
  4. Update README.md

    danielhanchen committed May 21, 2024
    Configuration menu
    Copy the full SHA
    2b23b93 View commit details
    Browse the repository at this point in the history
  5. Update llama.py

    danielhanchen committed May 21, 2024
    Configuration menu
    Copy the full SHA
    902e23a View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Configuration menu
    Copy the full SHA
    98f41ce View commit details
    Browse the repository at this point in the history
  2. is_bfloat16_supported

    danielhanchen committed May 22, 2024
    Configuration menu
    Copy the full SHA
    3193cac View commit details
    Browse the repository at this point in the history
  3. Update __init__.py

    danielhanchen committed May 22, 2024
    Configuration menu
    Copy the full SHA
    dfeaf4b View commit details
    Browse the repository at this point in the history
  4. Mistral v3

    danielhanchen committed May 22, 2024
    Configuration menu
    Copy the full SHA
    1e84090 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Configuration menu
    Copy the full SHA
    f63f32b View commit details
    Browse the repository at this point in the history
  2. Phi 3 medium

    danielhanchen committed May 23, 2024
    Configuration menu
    Copy the full SHA
    57ad8e7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2b994b2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ff8171f View commit details
    Browse the repository at this point in the history
  5. Phi-3

    danielhanchen committed May 23, 2024
    Configuration menu
    Copy the full SHA
    5ca8b58 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    98c2e81 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    3817660 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Configuration menu
    Copy the full SHA
    f858145 View commit details
    Browse the repository at this point in the history
  2. Update save.py

    danielhanchen committed May 24, 2024
    Configuration menu
    Copy the full SHA
    a1328f6 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Update README.md

    Mistral v3 to Mistral v0.3
    shimmyshimmer committed May 25, 2024
    Configuration menu
    Copy the full SHA
    fb29673 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. Untrained tokens

    danielhanchen committed May 26, 2024
    Configuration menu
    Copy the full SHA
    fa85556 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c511aca View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    35e7355 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cc0bf44 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    674ba66 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    9823f52 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c0c761b View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e2850c0 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    8e12780 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    6f1855e View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    d27b173 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    7bf7399 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    31ecef9 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    b67d93f View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    e874ccd View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Configuration menu
    Copy the full SHA
    d7b54ff View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5a4a512 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    82c040e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8e227b2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    250d386 View commit details
    Browse the repository at this point in the history
  6. Update llama.py

    danielhanchen committed May 27, 2024
    Configuration menu
    Copy the full SHA
    e6db3ba View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    e673fa2 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    222b835 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    6404aa5 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    cfea7b2 View commit details
    Browse the repository at this point in the history
  11. Update save.py

    danielhanchen committed May 27, 2024
    Configuration menu
    Copy the full SHA
    083e5ba View commit details
    Browse the repository at this point in the history
  12. Update save.py

    danielhanchen committed May 27, 2024
    Configuration menu
    Copy the full SHA
    6f2565c View commit details
    Browse the repository at this point in the history
  13. Update save.py

    danielhanchen committed May 27, 2024
    Configuration menu
    Copy the full SHA
    c19b04e View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. checkpoint

    danielhanchen committed May 28, 2024
    Configuration menu
    Copy the full SHA
    64b12a2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4cd5a8a View commit details
    Browse the repository at this point in the history
  3. Update _utils.py

    danielhanchen committed May 28, 2024
    Configuration menu
    Copy the full SHA
    196faec View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Configuration menu
    Copy the full SHA
    235be40 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cf9090a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1fb1110 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Update llama.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    d1bd60c View commit details
    Browse the repository at this point in the history
  2. accelerate

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    732ead0 View commit details
    Browse the repository at this point in the history
  3. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    359ae5c View commit details
    Browse the repository at this point in the history
  4. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    8dcfad3 View commit details
    Browse the repository at this point in the history
  5. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    2bafc57 View commit details
    Browse the repository at this point in the history
  6. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    90f6311 View commit details
    Browse the repository at this point in the history
  7. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    7b84ff7 View commit details
    Browse the repository at this point in the history
  8. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    60f4b9a View commit details
    Browse the repository at this point in the history
  9. Update _utils.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    3ebe5a5 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    7bbc8ce View commit details
    Browse the repository at this point in the history
  11. train_dataloader

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    6f5c84c View commit details
    Browse the repository at this point in the history
  12. Update llama.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    0d269ca View commit details
    Browse the repository at this point in the history
  13. Update llama.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    6b7c142 View commit details
    Browse the repository at this point in the history
  14. Update llama.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    54f3a74 View commit details
    Browse the repository at this point in the history
  15. use_fast_convert

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    0bc96c5 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    02c91b0 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    b384ff0 View commit details
    Browse the repository at this point in the history
  18. Update save.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    a8b5d89 View commit details
    Browse the repository at this point in the history
  19. Update save.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    872d569 View commit details
    Browse the repository at this point in the history
  20. Update save.py

    danielhanchen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    3a1f5f2 View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2024

  1. Update save.py

    danielhanchen committed Jun 2, 2024
    Configuration menu
    Copy the full SHA
    bcadc8c View commit details
    Browse the repository at this point in the history
  2. remove_special_tokens

    danielhanchen committed Jun 2, 2024
    Configuration menu
    Copy the full SHA
    1381820 View commit details
    Browse the repository at this point in the history
  3. Ollama

    danielhanchen committed Jun 2, 2024
    Configuration menu
    Copy the full SHA
    e01b87d View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Configuration menu
    Copy the full SHA
    b3479c7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    86804dc View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    87fdd3a View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Configuration menu
    Copy the full SHA
    5c5df69 View commit details
    Browse the repository at this point in the history
  2. Update llama.py

    danielhanchen committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    6386d94 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2024

  1. Configuration menu
    Copy the full SHA
    b1a9551 View commit details
    Browse the repository at this point in the history
  2. Support bfloat16 GGUF

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    344a05d View commit details
    Browse the repository at this point in the history
  3. Update save.py

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    6b11e0d View commit details
    Browse the repository at this point in the history
  4. Update llama.py

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    c6e4b5b View commit details
    Browse the repository at this point in the history
  5. fast_forward_inference

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    57f29ab View commit details
    Browse the repository at this point in the history
  6. Update mapper.py

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    d32e972 View commit details
    Browse the repository at this point in the history
  7. Update loader.py

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    e121fa5 View commit details
    Browse the repository at this point in the history
  8. Update llama.py

    danielhanchen committed Jun 9, 2024
    Configuration menu
    Copy the full SHA
    5eaa10f View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Configuration menu
    Copy the full SHA
    f57d28d View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. info

    danielhanchen committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    8937507 View commit details
    Browse the repository at this point in the history
  2. edits

    danielhanchen committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    8982edb View commit details
    Browse the repository at this point in the history
  3. Create chat template

    danielhanchen committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    8904605 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Fix tokenizer

    danielhanchen committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    2a374c2 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Configuration menu
    Copy the full SHA
    d704b73 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8176155 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    21a99f1 View commit details
    Browse the repository at this point in the history
  4. Support revision parameter in FastLanguageModel.from_pretrained (#629)

    * support `revision` parameter
    
    * match unsloth formatting of named parameters
    chrehall68 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    dbf2dcf View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    9016171 View commit details
    Browse the repository at this point in the history
  6. Update __init__.py (#602)

    Check for incompatible modules before importing unsloth
    xyangk committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    0428920 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    9fdd847 View commit details
    Browse the repository at this point in the history
  8. Add GGML saving option to Unsloth for easier Ollama model creation an…

    …d testing. (#345)
    
    * Add save to llama.cpp GGML to save.py.
    
    * Fix conversion command and path of convert to GGML function.
    
    * Add autosaving lora to the GGML function
    
    * Create lora save function for conversion to GGML
    
    * Test fix #2 for saving lora
    
    * Test fix #3 to save  the lora adapters to convert to GGML
    
    * Remove unwated tokenizer saving for conversion to ggml and added a few print statements.
    
    * Needed tokenizer for saving, added it back, also made it more unslothy style by having positional arguments, and added a few messages.
    
    * Positional arguments didn't work out, so reverted to older version of the code, and added a few comments.
    
    * Test fix 1 for arch
    
    * Test fix 2 new Mistral error.
    
    * Test fix 3
    
    * Revert to old version for testing.
    
    * Upload issue test fix 1
    
    * Fix 2 uploading ggml
    
    * Positional ags added.
    
    * Temporray remove positional args
    
    * Fix upload again!!!
    
    * Add print statements and fix link
    
    * Make the calling name better
    
    * Create local saving for GGML
    
    * Add choosing directory to save local GGML.
    
    * Fix lil variable error in the save_to_custom_dir func
    mahiatlinux committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b5fc6aa View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    3fafbf7 View commit details
    Browse the repository at this point in the history
  10. llama.cpp failing (#371)

    llama.cpp is failing to generate quantize versions for the trained models.
    
    Error:
    
    ```bash
    You might have to compile llama.cpp yourself, then run this again.
    You do not need to close this Python program. Run the following commands in a new terminal:
    You must run this in the same folder as you're saving your model.
    git clone https://github.com/ggerganov/llama.cpp
    cd llama.cpp && make clean && LLAMA_CUDA=1 make all -j
    Once that's done, redo the quantization.
    ```
    
    But when i do clone this with recursive it works.
    
    Co-authored-by: Daniel Han <[email protected]>
    bet0x and danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    273a871 View commit details
    Browse the repository at this point in the history
  11. fix libcuda_dirs import for triton 3.0 (#227)

    * fix libcuda_dirs import for triton 3.0
    
    * Update __init__.py
    
    * Update __init__.py
    
    ---------
    
    Co-authored-by: Daniel Han <[email protected]>
    t-vi and danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b312b3f View commit details
    Browse the repository at this point in the history
  12. Update save.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    1601dca View commit details
    Browse the repository at this point in the history
  13. Update __init__.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    26dc502 View commit details
    Browse the repository at this point in the history
  14. Update fast_lora.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    6a51657 View commit details
    Browse the repository at this point in the history
  15. Update save.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    4a8ba90 View commit details
    Browse the repository at this point in the history
  16. Update save.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    0abb5ba View commit details
    Browse the repository at this point in the history
  17. Update save.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b24dd05 View commit details
    Browse the repository at this point in the history
  18. Update loader.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    48c6d6d View commit details
    Browse the repository at this point in the history
  19. Update save.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    e35f608 View commit details
    Browse the repository at this point in the history
  20. Update save.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    4822eae View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    7d847ed View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    82f10cb View commit details
    Browse the repository at this point in the history
  23. Update loader.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    08424f0 View commit details
    Browse the repository at this point in the history
  24. Update mapper.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    eb906d0 View commit details
    Browse the repository at this point in the history
  25. Update __init__.py

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    0a304ae View commit details
    Browse the repository at this point in the history
  26. embedding size

    danielhanchen committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    71edc42 View commit details
    Browse the repository at this point in the history