Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation with agent with finetuned model #240

Open
wants to merge 60 commits into
base: main
Choose a base branch
from

Commits on Apr 19, 2024

  1. added features to download models from the hugging face model hub/loa…

    …d local hugging face model and finetune loaded model with hugging face dataset
    
    Added features to download models from hugging face model hub/load local hugging face model and finetune loaded model with hugging face dataset. Model loading and fine-tuning can happen both at the initialization stage and after the agent has been initialized (see README in `agentscope/examples/load_finetune_huggingface_model` for details). Major changes to the repo include creating the example script `load_finetune_huggingface_model`, adding a new model wrapper `HuggingFaceWrapper`, and creating a new agent type Finetune_DialogAgent. All changes are done in a new example directory `agentscope/examples/load_finetune_huggingface_model`.
    zyzhang1130 committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    7b754a9 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. added customized hyperparameters specification

    made customized hyperparameters specification available from `model_configs` for fine-tuning at initialization, or through `fine_tune_config` in `Finetune_DialogAgent`'s `fine_tune` method after initialization
    zyzhang1130 committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    ea00db0 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. Configuration menu
    Copy the full SHA
    3e8c468 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    10a9870 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5237356 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a6918eb View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b4f4f40 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Update huggingface_model.py

    fixed issue related to `format` method
    zyzhang1130 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    e33b3de View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Configuration menu
    Copy the full SHA
    8023820 View commit details
    Browse the repository at this point in the history
  2. added updated README

    zyzhang1130 committed May 2, 2024
    Configuration menu
    Copy the full SHA
    0a079b9 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. Configuration menu
    Copy the full SHA
    a4d1f1b View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Configuration menu
    Copy the full SHA
    6b5410e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6d10051 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    db27edd View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b371226 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    7f3a012 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. resolve issues mentioned

    zyzhang1130 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    15bf79a View commit details
    Browse the repository at this point in the history
  2. resolve issues raised

    zyzhang1130 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    9998e66 View commit details
    Browse the repository at this point in the history
  3. resolve issues raised

    zyzhang1130 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    f6b46ed View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Update README.md

    updated the dependencies needed
    zyzhang1130 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    6bf09f1 View commit details
    Browse the repository at this point in the history
  2. Update README.md

    zyzhang1130 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    8d7e880 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Configuration menu
    Copy the full SHA
    195ac69 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Update huggingface_model.py

    Updated the way to read token from .env file, so that it can work in any example directory.
    zyzhang1130 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    98b471e View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Configuration menu
    Copy the full SHA
    ee062fd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6203f51 View commit details
    Browse the repository at this point in the history
  3. revert unnecessary change

    zyzhang1130 committed May 22, 2024
    Configuration menu
    Copy the full SHA
    ce0671f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    456f1ae View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    fbca61f View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    a0882fa View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    6e9dca6 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Configuration menu
    Copy the full SHA
    46233ff View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2d3c249 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5b6cf2c View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Configuration menu
    Copy the full SHA
    28037bc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3fcc03b View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Configuration menu
    Copy the full SHA
    3fb3540 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Configuration menu
    Copy the full SHA
    ce1373b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b2f2b09 View commit details
    Browse the repository at this point in the history
  3. optimized the behavior of device_map when loading a huggingface model.

    optimized the behavior of `device_map` when loading a huggingface model. Now if `device` is not given by the user, `device_map="auto"` by default; otherwise  `device_map` is set to the user-specified `device`.
    zyzhang1130 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    1d0704d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8685213 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    3da24f4 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    2ea8703 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. updated peft config

    now the user can choose to do full-parameter finetuning by not passing `lora_config`
    zyzhang1130 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    e0ba282 View commit details
    Browse the repository at this point in the history
  2. updated peft config

    now the user can choose to do full-parameter finetuning by not passing `lora_config` and `bnb_config`
    zyzhang1130 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    7f2f565 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    427f9f5 View commit details
    Browse the repository at this point in the history
  4. Merge remote-tracking branch 'origin/conversation_with_agent_with_fin…

    …etuned_model' into conversation_with_agent_with_finetuned_model
    zyzhang1130 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    e2f1cf6 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Configuration menu
    Copy the full SHA
    432bb21 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a27c3a8 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Update huggingface_model.py

    updated according to the latest comments
    zyzhang1130 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b532346 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d0bcc34 View commit details
    Browse the repository at this point in the history
  3. bug fixing

    zyzhang1130 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    21a9f21 View commit details
    Browse the repository at this point in the history
  4. bug fixing

    zyzhang1130 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    97e6330 View commit details
    Browse the repository at this point in the history
  5. bug fixing

    zyzhang1130 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b4a3849 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Configuration menu
    Copy the full SHA
    e05e606 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. changed to using chat_template format for finetuning. Resolve the b…

    …ug for continual finetuning.
    zyzhang1130 committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    799cac5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a13b219 View commit details
    Browse the repository at this point in the history
  3. when continue_lora_finetuning is True, check if model is already…

    … `PeftModel` before convert it to `PeftModel`
    zyzhang1130 committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    06d3ae1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    50f7ae7 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. Configuration menu
    Copy the full SHA
    19ed176 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    99cecb6 View commit details
    Browse the repository at this point in the history