Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Trainer saves the given config to ClearML rather than the continued config #55

Open
erogol opened this issue Jun 30, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@erogol
Copy link
Member

erogol commented Jun 30, 2022

Describe the bug

Trainer saves the config that is given at the beginning of the training rather than the one restored after continuing a training.

To Reproduce

Continue one of your training using python script and give a modified config.json

The trainer will use the restored config but save the modified config.

Expected behavior

Save the config as exactly used.

Logs

No response

Environment

{
    "CUDA": {
        "GPU": [
            ""
        ],
        "available": true,
        "version": "11.3"
    },
    "Packages": {
        "PyTorch_debug": false,
        "PyTorch_version": "1.11.0",
        "Trainer": "v0.0.12",
        "numpy": "1.21.6"
    },
    "System": {
        "OS": "Linux",
        "architecture": [
            "64bit",
            "ELF"
        ],
        "processor": "x86_64",
        "python": "3.9.5",
        "version": "#119-Ubuntu SMP Mon Mar 7 18:49:24 UTC 2022"
    }
}

Additional context

No response

@erogol erogol added the bug Something isn't working label Jun 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant