Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log all config hyper parameters to mlflow tags #480

Closed
3 tasks
guybartal opened this issue Apr 15, 2024 · 0 comments · Fixed by #529
Closed
3 tasks

Log all config hyper parameters to mlflow tags #480

guybartal opened this issue Apr 15, 2024 · 0 comments · Fixed by #529
Assignees
Labels
bug Something isn't working Sprint 1 April 11 to May 1 2024

Comments

@guybartal
Copy link
Collaborator

guybartal commented Apr 15, 2024

As a researcher I would like all my config.json hyper parameters logged as mlflow tags as soon as possible
So, I would be able to compare between my job runs even if pipeline didn't finish to run (failed / long time running).

note:
today only few properties are being tagged in mlflow and many parameters are missing.

Tasks

@guybartal guybartal self-assigned this Apr 15, 2024
@guybartal guybartal added the bug Something isn't working label Apr 15, 2024
@Lep06fg Lep06fg added the Sprint 1 April 11 to May 1 2024 label May 2, 2024
guybartal added a commit that referenced this issue May 18, 2024
closes #480 

### This PR includes

- Log all hyper parameters to mlflow
- Config refactoring - lowercase for all attributes as those are not constants (match coding conventions)
- Print azure ml monitoring URL right after its creation to allow easy access to monitoring (ctrl + left click)
- Fix issues with experiment and job names, allowing azure ml commands open experiment and mlflow runs automatically, while locally we create those manually.
- Remove unused experiment settings from `.env` sample file
- Hide warning azureml warnings by using `CliV2AnonymousEnvironment` as Azure ML environment name
- Temporary solution for wrong json format in Q&A Gen step with current CI generation model version by removing all "..."` strings from the model response

### WIP
#540
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Sprint 1 April 11 to May 1 2024
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants