Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BMs] Make it easy to reproduce multisim benchmarking plots #1332

Closed
1 task
graceful-coder opened this issue Jul 3, 2024 · 2 comments · May be fixed by #1613
Closed
1 task

[BMs] Make it easy to reproduce multisim benchmarking plots #1332

graceful-coder opened this issue Jul 3, 2024 · 2 comments · May be fixed by #1613
Assignees
@graceful-coder
Labels
Type: Enhancement New feature or request

Comments

@graceful-coder
Copy link
Collaborator

graceful-coder commented Jul 3, 2024 •
edited by trentmc
Loading

Background / motivation

Plots improve the understanding of ML model benchmarks for Predictoor. Alternative tools like Codepen.io are difficult to integrate into pdr-backend, while Plotly is an easy addition to pdr-backend with the option to plot live multisim data.

TODOs

  • Implement Python Plotly to generate plots for benchmarks of different ML models.
@graceful-coder graceful-coder added the Type: Enhancement New feature or request label Jul 3, 2024
@graceful-coder graceful-coder self-assigned this Jul 3, 2024
@graceful-coder
Copy link
Collaborator Author

  • Created a new benchmarks dir under the pdr-backend/pdr_backend dir
  • Initially committed three plot files, one for each model.
  • Reduced DRY violations by consolidating into one simpler file and deleted the three previous files.

@trentmc trentmc changed the title Add Benchmark Plots [Benchmarking] Make it easy to reproduce multisim benchmarking plots Jul 16, 2024
@trentmc trentmc changed the title [Benchmarking] Make it easy to reproduce multisim benchmarking plots [BMs] Make it easy to reproduce multisim benchmarking plots Jul 17, 2024
@trentmc
Copy link
Member

trentmc commented Aug 6, 2024

done

@trentmc trentmc closed this as completed Aug 6, 2024
@graceful-coder graceful-coder mentioned this issue Sep 3, 2024
Closed
@graceful-coder graceful-coder mentioned this issue Sep 17, 2024
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@graceful-coder graceful-coder

Labels
Type: Enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix #1332: Add benchmark plots oceanprotocol/pdr-backend
2 participants
@trentmc @graceful-coder