Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encounter a error while executing training process #33

Open
WangWilly opened this issue Sep 8, 2021 · 2 comments
Open

Encounter a error while executing training process #33

WangWilly opened this issue Sep 8, 2021 · 2 comments

Comments

@WangWilly
Copy link

Hi, I followed all you mentioned step. And I executed python run.py experiment=multigpu_vocals model=ConvTDFNet_vocals to start training then encounter following problem. 💔

RuntimeError: Early stopping conditioned on metric `val/sdr` which is not available. Pass in or modify your `EarlyStopping` callback to use any of the following: `train/loss`, `train/loss_step`, `train/loss_epoch`

Appreciate to get your reply. ✨✨

@cnh2769
Copy link

cnh2769 commented Sep 12, 2021

Same issue here..!

@ws-choi
Copy link
Collaborator

ws-choi commented Sep 19, 2021

Hi @WangWilly and @cnh2769,
We have also encountered the issue several times and I am not sure what it is honestly.

Hmm can you try the below and share the result with me?

  1. go to
    early_stopping:
  2. and insert check_on_train_epoch_end: False
    early_stopping:
      ~~~~
      check_on_train_epoch_end: False
    

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants