Skip to content

Add params_to_tune for pf NNs (DeepARModel, TFTModel) #1197

Closed
Mr-Geekman opened this issue Mar 30, 2023 · 2 comments
Closed

Add params_to_tune for pf NNs (DeepARModel, TFTModel) #1197

Mr-Geekman opened this issue Mar 30, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@Mr-Geekman
Copy link
Contributor

Mr-Geekman commented Mar 30, 2023

🚀 Feature Request

Add params_to_tune for pf NNs (DeepARModel, TFTModel)

Proposal

Suggested grid for DeepARModel:

{
    "hidden_size": IntDistribution(4, 64, step=4),
    "rnn_layers": IntDistribution(4, 3, step=1),
    "dropout": Uniform(0, 0.5),
    "lr": LogUniformDistribution(1e-5, 1e-2),
}

Suggested grid for TFTModel:

{
    "hidden_size": IntDistribution(4, 64, step=4),
    "lstm_layers": IntDistribution(4, 3, step=1),
    "dropout": Uniform(0, 0.5),
    "attention_head_size": IntDistribution(2, 8, step=2),
    "lr": LogUniformDistribution(1e-5, 1e-2),
}

To discuss:

  • Is tuning lr necessary?

Test cases

Look at #1184.

Additional context

No response

@Mr-Geekman Mr-Geekman added the enhancement New feature or request label Mar 30, 2023
@Mr-Geekman Mr-Geekman added this to the AutoML 2.0 milestone Mar 30, 2023
@martins0n
Copy link
Contributor

The same comments for lr as for mlp rnn

@Mr-Geekman
Copy link
Contributor Author

Closed by #1210.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
Status: Done
Development

No branches or pull requests

2 participants