New versions of how-to-guides for computing at scale #302

MMenchero · 2024-04-24T00:57:05Z

Description:

New versions of the Dask and Ray how-to guides that incorporate the new NixtlaClient class.

Changes:

Updated version of issue feat: Added Dask and Ray how-to-guides #175 (this version was too old).
Tutorials have repetitive information, so they will be consolidated into a single how-to-guide for every distributed framework (Spark, Dask, and Ray) - this is WIP

review-notebook-app · 2024-04-24T00:57:09Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

github-actions · 2024-04-24T00:59:06Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	13.1658	6.3772	0.008	0.0046

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	3.6662	6.5325	0.0054	0.0047

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.8	123119	213677	4.68961e+06
total_time	7.5721	6.1557	0.0075	0.0079

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	5.7136	5.6133	0.0073	0.0067

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	8.152	5.7838	0.0075	0.0071

Plot:

nbs/docs/how-to-guides/2_distributed_fcst_dask.ipynb

github-actions · 2024-04-25T07:02:09Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.935	199.132	2571.33	10604.2
total_time	4.8064	4.8169	0.0084	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.22	4110.79	5928.17	18859.2
total_time	5.4804	4.9555	0.0055	0.0047

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	8.4355	6.8426	0.0077	0.0096

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	9.751	12.3839	0.0075	0.0069

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	11.8608	11.3086	0.0074	0.0068

Plot:

github-actions · 2024-04-25T07:08:32Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.4531	3.0568	0.0083	0.0045

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.22	4110.79	5928.17	18859.2
total_time	3.2119	3.5591	0.0053	0.0045

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	3.4369	3.5411	0.0078	0.0068

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	5.2643	3.6144	0.0077	0.007

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	5.7772	3.807	0.0077	0.007

Plot:

github-actions · 2024-04-25T07:11:28Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.2261	3.1536	0.0087	0.0046

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	3.1501	4.0206	0.0057	0.0049

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	3.1807	3.4506	0.0078	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	6.1373	3.5654	0.0075	0.007

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	5.539	7.3245	0.0076	0.0071

Plot:

github-actions · 2024-04-26T03:07:24Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	3.5791	3.1986	0.0084	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	3.2424	3.3006	0.0056	0.0048

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	3.8697	3.862	0.0076	0.0068

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	5.0009	3.7997	0.0074	0.0067

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	5.9385	4.2755	0.0077	0.0071

Plot:

github-actions · 2024-04-26T13:36:07Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	7.774	9.3261	0.0092	0.0054

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	8.1202	9.6165	0.0062	0.0055

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	10.5574	10.7089	0.009	0.0078

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	11.5292	8.8442	0.0082	0.0086

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	10.0955	9.856	0.0081	0.0079

Plot:

nbs/docs/how-to-guides/0_computing_at_scale.ipynb

github-actions · 2024-04-29T20:36:45Z

Experiment Results

Experiment 1: air-passengers

Description:

variable	experiment
h	12
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	12.6793	11.0623	47.8333	76
mape	0.027	0.0232	0.0999	0.1425
mse	213.936	199.132	2571.33	10604.2
total_time	21.0562	25.9814	0.0083	0.0047

Plot:

Experiment 2: air-passengers

Description:

variable	experiment
h	24
season_length	12
freq	MS
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	58.1031	58.4587	71.25	115.25
mape	0.1257	0.1267	0.1552	0.2358
mse	4040.21	4110.79	5928.17	18859.2
total_time	20.5279	16.2358	0.006	0.0049

Plot:

Experiment 3: electricity-multiple-series

Description:

variable	experiment
h	24
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	142.394	196.363	269.23	1331.02
mape	0.0203	0.0234	0.0304	0.1692
mse	63464.7	123119	213677	4.68961e+06
total_time	22.0779	17.7772	0.0079	0.0069

Plot:

Experiment 4: electricity-multiple-series

Description:

variable	experiment
h	168
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	522.427	353.528	398.956	1119.26
mape	0.069	0.0454	0.0512	0.1583
mse	966294	422332	656723	3.17316e+06
total_time	22.1067	19.931	0.0075	0.0073

Plot:

Experiment 5: electricity-multiple-series

Description:

variable	experiment
h	336
season_length	24
freq	H
level	None
n_windows	1

Results:

metric	timegpt-1	timegpt-1-long-horizon	SeasonalNaive	Naive
mae	478.362	361.033	602.926	1340.95
mape	0.0622	0.046	0.0787	0.17
mse	805039	441118	1.61572e+06	6.04619e+06
total_time	24.5639	27.3312	0.0075	0.0071

Plot:

MMenchero · 2024-04-29T21:49:47Z

This is ready for review @AzulGarza @mergenthaler

WIP: Added new how-to-guides

0b4ae83

MMenchero added the documentation label Apr 24, 2024

MMenchero marked this pull request as draft April 24, 2024 00:58

MMenchero mentioned this pull request Apr 24, 2024

Guides/computing at scale #301

Closed

mergenthaler reviewed Apr 24, 2024

View reviewed changes

nbs/docs/how-to-guides/2_distributed_fcst_dask.ipynb Outdated Show resolved Hide resolved

MMenchero added 3 commits April 24, 2024 15:06

Merge branch 'main' into how-to-guides/computing-at-scale

916949e

New versions of how-to-guides for computing at scale

ae646c1

Added missing paragraph

9f72a05

Merge branch 'main' into how-to-guides/computing-at-scale

be3dab6

Minor change to text

ee706d2

MMenchero and others added 3 commits April 25, 2024 21:03

Merge branch 'main' into how-to-guides/computing-at-scale

ee46965

Potential fix to failing checks

0cfc43d

Merge branch 'main' into how-to-guides/computing-at-scale

9fdedd4

add_distributed_to_distributed_tutorials

a63e94f

elephaint marked this pull request as ready for review April 26, 2024 14:00

cchallu reviewed Apr 26, 2024

View reviewed changes

nbs/docs/how-to-guides/0_computing_at_scale.ipynb Show resolved Hide resolved

AzulGarza and others added 6 commits April 29, 2024 14:32

fix: update min version and nixtla_client (#317)

2cecf4c

feat: restrict input forecast (#314)

2e28c68

store x_cols as a variable instead of attribute (#318)

1a1a454

[FEAT] - Tutorials update (Marco) (#311)

303185a

[DOCS] Add tutorials (#306)

bcb7c06

Added note on parallelization

182a5a5

mergenthaler approved these changes Apr 29, 2024

View reviewed changes

MMenchero merged commit 22ef101 into main Apr 29, 2024
14 checks passed

MMenchero deleted the how-to-guides/computing-at-scale branch April 29, 2024 23:23

MMenchero restored the how-to-guides/computing-at-scale branch April 30, 2024 03:22

elephaint deleted the how-to-guides/computing-at-scale branch May 6, 2024 19:18

New versions of how-to-guides for computing at scale #302

New versions of how-to-guides for computing at scale #302

Conversation

MMenchero commented Apr 24, 2024 • edited Loading

Description:

Changes:

review-notebook-app bot commented Apr 24, 2024

github-actions bot commented Apr 24, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

github-actions bot commented Apr 25, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

github-actions bot commented Apr 25, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

Description:

Results:

Plot:

Experiment 4: electricity-multiple-series

Description:

Results:

Plot:

Experiment 5: electricity-multiple-series

Description:

Results:

Plot:

github-actions bot commented Apr 25, 2024

Experiment 1: air-passengers

Description:

Results:

Plot:

Experiment 2: air-passengers

Description:

Results:

Plot:

Experiment 3: electricity-multiple-series

MMenchero commented Apr 24, 2024 •

edited

Loading