Skip to content

Commit

Permalink
Added note on parallelization
Browse files Browse the repository at this point in the history
  • Loading branch information
MMenchero committed Apr 29, 2024
1 parent bcb7c06 commit 182a5a5
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion nbs/docs/how-to-guides/0_computing_at_scale.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,15 @@
"These are the general steps that you will need to follow to use `TimeGPT` with any of the supported distributed computing frameworks. For a detailed explanation and a complete example, please refer to the guide for the specific framework linked above."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"::: {.callout-important}\n",
"Parallelization in these frameworks is done along the various time series within your dataset. Therefore, it is essential that your dataset includes multiple time series, each with a unique id. \n",
":::"
]
},
{
"cell_type": "markdown",
"metadata": {},
Expand All @@ -74,7 +83,7 @@
"\n",
"Consider using a distributed computing framework if your dataset:\n",
"\n",
"- Consists of millions of observations.\n",
"- Consists of millions of observations over multiple time series.\n",
"- Is too large to fit into the memory of a single machine.\n",
"- Would be too slow to process on a single machine.\n",
"\n",
Expand Down

0 comments on commit 182a5a5

Please sign in to comment.