You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Concatenating all blocks into a huge array prior to counting can lead to excessive memory usage, see #132.
Potential solutions (not mutually exclusive):
Specify correct dtype instead of always using 64-bit integers.
Use for loops over windows while tallying. This would allow us to skip having to allocate memory for the concatenated array entirely. Numba could be used to speed up the for loop if speed becomes an issue because of it.
The text was updated successfully, but these errors were encountered:
Concatenating all blocks into a huge array prior to counting can lead to excessive memory usage, see #132.
Potential solutions (not mutually exclusive):
dtype
instead of always using 64-bit integers.The text was updated successfully, but these errors were encountered: