Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huge memory consumption with large JSON files #73

Open
eMPee584 opened this issue Oct 31, 2023 · 1 comment
Open

Huge memory consumption with large JSON files #73

eMPee584 opened this issue Oct 31, 2023 · 1 comment

Comments

@eMPee584
Copy link

I just tried to diff two firefox memory reports (73MiB each) and jdiff exploded, had to shoot it down at about 5GiB of RAM usage.. You may try yourself, the reports can be generated on the internal about:memory page.

@corytodd
Copy link
Collaborator

corytodd commented Nov 1, 2023

Related to #49

The algorithm does not scale very well and appears to run in O(n^2) time. I don't have any immediate suggestions other than perhaps preprocessing the output into smaller sections and diffing those. If you have ideas on alternative approaches we'd love to hear them!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants