Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please improve the parse speed of rule config file #306

Closed
ricky1203 opened this issue Jan 10, 2022 · 6 comments
Closed

Please improve the parse speed of rule config file #306

ricky1203 opened this issue Jan 10, 2022 · 6 comments

Comments

@ricky1203
Copy link

I have a large rule list with many domain list (about 69k lines) and cidr (about 8k lines), the glider need about 30 seconds to load the config file, Please optimize the config parsing process for modify the domain rule config file frequently
thanks

@nadoo
Copy link
Owner

nadoo commented Jan 10, 2022

Thanks for your test! glider uses the Golang's command line parser flag to parse cli and config files, maybe it's not suitable for loading large files, I'll consider to improve it later.

@nadoo
Copy link
Owner

nadoo commented Jan 30, 2022

Hi @ricky1203 , I've made a small change to speed up the rule loading process, you can try the attachment if you need.
glider-dev-linux-amd64.zip

@ricky1203
Copy link
Author

@nadoo thanks lot, I run it on arm64, please build with arch arm64 :)

@nadoo
Copy link
Owner

nadoo commented Feb 12, 2022

@ricky1203
Copy link
Author

@nadoo great improvement, only take about 2 seconds to parse the whole rule files

@nadoo
Copy link
Owner

nadoo commented Mar 16, 2022

Closing as v0.16.0 released: https://github.com/nadoo/glider/releases/tag/v0.16.0

@nadoo nadoo closed this as completed Mar 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants