Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance Security: Mask/Remove Reduct sensitive spark properties from session info #1071

Open
katymufler opened this issue Jul 1, 2024 · 0 comments

Comments

@katymufler
Copy link

Description:

Currently, Lighter session info page may inadvertently expose sensitive information (e.g., database credentials, API keys) as part of spark properties.

I think it would be useful to create a comprehensive list of sensitive Spark properties that should be masked or removed from session info. This could include:
spark.hadoop.hive.metastore.uris
spark.datasource.jdbc.url
Any property containing password, secret, key, etc.

Also Allow users to customize the list of sensitive properties and the masking/removal behavior via configuration options.

Regards, Katy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant