Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove usages of commons-text library lower than 1.10.0 #7850

Merged
merged 3 commits into from
Apr 21, 2023
Merged

Conversation

iprentic
Copy link
Contributor

@iprentic iprentic commented Apr 18, 2023

Version not vulnerable to CVE-2022-42889

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

build.gradle Outdated
@@ -96,7 +96,7 @@ project.ext.externalDependency = [
'guice': 'com.google.inject:guice:4.2.3',
'guava': 'com.google.guava:guava:27.0.1-jre',
'h2': 'com.h2database:h2:2.1.214',
'hadoopClient': 'org.apache.hadoop:hadoop-client:3.2.4',
'hadoopClient': 'org.apache.hadoop:hadoop-client:3.3.5',
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This worries me a bit. Our Spark components are sensitive to this version. I would instead look to control the transitive dependency here too. If there is a newer 3.2.x that would be fine for sure, but I do believe they are not releasing any more minor versions there.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are no new 3.2.x versions... I put this out to see if the build would pass but it looks like not.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iprentic - I took a look this is actually very limited in just the datahub-upgrade module and that it is only involved with reading parquet, not a full Spark stack. My initial assumption here was wrong. The only thing I noticed is that the the hadoop commons library a few lines down should be matched with this version. So 3.3.4 -> 3.3.5 for both. I've added a common variable to make sure they are alignment.

@david-leifker
Copy link
Collaborator

@iprentic once this is green we can merge!

@iprentic iprentic merged commit fa260fc into master Apr 21, 2023
@iprentic iprentic deleted the commons-text branch April 21, 2023 17:30
iprentic added a commit that referenced this pull request Apr 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants