Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDP: We added code to run the patch on the active name node only. #25

Open
nashvm opened this issue Dec 15, 2021 · 5 comments
Open

HDP: We added code to run the patch on the active name node only. #25

nashvm opened this issue Dec 15, 2021 · 5 comments

Comments

@nashvm
Copy link

nashvm commented Dec 15, 2021

We run the patch with ansible on all machines.

Added code in patch_hdfs_tgz.sh:

kinit -kt $keytab $principal # under this line.

hdfs haadmin -getAllServiceState | grep active | grep hostname
active_nn=$?
if [ $active_nn -eq 1 ]
exit 0
fi

@jtran-cloudera
Copy link
Contributor

Thanks for the suggestion. We will look into this. Note that there is already code which ensures via a marker file that even when the HDFS phase runs on multiple hosts, only one will modify the HDFS contents.

@dins2k2
Copy link

dins2k2 commented Dec 16, 2021

Thanks for the suggestion. We will look into this. Note that there is already code which ensures via a marker file that even when the HDFS phase runs on multiple hosts, only one will modify the HDFS contents.

But this command ps -efww | grep org.apache.hadoop.hdfs.server.namenode.NameNode | grep -v grep in hdp_log4j_jndi_removal.sh returns true for both the active and standby NNs, so patch_hdfs_tgz.sh script run twice which will be duplicate effort and time consuming.

@jtran-cloudera
Copy link
Contributor

Ah, this was on HDP? I see that the marker file logic doesn't exist there.

@dins2k2
Copy link

dins2k2 commented Dec 18, 2021

Ah, this was on HDP? I see that the marker file logic doesn't exist there.

Yes

@dins2k2
Copy link

dins2k2 commented Dec 21, 2021

@jtran-cloudera Any update on fixing this?

sdevineni pushed a commit that referenced this issue Dec 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants