Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

数据没有生成相关问题 #7

Open
ergouy opened this issue Mar 3, 2022 · 1 comment
Open

数据没有生成相关问题 #7

ergouy opened this issue Mar 3, 2022 · 1 comment

Comments

@ergouy
Copy link

ergouy commented Mar 3, 2022

个人感觉可能hadoop-streaming-3.2.2.jar有问题(我没有去看这个jar包的代码),因为全程没报错,但是表里就是没数据,我定位后发现,dbgen.sh这个脚本没有被执行(因为我在这个脚本中设置的输出并没有输出)。
1
2

@Thesharing
Copy link

Hi, @ergouy Would you mind rewriting your contents with English? It would be readable for English speakers. I met the same issue as yours on Hadoop 3.2.1. I checked the stderr of the mapreduce job dbgen and found an error in it:

/path/to/dbgen.sh: line 32: hadoop: command not found

I'm not quite sure about the root cause. I try to add the environment variables for Hadoop in dbgen.sh and then it works. The data is generated correctly. Therefore, I think maybe you could try my solution.

export HADOOP_HOME='/usr/lib/hadoop-current'
export PATH=$PATH:$HADOOP_HOME/bin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants