Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to read the json dataset from hadoop or file #8

Open
nihaosheng opened this issue Jun 19, 2021 · 0 comments
Open

Fail to read the json dataset from hadoop or file #8

nihaosheng opened this issue Jun 19, 2021 · 0 comments

Comments

@nihaosheng
Copy link

nihaosheng commented Jun 19, 2021

我尝试着复现论文Balance-aware distributed string similarity-based query processing system里面的数据集
然而我的代码却无法读取数据,无论是hdfs还是本地文件
image

“val sqlContext = new org.apache.spark.sql.SQLContext(sc)

// A JSON dataset is pointed to by path.
// The path can be either a single text file or a directory storing text files.
val path = "hdfs://user/hni/Software.json"
val people = sqlContext.read.json(path)”
无论是内存跟权限都没有问题,请问您遇到这种问题吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant