Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

为什么只能爬取一小部分呢 #1

Open
zhoujingang opened this issue Aug 17, 2017 · 3 comments
Open

为什么只能爬取一小部分呢 #1

zhoujingang opened this issue Aug 17, 2017 · 3 comments

Comments

@zhoujingang
Copy link

为什么只能爬取一小部分呢？
@lihaonanGY
Copy link

我也想问为什么只能爬取两个回答的数据呢 是cheerio解析html的问题么。我试了几次以后发现只能 爬取到两个回答的

@qianlongo
Copy link
Owner

@zhoujingang @lihaonanGY 现在只能爬取到服务端同步生成的那段html，因为知乎后续是通过ajax请求数据动态生成的dom。

在考虑增加能够爬取所有数据的功能，谢谢关注。

@qianlongo
Copy link
Owner

@zhoujingang @lihaonanGY 昨晚用新的方式，重写了一版，可以试试，能够下载很多图片，不局限在一部分

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@qianlongo @lihaonanGY @zhoujingang