Skip to content

Latest commit

 

History

History
9 lines (8 loc) · 605 Bytes

README.md

File metadata and controls

9 lines (8 loc) · 605 Bytes
Raw

yandex-q

Scripts that were used to scrape and process data from Yandex.Q. The resulting dataset can be found here.
Some scripts are messy, but they get the job done.

Scripts used

  • parse_questions_search.py - to parse questions by searching all 4 letter combinations, because of the 1000 items limit per search
  • parse_question_ids.py - to parse question ids by using question recommendation endpoint
  • get_ids.py - to extract ids from questions that were retrieved from search
  • parse_qa.py - to parse all question info from ids collected