Skip to content

Releases: Producters/express-crawler-snapshots

0.5.0

01 Aug 10:21
Compare
Choose a tag to compare
  • caching disabled - library I was using is broken, not sure if worth re-implementing
  • errors thrown inside rendered webpage are logged to logger

0.4.0

27 Sep 08:03
Compare
Choose a tag to compare

0.3.3

07 Sep 19:12
Compare
Choose a tag to compare
  • Readme updated
  • default timeout increased to 10000ms
  • default delay increased to 300ms
  • default maxPageLoads set to 100

0.3.2

04 Sep 07:51
Compare
Choose a tag to compare
  • maxPageLoads options added to restart phantomjs every x page loads, for preventing mem leaks

0.3.1

04 Sep 07:25
Compare
Choose a tag to compare
  • make 'loadImages' phantomjs option optional, because of a bug that introduces memory leak with older QT versions:

ariya/phantomjs#11390
https://bugreports.qt.io/browse/QTBUG-34494

0.3.0

29 Aug 18:51
Compare
Choose a tag to compare
  • 'attempts' option. If set > 1, multiple attempts to render page will be made in case of phantomjs timeout or crash

0.2.0

18 Jul 14:33
Compare
Choose a tag to compare

0.1.5

01 Jul 20:12
Compare
Choose a tag to compare
  • Detect google + snippet bot via UA string

0.1.4

19 Jun 17:26
Compare
Choose a tag to compare
  • Fix bug where tag was not included in output
  • Add more logging to phantomjs page creation

_escaped_fragment_ handling fixed

26 May 18:31
Compare
Choose a tag to compare

reimplemented escaped_fragment url transform as specified by google