Releases: website-local/website-scrap-engine
Releases · website-local/website-scrap-engine
0.7.2
0.7.1
0.7.0
0.6.0
npm: prepare for 0.6.0 release Close https://github.com/website-local/website-scrap-engine/issues/720 BREAKING ------------ * resource: custom callback for rewriting savePath * life-cycle: custom callback for rewriting savePath (<https://github.com/website-local/website-scrap-engine/issues/383>) Fix ------------ * cheerio: replace deprecated api Test ------------ * test: migrating to eslint v8 and typescript-eslint v5 * cheerio: fix a test * resource: add a test * ci: run tests on node.js 18.x (<https://github.com/website-local/website-scrap-engine/issues/610>) Misc ------------ * package-lock-resolved: process registry.npmmirror.com * logger: fix type conflict * util: fix compatibility with typescript 4.8 * npm: drop @types/mkdirp * update deps
0.5.0
infra: add changelog for release 0.5.0 BREAKING ------------ * typescript 4.4 support * WorkerMessage: `error` can be `unknown` * StreamingDownloadErrorHook: `e` can be `unknown` * pipeline-executor-impl fix keepSearch param * resource: redirectedSavePath not set after redirect Test ------------ * test: adapt for jest 27 and ts-jest 27
0.4.0
npm: release version 0.4.0 BREAKING ------------ * worker-pool: load based worker pool (#11) * cheerio: adapt for version 1.0.0-rc.10 (#271) * test: adapt for URI.js v1.19.7 (#301) Fix ------------ * downloader: correctly transfer resource body * correctly convent ArrayBufferView to Buffer * worker-pool: fix ready Enhancement ------------ * npm: update * life-cycle: add init and dispose life cycle * resource: optionally redirected savePath * resource: take a log on replacing long search string * save-to-disk: optionally use remote date * worker-pool: log worker errors * worker-pool: custom initializer of worker Test ------------ * worker-pool: basic unit test * save-html-to-disk: initial unit tests with mocked fs * save-to-disk: refactor tests Close https://github.com/website-local/website-scrap-engine/issues/281
0.3.2
0.3.1
0.3.0
npm: bump version to 0.3.0 New Feature ------------- * life-cycle: extract and process source maps (#123) * adapters: async processHtml * life-cycle: add read-or-copy-local-resource * resource: support file protocol (#126) Misc ------------- * types: export type CheerioElement * resource: optional skip replacePath processing in case of parser error (#107) * resource: fix new type of Buffer.from (#116) * build(deps): bump cheerio from 1.0.0-rc.3 to 1.0.0-rc.5 * io: mkdirRetry returns no string * life-cycle: add download-streaming-resource to default * skip-links: skip unix scheme * skip-links: allow file protocol * download: skip non-http url * (BREAKING) resource: refactor createResource (#139)