Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Output referrer to help diagnose crawl errors #126

Closed
exortech opened this issue Dec 19, 2022 · 2 comments
Closed

Output referrer to help diagnose crawl errors #126

exortech opened this issue Dec 19, 2022 · 2 comments

Comments

@exortech
Copy link

Simplecrawler does find and attempt to crawl a lot of invalid uris - especially in script tags. However, it does occasionally find useful broken links. The current output of lighthouse-parade makes it difficult to determine which page contains the broken link. Including the referrer (the page where the broken link was discovered) makes it much easier to identify where the broken link is.

exortech added a commit to doteco/lighthouse-parade that referenced this issue Dec 20, 2022
exortech added a commit to doteco/lighthouse-parade that referenced this issue Dec 20, 2022
@emilienbidet
Copy link

Maybe linked to #131

@calebeby
Copy link
Member

Closing since #128 was merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants