Outdated docs pages in search results

[nschneid]

A Google search for "npmod" includes some pages like this one (note "docs" in the URL): https://universaldependencies.org/docs/en/dep/nmod-npmod.html

The current page is https://universaldependencies.org/en/dep/nmod-npmod.html

Should the "docs" subdirectory be excluded e.g. with robots.txt?

[dan-zeman]

@fginter @spyysalo Any idea why this folder exists on the website? I don't see it in the underlying GitHub repo, so it must have survived at another place where GitHub copies the pages when they are ready, I suppose?

Note that https://universaldependencies.org/docs/ is a redirect to https://universaldependencies.org/. This is something we probably wanted when we removed "/docs" from the URL but I don't know where it is configured either.

---

https://stackoverflow.com/questions/16065693/github-pages-still-serving-deleted-files
carpentries/styles#544