Block internal links
Amrayu78
There's some internal links that seem to be discoverable by guests.
Please do not expose them:
- Add Subtitle Project
- Add Drama, Movie, SP, etc.
All of these actions should behave as they don't exist or be valid to bots or guests.
We've have bots that crawl the site that have found the add subtitle project link and prepopulate it with a title so they can report it.
Amrayu78
Max Romanchenko: Bug.
Max Romanchenko
Amrayu78 I found the reason. This Adopt me button was available to scan for guests/bots on the Forever Lonely page. I fixed it.
Amrayu78
Max Romanchenko: Can we make certain pages on the site not discoverable to guests and bots as well?
Forever Lonely, Advanced Search, Pirate's Booty, Treasure Island, etc?
Max Romanchenko
Amrayu78 Sure. These pages (Forever Lonely, Advanced Search, Pirate's Booty, Treasure Island,) now display restricted message for guests and banned roles (please see screenshot).
I also marked these pages as noindex and nofollow in the settings of the seo plugin to exclude these pages from sitemap and bot scanning.
Amrayu78
Max Romanchenko: Can we make these have an error of 404 instead? I don't want guests or bots to know that they even exist. Thanks!
Max Romanchenko
Amrayu78 Of course, I made the necessary changes. Please check.