robot(s).txt exists on the Web Server

Web Servers can use a file called /robots.txt to ask search engines to ignore certain files and directories. By nature this file can not be used to protect private files from public read access. OpenVAS Vulnerability Test $Id: webserverrobot.nasl 6053 2017-05-01 09:02:51Z teissa $ Description:...