# robots.txt file the linuxbit.net web server. # It prevents Search engines from crawling and indexing # the /cgi-bin/ (and potentially other directories as they are added here) # User-agent: * Disallow: /cgi-bin/