User-agent: * #allows all search engine spiders. Disallow: /admin/ #disallow them to crawl secretcontent folder. Disallow: /css/ Disallow: /design/ Disallow: /design/ Disallow: /dir_servis/ Disallow: /fajlovi_admin/ Disallow: /funkcije/