User-agent: * Disallow: /bin Disallow: /assets/courses Disallow: /assets/states Disallow: /assets/smes Disallow: /ws_ftp.log Disallow: /web.config