User-agent: * Allow: /BlogLink.asp Disallow: /404.asp Disallow: /blog*.asp Disallow: /register.asp Disallow: /login.asp Disallow: /search.asp /sitemap.asp