# robots.txt User-agent: Mediapartners-Google* Disallow: User-agent: * Disallow: /onlinekommunikation/ Disallow: /ip/ Disallow: /lena/ Disallow: /job/ Disallow: /rss/ Disallow: /moblog/ Disallow: /newsfeeds/ Disallow: /blog/archives/ Disallow: /blog/pivot/db/ Disallow: /blog/pivot/includes/ Disallow: /blog/pivot/index.php Disallow: /blog/pivot/langs/ Disallow: /blog/pivot/modules/ Disallow: /blog/pivot/templates/ Disallow: /tutorial/browser/grundlagen/ Disallow: /fotos/ Disallow: /blog/tag/ Disallow: /blog/category/ Disallow: /blog/pivot/ Disallow: trackback Disallow: feed Allow: /blog/feed/ User-agent: Slurp Crawl-delay: 600 User-agent: Teoma Crawl-delay: 600