# robots.txt for MEPCO Bill Website # Allow all Google bots full access User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: Googlebot-News Disallow: User-agent: Googlebot-Video Disallow: User-agent: Googlebot-Mobile Disallow: # Allow Bing bots User-agent: Bingbot Disallow: User-agent: Slurp Disallow: # Block known bad bots & SEO scrapers User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: YandexBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Sogou Disallow: / User-agent: Exabot Disallow: / User-agent: CCBot Disallow: / User-agent: PetalBot Disallow: / User-agent: ZoominfoBot Disallow: / # Block social preview bots (optional) User-agent: Facebot Disallow: / User-agent: Twitterbot Disallow: / # General rules User-agent: * Crawl-delay: 10 Disallow: # Important sitemap Sitemap: https://mepccobill.pk/sitemap_index.xml