Robots.txt & Ads.txt Validator

Inspect whether pasted robots.txt rules restrict Googlebot or AdSense crawler access, then generate an ads.txt record. This tool does not fetch live files or confirm indexing, account status, or ad delivery.

Found in AdSense > Account > Settings > Publisher ID.

Checks run in your browser and this tool does not submit pasted values to a PulseTools application endpoint. Site analytics and third-party services may still load as described in our privacy policy; avoid entering secrets.

This robots.txt validator reviews pasted crawler directives, including whether the effective rules block Googlebot or Mediapartners-Google from the root path. A robots.txt rule manages crawler access; it is not a way to keep a URL out of Google Search. The checker reads the wildcard group and applies a more-specific Mediapartners-Google group when one is present, then reports whether a sitemap directive exists. It does not fetch your live file or confirm how a crawler can access your site.

The second tab formats an ads.txt record using an AdSense Publisher ID. The check runs in your browser and does not submit pasted values to a PulseTools application endpoint. Site analytics and third-party services may still load as described in our privacy policy, so avoid entering sensitive information.

How to Use Robots & Ads.txt Validator

  1. Paste your robots.txt — Copy the contents of your live /robots.txt file into the text box, or start from the example.
  2. Review the checklist — Each rule is marked passed or failed with a plain-language explanation of what it means for crawling.
  3. Review the Mediapartners-Google rule if it fails — If that crawler should be able to request your pages, adjust the relevant rules; this local check cannot confirm live access or account status.
  4. Switch to the ads.txt tab — Enter your AdSense Publisher ID to generate a correctly formatted ads.txt record.
  5. Copy and publish — Paste the generated line into your site's root /ads.txt file and redeploy.

Frequently Asked Questions

Why does robots.txt matter for AdSense specifically?

Mediapartners-Google is a crawler used by AdSense. A robots.txt rule can restrict crawling, but this tool only checks pasted rules and cannot verify a live site, account status, ad serving, or revenue impact.

What does a correct ads.txt line look like?

A standard Google AdSense record reads: google.com, pub-XXXXXXXXXXXXXXXX, DIRECT, f08c47fec0942fa0. The four fields are the ad system domain, your 16-digit publisher ID, the relationship type (DIRECT means you manage the inventory yourself), and Google's certification authority ID, which is the same fixed value for every AdSense publisher.

Where do I find my AdSense Publisher ID?

Sign in to Google AdSense, open Account in the left menu, then Settings, and your Publisher ID is listed there in the format pub- followed by 16 digits. It is also visible in the ad code snippet AdSense gives you to paste into your site.

Does this tool fetch my live robots.txt automatically?

No. Paste the content yourself from a live file or a draft. The tool does not fetch either robots.txt or ads.txt.

Is my publisher ID or robots.txt content ever sent to a server?

The checker runs in your browser and does not submit values to a PulseTools application endpoint. This page may load site analytics or third-party services described in our privacy policy, so avoid entering secrets.

Related Tools & Guides