Generate the robots meta tag and X-Robots-Tag HTTP header. Toggle noindex, nofollow, noarchive, nosnippet, max-snippet, and max-image-preview, then copy the tag or header.
Free, no sign-up — one of the SaaSQuickStart Content & SEO tools.
The robots meta tag tells search engines how to treat a single page: whether to index it (noindex), follow its links (nofollow), show a cached copy (noarchive), or limit the snippet length. The X-Robots-Tag HTTP header does the same thing but works for any file type — useful for PDFs and images where you can’t insert a meta tag. Everything runs in your browser.
robots.txt controls crawling (whether Googlebot fetches a URL), not indexing. To keep a page out of the index, use the robots meta tag or X-Robots-Tag header with noindex. Importantly, if you block a URL in robots.txt, Google can’t see the noindex tag — so don’t do both.
Use the HTTP header for non-HTML resources (PDF, DOCX, images) that can’t contain a <meta> tag, or when you want to apply a directive at the server level across many URLs at once.
It lets Google show a large image thumbnail for your page in results and Discover. It’s often recommended for content and news sites to earn bigger, more clickable results.
No — index,follow is the default behavior, so an explicit tag is redundant. You only need this tag when you want to change the default (e.g. noindex a thank-you page or paginated archive).