Create a perfectly formatted robots.txt file in seconds with our visual builder — or validate your existing one for mistakes that could be silently blocking Google from your site.
Used to auto-fill the Sitemap URL.
# Loading preview…
Test, om en specifik URL ville være tilladt eller blokeret af disse regler.
Et robots.txt-fil er en almindelig tekstfil placeret i roden af dit websted (f.eks. https://yoursite.com/robots.txt). It instructs search engine crawlers — like Googlebot — which pages or sections of your site they should or should not crawl and index.
Selvom robots.txt ikke garanterer privatlivets fred (blokerede sider kan stadig vises i søgeresultater, hvis der linkes til fra andre websteder), er det det primære værktøj til at administrere crawl budget — how much of your site Google explores per day. Used correctly, it helps Google focus its crawling on the pages that actually matter for your rankings.
For WordPress sites specifically, a well-configured robots.txt prevents Googlebot from wasting time on admin pages, login screens, and internal search results — directing that crawl budget toward your content instead.
# Allow all crawlers, block admin User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Block bad bots entirely User-agent: AhrefsBot Disallow: / # Sitemap location Sitemap: https://yoursite.com/sitemap.xml
WordPress opretter ikke en robots.txt som standard. Her er præcis, hvad du skal tilføje for optimal SEO.
Vælg "WordPress"-skabelonen ovenfor, indtast dit websteds URL, og din robots.txt vil blive genereret øjeblikkeligt med alle de rigtige regler forududfyldt.
Download den genererede robots.txt-fil og upload den til dit websteds rodmappe ved hjælp af FTP, cPanel File Manager eller din værts filhåndtering.
SkySEOManager has a built-in robots.txt editor and validator under its Tools section. Paste your generated content there directly.
Pro-tip: Valider efter hver ændring
After uploading or editing your robots.txt, always run it through our validator above to check for mistakes. A single typo — like Disallow: / — can block your entire site from Google overnight.
These are the most common errors our validator catches — and the ones most likely to quietly kill your Google rankings.
Et Disallow: / under User-agent: * blocks Googlebot from your entire site. This is the single most catastrophic robots.txt mistake — and it happens more often than you'd think during site builds.
Ikke tillade /wp-content/ prevents Google from loading your stylesheets and scripts. Google renders pages like a browser — if it can't load CSS/JS, it can't properly evaluate your content for rankings.
Ikke inklusive a Sitemap: direktivet betyder, at Google kun skal opdage dit sitemap gennem indsendelse af Search Console. At tilføje det til robots.txt er en nem gevinst, der hjælper Googlebot med at finde alle dine sider hurtigere.
Robots.txt-stier skelner mellem store og små bogstaver på Linux-servere. Disallow: /Admin/ blokerer IKKE /admin/. Brug altid det nøjagtige bogstav for dine faktiske URL-stier.
Ret hele dit websteds SEO
Once your robots.txt allows Google to crawl your site, make sure every page is optimised. SkySEOManager Pro bulk-generates titles, meta descriptions, and image alt text across your entire WordPress site — powered by Gemini AI.
Disallow: /wp-admin/ forhindrer crawlere i at spilde dit crawl-budget på adminsider, der ikke har nogen SEO-værdi. Sørg dog for at tilføje Allow: /wp-admin/admin-ajax.php på næste linje for at holde AJAX-afhængige funktioner (såsom WooCommerce-vognopdateringer) til at fungere korrekt.Gratis for evigt. Ingen konto påkrævet. Din robots.txt er klar på 30 sekunder.