Manual robots.txt Manager.

Custom robots.txt per sales channel and domain: templates, preview with hints, live check and what can get in the way of delivery.

To the product pageGet in touch

What the plugin does

From version 6.7.1 on Shopware delivers the robots.txt itself, with the same default rules for every domain. The plugin replaces this output with your own text per sales channel. If a single domain needs something different, it gets its own version.

If nothing is stored for a domain or the version is switched off, Shopware delivers its default as usual.

Shopware 6.6 and 6.7.0: There they do not deliver the robots.txt yet, so the plugin answers the request itself. This requires a domain without a path, and delivery happens only when an own version is active. From 6.7.1 on the restriction no longer applies.

Getting started

  1. Install and activate the plugin, then clear the cache.
  2. Open the robots.txt Manager under Extensions, Stone & Water - Plugin Suite.
  3. In the Overview tab, check whether a red notice is shown.
  4. Click "Edit channel default" for a sales channel.
  5. Adjust the suggested content or insert a template.
  6. Save. The change is live right away, the cache is purged selectively.
  7. Use "Live check" to confirm the domain delivers the new version.

Channel default and own version

The channel default applies to all domains of a sales channel. Select a single domain in the editor to create its own version.

A robots.txt always applies to a whole host. Domains with a path, such as shop.de/en, therefore share the robots.txt of shop.de.

Delivery order:

  1. Active version of the domain
  2. Active channel default
  3. Shopware default

Editor settings

  • Deliver custom robots.txt: Off means the domain falls back to the channel default or the Shopware default. The content stays stored.
  • Add sitemap entries automatically: adds a sitemap line for every domain on the host. Lines already in the text are not repeated.
  • Template: replaces the content with a template after confirmation.

Templates

  • Shopware default - the rules Shopware 6.7 delivers itself, including access to theme files, media and thumbnails.
  • Shopware default, block AI training - additionally blocks GPTBot, ClaudeBot, CCBot, Google-Extended, Applebot-Extended, meta-externalagent and Bytespider. Search assistants stay allowed.
  • Shopware default, Google unrestricted - Googlebot and Googlebot-Image may do anything, everyone else gets the default.
  • Allow everything - no restrictions.
  • Block everything - blocks the whole site, for staging environments for instance.

Preview and hints

The preview shows exactly the text that will be delivered, including the sitemap lines. Below it the plugin points at typical mistakes:

  • Disallow: / for all crawlers blocks the whole site
  • lines without a colon or unknown directives
  • rules before the first user-agent line
  • paths not starting with / or *
  • sitemap without a full address
  • noindex and crawl-delay, which Google ignores
  • files over 500 KiB, Google reads no more

The hints do not block saving.

Live check

"Live check" fetches the domain's robots.txt from the server and compares it with the stored version. Possible results:

  • Matches the stored version - everything is fine.
  • Cache serves an older version - clear the cache or wait a moment.
  • Different robots.txt - usually a file in the public folder or a web server rule.
  • Shopware default - no own version is active for this domain.
  • Not reachable - the server cannot reach itself, open the address in a browser.

From the editor the fetched content can be used as a starting point with "Copy into editor". Sitemap lines are removed if automatic completion is switched on.

Notices in the overview

  • Physical robots.txt in the public folder - the web server serves this file directly, Shopware never gets a turn. "Disable file" renames it and keeps it as a backup.
  • robots rule in the .htaccess - a redirect prevents delivery by Shopware. Remove the rule by hand.
  • Staging mode active - Shopware then blocks all domains. Your own content takes effect only after switching it off.

Uninstalling

Uninstalling without "keep data" removes the table with all content. After that Shopware delivers its default again.

Support

We answer questions directly. Write to us via the contact form.

All settings

Every setting of the plugin with its default value and explanation, in the same order as in the administration. The texts come straight from the plugin (version 1.0.3).

Selection

Sales channelDefault: no selection

Selects the sales channel whose robots.txt is edited. Without own entries the channel delivers the Shopware default; the editor suggests it when first opened, nothing is stored until you click Save.

DomainDefault: All domains of the sales channel

Edits either the channel default for all domains of the channel or a version of its own for a single domain. A domain without its own version uses the channel default.

Settings

Deliver custom robots.txtDefault: on

Off: the domain falls back to the channel default or the Shopware default. The content stays stored.

Add sitemap entries automaticallyDefault: on

Adds a sitemap line for every domain on this host. Lines already in the text are not repeated.

TemplateDefault: none

Replaces the content with a template, which you can then adjust freely: Shopware default, Shopware default with AI training blocked, Shopware default with Google unrestricted, allow everything, or block everything. The plugin asks before replacing.

ContentDefault: Shopware default

The text of the robots.txt as delivered for the selected domain. Below it, the plugin checks the content continuously, for example for lines without a colon, rules before the first User-agent line, sitemaps without a full URL, or a Disallow: / for all crawlers.

Availability

Directly through Stone & Water

Available now

FreePermanently0,00 €

No booking needed, no term.

Download the free Plugin Suite and upload it in the admin, no SSH needed. It installs and updates the plugin with one click. You buy the licence directly from us, with an invoice from us and support straight from the developer.

Download Plugin Suite+49 2555 9997342

Shopware Store

In preparation

The plugin will be listed in the official Shopware Community Store. Installation and automatic updates then run through the plugin manager in the backend, billing through your Shopware account. We will link it here as soon as it is available.