Map from my browser

When you need it

Some hosts and firewalls (often Cloudflare, Wix and Squarespace protection) block crawlers. When that happens, the Site map page says "Your site is blocking bots" and offers three fixes:

• Map from my browser: the fastest. Your browser reads the pages for us.
• Allow our crawler: the best long-term fix. Allow the user agent ChattishBot in your firewall, then click Run the crawl again.
• Paste page addresses: list the pages yourself, one per line.

Before you start

Map from my browser needs two things:

1. The snippet installed on your site, because the mapping runs inside the Chattish panel on your own pages.
2. A verified domain, because it sends pages to Chattish on your behalf.

The two clicks

1. Click Create mapping link. The link works only on your site's address, for one run, and expires after 10 minutes.
2. Click Open my site and start mapping. Your site opens in a new tab with the Chattish panel asking "Map your site for Chattish?". Click Start mapping.

Keep that tab open until it says "Done". You can stop it at any time.

Why two clicks instead of one

The first click creates a short-lived link in the dashboard. The second opens your site in a separate tab that has no connection back to the dashboard, so a page on your site can never reach into your Chattish account. The link's secret sits after the # in the address, which browsers never send to any server, and the panel removes it from the address bar as soon as it reads it.

What your browser reads

• Only public pages on the same site. Requests are made without your cookies, so pages you see because you're logged in are never read.
• Nothing that your robots.txt blocks.
• One page about every third of a second, up to 500 pages per run (or your plan's page limit, if lower).

Each mapping link is used once. Creating a new one cancels any older link.