Unsolved Moz crawler not crawling on my site
-
Hi all,
im facing an issue where moz crawler is unable to crawl my site. The following error keeps showing Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag.
This is my robots.txt file : https://www.wearefutureheads.com/robots.txt
I'm not sure what else am I missing.. can anyone help
-
@teikh Hi, thanks for contacting us! Would you be able to write into help@moz.com so that our support team can take a closer look at your query please? Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz crawler not working
Hi Moz crawler keep failing on my site with the error showing : Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. I'm not sure what am I missing out.. this is my robots.txt.. i don't think Im missing anything else.. https://www.wearefutureheads.com/robots.txt can the support team help ?
Moz Pro | | teikh0 -
Unsolved What would the exact text be for robots.txt to stop Moz crawling a subdomain?
I need Moz to stop crawling a subdomain of my site, and am just checking what the exact text should be in the file to do this. I assume it would be: User-agent: Moz
Getting Started | | Simon-Plan
Disallow: / But just checking so I can tell the agency who will apply it, to avoid paying for their time with the incorrect text! Many thanks.0 -
Unsolved Moz can't crawl my site
Moz is being blocked from crawling the following site - https://www.cleanchain.com. When looking at Robot.txt, the following is disallowing access but don't know whether this is preventing Moz from crawling too? User-agent: *
Moz Pro | | danhart2020
Disallow: /adeci/
Disallow: /core/
Disallow: /connectors/
Disallow: /assets/components/ Could something else be preventing the crawl?0 -
Moz rank tracking with new subpage address
Hello, I have built a new website and the subpages web address are new. I haven't made a redirect yet but I am about to do it. How do I continue keeping track of my ranking evolution in moz. Do I need to indicate the new web address ? or once the redirect will be done will moz continue the tracking of my keywords showing the old web address but tracking the new address ? Thank you,
Product Support | | seoanalytics0 -
Remove account from MOZ
I have subscribed for 1 month free Moz trial account. It was free but to subscribe this account I need to put my credit card details. Suddenly at the end of this 1 month term period, Moz tried to cut 149 Dollar from my account without notifying me. But they could not because there were insufficient funds on my credit card. I haven't used any services and would like to remove my account from Moz service? Would appreciate your assistance.
Product Support | | edgarsb0 -
MOZ Profile is not getting update?
It seems like my profile (especially points) is not been updated since the start of this week. any possible reason?
Product Support | | Mustansar0 -
Historical Data in MOZ
Currently I'm sharing a MOZ account with an SEO buddy of mine. So, let’s say we want our own account eventually. Would I be able to export historical keyword data to a new account?
Product Support | | fwymanagement0