Correct robots.txt

WordPress Business Themes Forums General Discussion Correct robots.txt

Correct robots.txt

April 2, 2017
Igor Igor
  • Igor
    Newbie 56 points

    Can anyone show the correct file robots.txt for premiumpress themes?

    April 2, 2017 at 3:56 am
  • Ramon
    Senior Member 174 points

    The robots.txt I use is-

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php


    This is also presuming that you use the Google XML sitemaps plugin.

    April 2, 2017 at 8:17 am
  • Pravin
    Newbie 1 points


    Use Yoast Seo to correct your Robots.txt file.

    It should be like this

    April 2, 2017 at 12:46 pm
  • Ramon
    Senior Member 174 points

    Yeah, I used to use Yoast for sitemaps – until I worked out that a vast majority of their links gave out warnings in Google Search Console.

    So now if I’m using Yoast for any reason, I make sure that sitemaps are turned off and Google XML Sitemaps is used instead.

    April 2, 2017 at 1:17 pm

  • Becca
    Newbie 40 points

    I’m curious about this as well. I have tried Yoast and Google sitemap. What is interesting is no matter which setting the listing pages themselves do not show in the sitemap only categories, static pages, author pages but no pages from within the listing manager. If I use Yoast, I get 1 error and Google gets me 17 errors where the file showed info not available?? But again, no actual listing pages appear, just categories. Anyone else run into this? If so, how did you solve it?

    September 13, 2017 at 5:50 pm
  • Anthony
    Senior Member 304 points

    Curious as ever since we started using YOAST we have lost ranks even with the GREEN lights on all pages.

    Do you think using YOAST to “dial-in” the page / keywords and Google then for Sitemap submission is best? Do you have success using that combo?

    Very curious of others thoughts….

    September 13, 2017 at 11:10 pm
Viewing 6 posts - 1 through 6 (of 6 total)

Didn't find what you were after?

Chat with us now

or contact our support team