• Register
1 vote

Problem :

I have created the web application and trying to host my site using the wordpress. But when I try to search the name of my site in goole it is showing me below error :

A description for this result is not available because of this site's robots.txt

the content of my robot.txt is only that : User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

My site is supposed to be the woocommerce site and the blog in the same time,
I know nothing about that error if someone could help me here

Why is this happening to my site. Is there any problem in my site?

6 5 3
7,540 points

Please log in or register to answer this question.

1 Answer

0 votes

Solution :

Your sites robots.txt file must be disallowing the crawling of the page you tried to find in Google Search. This clearly means Google’s bot will not visit your page to read your content.

The robots.txt file always exists at the URL e.g. /robots.txt, e.g url., http://example.com/robots.txt.

You need to look for and check any lines starting with the Disallow: and the below forms of Disallow:

·         Disallow: It allows everything

·         Disallow: / It blocks everything

·         Disallow: /a It blocks every URL whose path starts with /a,
e.g. http://example.com/a, http://example.com/abc, http://example.com/a/b.html etc.

9 7 4
38,600 points

Related questions

0 votes
0 answers 2 views
Problem: Can anyone help me how to the stop fetching the page failed?
asked Mar 26 ashik 11.2k points
0 votes
1 answer 1 view
1 view
Problem: Other Anonymous users should not be able to access the file. So anyone knows out?
asked 15 hours ago Sana8989 8.9k points
1 vote
1 answer 43 views
Problem: I have gained fundamental knowledge on PHP programming after going through online tutorials. Now I am trying to debug the issue related with WP_cron() so I have tried to write the very short app to list the cron() tasks which are pending as shown below. <? php ... -wp-cron-test.php on line 12 Is there anything basic which I am missing about the building of a very simple plugin in PHP?
asked May 30, 2020 Martin K 6.6k points
0 votes
1 answer 2 views
Problem: Hi all I make the easing effect for the notification bar in my WordPress Site but whenever i click the button i get the error as TypeError. TypeError: v.easing[this.easing] is not a function Any suggestion would be great
asked 1 day ago ummesalma 24.5k points
1 vote
1 answer 2 views
Problem: I am unable to find out the solution, Please solve it : sitemap contains urls which are blocked by robots txt
asked Mar 18 MUHAMMAD MUNEEB 82.5k points
1 vote
1 answer 3 views
Problem: Please help me to solve it out : sitemap contains urls which are blocked by robots.txt.
asked Mar 18 MUHAMMAD MUNEEB 82.5k points
0 votes
1 answer 165 views
Problem: I tried to find out the solution on the web when I face this problem but I did not get any fruitful information that I can continue if you read the above question and understand what is the solution of this please cooperate with me- Thanks
asked Mar 21 shamimkhan 15.1k points
0 votes
1 answer 33 views
Problem: I used Google to try to find a solution on the web of the above question, But I got no useful hints. Can I get Pointer information about my problem with this?
asked Mar 21 shamimkhan 15.1k points
1 vote
1 answer 49 views
Problem : Currently I am facing the below issue with one of my website where I am displaying the products randomly. Woocommerce this product is currently out of stock and unavailable. If I go to my WordPress admin and then click on update button for my product and without ... my problem. So I need to find some way to fix my above listed problem permanently so that it will not come back itself.
asked Apr 27, 2020 stewart 4k points
1 vote
1 answer 52 views
Problem : When ever I try to install theme on wamp server it shows me following error download failed. there are no http transports available which can complete the requested request.
asked Nov 11, 2019 peterlaw 6.9k points