• Register
1 vote
29 views

Problem :


I have created the web application and trying to host my site using the wordpress. But when I try to search the name of my site in goole it is showing me below error :

A description for this result is not available because of this site's robots.txt

the content of my robot.txt is only that : User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/

My site is supposed to be the woocommerce site and the blog in the same time,
I know nothing about that error if someone could help me here

Why is this happening to my site. Is there any problem in my site?

7.5k points

Please log in or register to answer this question.

1 Answer

0 votes

Solution :

Your sites robots.txt file must be disallowing the crawling of the page you tried to find in Google Search. This clearly means Google’s bot will not visit your page to read your content.

The robots.txt file always exists at the URL e.g. /robots.txt, e.g url., http://example.com/robots.txt.

You need to look for and check any lines starting with the Disallow: and the below forms of Disallow:

·         Disallow: It allows everything

·         Disallow: / It blocks everything

·         Disallow: /a It blocks every URL whose path starts with /a,
e.g. http://example.com/a, http://example.com/abc, http://example.com/a/b.html etc.

38.6k points

Related questions

0 votes
1 answer 11 views
11 views
Problem: Is there some way to solve this problem: A description for this result is not available because of this site's robots.txt – learn more .
asked Jun 10 Shima 126k points
0 votes
0 answers 5 views
5 views
Problem: Is there some way to solve this problem: A description for this result is not available because of this site's robots.txt – learn more .
asked Jun 10 Shima 126k points
0 votes
1 answer 2 views
2 views
Problem: Having a tough time with this, help please : A description for this result is not available because
asked Jun 25 Chi Omega 168k points
0 votes
1 answer 45 views
45 views
Problem: I'm trying to validate my page with twitter tags in twitter card validator. But all times i get error: "ERROR: Fetching the page failed because it's denied by robots.txt." If i try to watch on my robots.txt: 'http://domain.subdomain.com/robots.txt' it looks ... User-Agent: Twitterbot Disallow: I have tried to change it to: User-Agent: * Disallow: But it did not help. Where am I not right?
asked May 3 muktaa 34.6k points
0 votes
0 answers 16 views
16 views
Problem: Can anyone help me how to the stop fetching the page failed?
asked Mar 26 ashik 14.6k points
0 votes
1 answer 21 views
21 views
Problem: I had a page for my site it throws this error:"Page cannot be reachedThis could be because the page is unavailable or blocked by robots.txt LEARN MORE " Can anyone please suggest me help to allow my page?
asked May 1 salim1 60.6k points
0 votes
1 answer 9 views
9 views
Problem: <meta name='robots' content='noindex,follow' />
asked Jul 2 asha 121k points
0 votes
1 answer 4 views
4 views
Problem: <meta name="robots" content="noindex, nofollow">.
asked Jun 30 Shima 126k points
0 votes
1 answer 9 views
9 views
Problem: Sitemap contains urls which are blocked by robots.txt
asked Jun 27 Sawyer Parviz 167k points
0 votes
1 answer 4 views
4 views
Problem: I am creating a wordpress site on subdomain and I am facing this error: Sitemap contains urls which are blocked by robots.txt. on google search console.
asked May 3 salim1 60.6k points