Google Custom Search Engine does not produce expected search result

Question

I am trying to create a new Google search engine, but when I try to fulfill any query, the search engine does not give me the expected search result. In some queries it works fine, but for other queries it says "no result".

I tried to add the URL of the website I wanted to find, but there are certain pages and keywords that do not appear in the search results when I try to find the keyword for this page. I am tired of adding both the URL of the main page and the URL of the sub page I want to find, but nothing works. There are some subpages to the main URL that fall into the search result.

Answer 1

it happened to me. This is because the URL you specify on google must match the address of the server on which your site is hosted. For example, I created a site with a custom google search ( mainstreetbd.com ), and when I tested it on my server, google search returned no Results. But when I did this at the specified URL, it works fine.

Answer 2

Some web pages tell search engines how to index their web page in a robots.txt file.

For example: https://stackoverflow.com/robots.txt

(If the site has one, it should be under http: //URL/robots.txt immediately after the domain name)

robots.txt , , , .