How to get personal pages crawled by Google

How can I get personal pages of my website that are crawled and indexed by Google?

perhaps this is not very "conditional", but I want my personal "link" pages to appear in the google index, but then registration is required to register the page.

+3
source share
5 answers

EDIT . Based on the addition of "maybe this is not very" conditional ", but I want my personal" link "pages to appear in the google index, and then registration is required to register the page." To the question: You can check the User Agent in your php code to basically allow google to see pages if he was a registered user (Google agent for Google is “Googlebot / 1.0”, and you can search to find user agents for others common engines).

However, this behavior is specifically against google rules, and they can and will remove your site from the index if they catch you on it. Their policy is that you should not treat googlebot differently than any random person who visits your site.

( ). - sitemap, google . , Sitemap, , , , "root" (/) (.. ) , , . - -.

, , google ?

+3

, , robots.txt . , .

+2

, Google ?

. , SEO'd, " " , .

Google, , , Google . .

, - .

+1

Google

  • - Google
  • ( ) HTTP

  • -.

"private".

+1

I'm going to assume that all the other previous defendants misunderstand you. When I read this, you are not asking how to get Google to index your pages, but how to get a list of all the pages that Google has already indexed on your site? If so, you should take a look at Google Webmaster Tools .

+1
source

Source: https://habr.com/ru/post/1729330/


All Articles