Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

What is the best way of forcing googlebot to crawl the page?

I've put up Google analytics, registered site with Google webmaster. I've done great deal of SEO work on the website with keywords and titles, I took care of microdata. I submitted the site anonymously, I successfully fetched the site and submit for indexing couple of days ago and still nothing.

Last time googlebot visited the site is almost 1 month ago and the indexed content is now obsolete.

Am I missing something? or is it just a slow process??

share|improve this question

closed as off topic by Renan, ChrisF, 8088, Canadian Luke, BBlake Oct 4 '12 at 15:03

Questions on Super User are expected to relate to computer software or computer hardware within the scope defined by the community. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about reopening questions here.If this question can be reworded to fit the rules in the help center, please edit the question.

Have you already tried attaching a sitemap to your website as you didn't mention it? If not you should look into it - you can get an XML sitemap automatically generated here - then you just have to upload the file to the same location as your files.

Sitemaps are a way to tell Google about pages on your site we might not otherwise discover. In its simplest terms, a XML Sitemap—usually called Sitemap, with a capital S—is a list of the pages on your website. Creating and submitting a Sitemap helps make sure that Google knows about all the pages on your site, including URLs that may not be discoverable by Google's normal crawling process. - Google

Although in your case a sitemap should definitely help your cause, it is not always 100% that all URLS will be crawled or indexed:

Google doesn't guarantee that we'll crawl or index all of your URLs. However, we use the data in your Sitemap to learn about your site's structure, which will allow us to improve our crawler schedule and do a better job crawling your site in the future. - Google

Although, having one wouldn't hurt:

In most cases, webmasters will benefit from Sitemap submission, and in no case will you be penalized for it. - Google

share|improve this answer
sitemap is on my list sometime tonight – mamadum Oct 4 '12 at 14:47

You can't force the Google bot to crawl anything; it will progress based on its own arcane evaluation criteria. From Webmaster Tools Help:

Crawls are based on many factors such as PageRank, links to a page, and crawling constraints such as the number of parameters in a URL. Any number of factors can affect the crawl frequency of individual sites.

The best things you can do are to get people linking to your site and to update it regularly.

share|improve this answer
yeah I got that, so what actually does that site fetching and indexing request? I'm talking about this… – mamadum Oct 4 '12 at 14:52
Submitting a URL does not guarantee a crawl, it merely suggests it for consideration. If Google already knows the page exists, it will probably make very little difference to when the page is actually next crawled. The main reason they provide it is so they can capture websites (or networks of websites) that aren't linked from externally. – colons Oct 4 '12 at 21:12

Not the answer you're looking for? Browse other questions tagged .