vote up -1 vote down star

How can a website be crawled every hour?
My website is being crawled on a daily basis but want it to get crawled on an hourly basis. How can I do it?

flag
2  
Become popular enough to warrant it. – Michael Petrotta Nov 25 at 6:09
@Diago, are any/all website problems not allowed to be posted? I see Doctype is a site at the bottom - can questions be moved to them?... I don't really understand it being closed, but surely it is computer related? – Wil Nov 25 at 6:18
i'd guess this is a better question for serverfault. no idea why it got migrated here instead of sent there. – ~quack Nov 25 at 6:33
@WIl. No we can't migrate to DocType. SEO Website questions and crawler questions are not in the scope of SuperUser, as per Jeff. – Diago Nov 25 at 8:16

migrated from stackoverflow.com Nov 25 at 6:15

closed as not computer related by Diago Nov 25 at 6:15

Questions on Super User are expected to generally relate to computer software or computer hardware in some way. This question is very far afield from software or hardware.

Browse other questions tagged or ask your own question.