I do write my python crawlers and collect data using mysql databases and sometime postgres, but I really want to move to EC2 where I can run more instances and setup more row bust crawling. What I don't know is where to start especially with EC2 and setting up EC2 to do such a task. I search Google for tutorials but was not able to find any I hope this question will become a repository for EC2 with Crawling.
Tell me more
×
Super User is a question and answer site for
computer enthusiasts and power users. It's 100% free, no registration required.
closed as off topic by Karan, TFM, Tog, Windos, Mokubai Mar 13 at 10:31
Questions on Super User are expected to relate to computer software or computer hardware within the scope defined in the FAQ. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about closed questions here.
|
setting up EC2 is actually quite easy. You are allowed to import an image if you have a compatible one, or deploy an image (typically Ubuntu I hear). You can then setup your environment from there. |
|||
|
|