Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I am currently thinking of how to best set up my server architecture for a high traffic website which scrapes data from the internet and provides a REST API.

One idea is renting root servers in different data centers, another idea is creating my own datacenter. I do have a few technical things that are uncertain and maybe you guys can enlighten me.

Backbone

We have fiber connections that allow 622 Mbit/s connections. So I have this coming into my data center, so far so good!

Switching

Since there is Gigabit switches I also think we don't have a big problem so far, the network infrastructure is still faster than my 622 Mbit/s backbone.

Server Administration

I am considering buying a bundle of 10 used Dell PowerEdge with XEON QuadCore L5335 2.0GHz and 4GB Ram (to deal with all the scraping), I put them in a rack and hook them up to the switches, cooling and redundant power supply. I will have one more powerful machine as my MySQL datacenter. Now comes the first question, how do I most efficiently administer the 10 web servers? I basically only need them to run Tomcat on a basic linux box which to talk to my sql server. Is there some sort of central administration tool I can use to deploy the preconfigured operating systems to the server?

Load Balancing

Now if somebody calls my website the a record points to my IP address, how do I now balance the load so the 10 web servers are stressed equally? Also how do I ensure that these 10 webservers all have the same share of my bandwidth, is that done with managed switches?

share|improve this question

closed as off-topic by Karan, techie007, Breakthrough, gronostaj, Mokubai Jun 30 '13 at 22:50

  • This question does not appear to be about computer software or computer hardware within the scope defined in the help center.
If this question can be reworded to fit the rules in the help center, please edit the question.

add comment

Browse other questions tagged or ask your own question.