I would recommend that you download the video of this!! Sheeri posted it here.
The numbers in parentheses are Alexa rankings.
Moderator - Kaj Arno
(1317) Monty Taylor - MySQL
(905) Matt Ingenthron - Sun
(39) John Allspaw - Flickr
(13) Frank mash - Fotolog
(9) Domas Mituzas - Wikipedia
(6) Jeff Rothschild - Facebook
(2) Paul Tuckfield - YouTube
Question One: Number of MySQL servers
MySQL one master/three slaves
Sun four servers
Flickr 166
Fotolog 37
Wikipedia
Facebook 1,800 (900m/900s)
YouTube
Question Two: Number of MySQL DBAs
MySQL 1/10th
Sun 1.5
Flickr 0 (normally 1)
Fotolog 1
Wikipedia Technical Team
Facebook 2
YouTube 3
Question Three: Number of Web Servers
MySQL 2
Sun 160
Flickr 244
Fotolog 70
Wikipedia
Facebook 10,000
YouTube
Question Four: Number of Memcached servers
MySQL 2
Sun 8
Flickr 14
Fotolog 40
Wikipedia 79
Facebook 805
YouTube
Question Five: Version of MySQL
MySQL 5.23-2rc
Sun 5.0.21
Flickr 5.0.51
Fotolog 4.11
Wikipedia 4.4
Facebook 5.0.44
YouTube 5.0.24
Question Six: Operating System on Server
MySQL Fedora
Sun OpenSolaris
Flickr Linux
Fotolog Solaris 10
Wikipedia Fedora/Ubuntu
Facebook Fedora/RHEL
YouTube SuSE 9
Question Seven: What happens if a server fails?
Flickr - Federated setup for failover. Can loose any one side of the shard.
Wikipedia - if a master fails they replace with slave
Facebook - archive binlogs, promote slave
Fotolog - mount snapshots?
Youtube - SAN; shards with a master and multiple slaves so they promote slaves
Question Eight: What is Their Crucial Scaling Technology
Facebook doesn’t use SAN - they do use RAID 10 with 2.5″ drives
Fotolog — UltraSparc T1 — excellent master UltraSparc T2 — excellent slave — uses SAN
This was interesting to me. Frank (Fotolog) said they use a SAN to keep things manageable (only two dbas with the second one just hired). Facebook says they don’t use SAN because they didn’t want to limit themselves.
Next they got off on discussion about power. This varied quite a bit with YouTube pretty much dismissing power concerns. Of course Frank from Fotolog then pointed out that when they (Fotolog) want to expand in a datacenter — the datacenter has to get Google’s approval…hmmm..no wonder Google isn’t worried about it. Fotolog and Facebook were very much in favor of power savings. I think there is more than just saving a little power, you get cooling and space (if smaller of course) savings.
Loading ...
38 comments ↓
[...] has a nice summary of everything that went on together with the numbers here. Posted by Artem Russakovskii in [...]
Thanks for publishing this, I was looking for the notes. These numbers are fun.
[...] (Google is still quite secretive about many numbers-related items it seems). Good coverage of the numbers presented (Colin was plogging, so that document should be released soon and the video should be available on [...]
Hi,
Thanks for writing this. A few corrections:
1. We have 37 database servers. The number posted is the number of instances.
2. In the following sentence, Facebook should be replaced with Fotolog, as it was me who made the point
“Of course Facebook then pointed out that when they (Facebook) want to expand in a datacenter — the datacenter has to get Google’s approval…hmmm..no wonder Google isn’t worried about it.”
3. Our second DBA has yet to start
Thanks
Ughhh, typo in my last comment:
We have 37 database servers. The number posted is the number of databases.
thanks!
Thanks for the updates Frank. Sorry about the mistake. I updated the numbers.
Keith
[...] I can live vicariously through all the people blogging the event. Artem Russakovskii’s notes on the Scaling MySQL - Up or Out? keynote have some interesting numbers: Question One: Number of [...]
They should be running IIS/Windows/MSSQL. Scales better.
I’m sorry, but where is the video you are talking about?
[...] Diamond Notes » Scaling MySQL - - Up or Out? Panel @ UC (tags: configurations mysql server) [...]
So Facebook is built on Rails? I can’t even fathom what their burn rate must be what with the employees, the perks, and the unholy number of web servers.
Cyndy: Facebook is built on PHP: http://blog.facebook.com/blog.php?post=2356432130
[...] Diamond Notes » Scaling MySQL - - Up or Out? Panel @ UC [...]
database server count: twenty
thats for wikipedia
Who mentioned rails and where? Facebook is built on php.
Artem, I was joking at the Rails theory of throwing more servers at a problem. Facebook has an insane number of servers and MySQL instances based on their approximate pageviews.
Updated with link to video.
[...] Среди новостей с прошедшей на прошлой неделе MySQL Conference в Санта-Кларе - кто сколько баз данных MySQL пользует в своих проектах: [...]
[...] Number of Servers at Wikipedia, Facebook, FLickr and YouTube Number of MySQL servers Flickr 166 Facebook 1,800 (900m/900s) (tags: servers scalability mysql) [...]
1,800 MySQL Servers with Two DBAs…
…
[...] Miller points out some notes from a recent MySQL user conference during which Facebook VP of Technology Jeff Rothschild gave [...]
[...] servers, according to Data Center Knowledge, citing comments made by Facebook VP of technology, Jeff Rothschild, at a recent MySQL user conference. (See video of the panel.) Of the 10,000 servers, 1,800 are from [...]
[...] a recent MySQL conference, titled “Scaling MySQL - Up or Out”, Facebook revealed that they are currently operating 10,000 web servers and 1,800 database servers. Another newsworthy [...]
[...] servers, according to Data Center Knowledge, citing comments made by Facebook VP of technology, Jeff Rothschild, at a recent MySQL user conference. (See video of the panel.) Of the 10,000 servers, 1,800 are from [...]
[...] Diamond Notes » Scaling MySQL - - Up or Out? Panel @ UC [...]
Strategy: Break Up the Memcache Dog Pile…
…
[...] Diamond Notes » Scaling MySQL - - Up or Out? Panel @ UC Wow. Facebook = 1,800 MySQL servers, 10,000 http servers, 800 memcached servers. (categories: facebook scaling memcached mysql performance architecture ) [...]
better link to the video:
http://www.technocation.org/content/panel-video%3A-scaling-mysql-or-out%3F
[...] files. 540 terabytes. 475 000 photos served per second. 100 million photos uploaded every week. 10 000 servers. Those are big ass numbers with big ass [...]
10,000 database servers for Facebook!? At a rough guess they would get 30,000 DB transactions per second… Having 10,000 servers seems a bit over the top don’t you think?
[...] at PlentyOf Fish- At a recent MySQL conference, titled “Scaling MySQL - Up or Out”, Facebook revealed that they are currently operating 10,000 web servers and 1,800 database servers. Another newsworthy [...]
[...] MySQL - Up or Out”, Facebook revealed that they are currently [...]
[...] at PlentyOf Fish- At a recent MySQL conference, titled “Scaling MySQL - Up or Out”, Facebook revealed that they are currently operating 10,000 web servers and 1,800 database servers. Another newsworthy [...]
[...] numbers from Facebook on their architecture: 1,800 MySQL servers (900 pairs of master/slave) holding a heavily partitioned data set managed by just 2 [...]
[...] team has done an amazing job. They have ~800 memcached servers handling 95% of the load. The comparative figures for Facebook vs. other major players shows how unique their setup [...]
[...] How good can it get? That’s an interesting question. Salesforce is using 1,000 servers to deliver a service to 1.5 million people, according to the Techcrunch article I linked to above. Consider these numbers for Facebook that are taken from a great posting over at Diamond Notes: [...]
[...] clusters of MySQL and Memcached to deal with storing user data and serving user queries. As reported nearly a year ago, they already had close to 2,000 MySQL boxes and 1,000 Memcached boxes in addition to their 10,000 [...]
Flickr || 166 || 244
Maybe I missed something, but does this mean that Flickr requires only 244 (or 410 = 244 + 166?) servers to work?
The _whole_ Flickr with its millions of photos?!
Leave a Comment