Google about the Googlenet and mystery networking device called the Pluto Switch: “We will communicate the idea, but not the implementation.”

Google’s Top Five Data Center Secrets (That Are Still Secret)

“A sign outside the floor dictates that no one can enter without hearing protection, either salmon-colored earplugs that dispensers spit out like trail mix or panda-bear earmuffs like the ones worn by airline ground crews,” he writes. “We grab the plugs. Kava holds his hand up to a security scanner and opens the heavy door. Then we slip into a thunderdome of data….”

But as Levy points out near the end of his piece, Google still views its data center empire as one of its most important advantages over the online competition, and it’s still determined to keep the latest technology hidden from rivals. After its data center technology matures, Google may share bits and pieces with the world at large, but it tends to keep its latest tech to itself. “We try to be as open as possible — without giving up our competitive advantage,” Google infrastructure boss Urs Hölzle told us this summer. “We will communicate the idea, but not the implementation.”

Over the past few years, we’ve learned a lot about the Googlenet, widely regarded as the most advanced operation on the web. But there’s still a lot we don’t know. Most notably, the company is tight-lipped about the networking tech used inside its worldwide data center empire. It says only so much about efforts to build its own servers. And like most of the big net players — including Facebook — it won’t say how many servers it operates worldwide.

It’s worth seeking answers to these questions because Google is very much a bellwether for the rest of the tech world. Its data center creations are typically well ahead of the status quo, and when they’re revealed, they tend to trickle down across the rest of the industry.

Today, the big question marks hang over Google’s networking setup. This past fall, the company acknowledged that it’s designing custom networking gear for moving information between its data centers, taking advantage of an open source protocol called OpenFlow. But this is separate from the networking tech used to move info within its computing facilities. When we met with Hölzle this summer, he declined to discuss such things.

It has long been an open secret that Google designs all its own networking gear, and according to a former Google engineer named JR Rivers, the company has been doing this sort of thing since 2005. This past February, photos of a mystery networking device called the Pluto Switch turned up on an obscure web forum after it was apparently delivered to the wrong place, and though this seems to be a cost-saving Google switch that dates back about three years, the company is still mum on the device.

Some have speculated that Google is using a new breed of optical networking switch in its data centers, but this seems unlikely. Optical switches have traditionally been much too expensive for sending data across the short hops between server racks, and it’s still going to take some technical work to get them to the point where they can replace the copper switches that sit on top of server racks in data centers today.

It’s also unclear whether Google is using OpenFlow inside the data center. Presumably, this is a big part of the company’s internal operation. But Google may also employ some sort of virtual networking scheme along the lines of the technology offered by Nicira, a company recently acquired by VMware in a deal valued at $1.26 billion.

Whereas OpenFlow is a means of remotely managing network hardware, virtual networking lets you build complex networks using nothing but software, making it even easier to adjust the flow of data inside the data center. On the wide area network that moves info between Google data centers, the company uses a network controller built in tandem with Nicira.

Nowadays, Google is rather forthright about the fact that it designs its own servers, and in 2009, it revealed some designs to the world at large. But these have likely evolved over the past three years, and it’s unclear how much. A company spokesperson tells us that at least some of Google’s latest server designs can be seen in this video.

As of last month, we do know that Google equips some of its servers with GPS devices and atomic clocks to help drive a worldwide database known as Spanner. Yes, GPS devices and atomic clocks. Last week, at a systems engineering conference in Los Angeles, Google engineer Jeff Dean told us these devices were relatively inexpensive, indicating they were no more than a few thousand dollars apiece — if that.

No, we still don’t know many servers Google is running. Levy argues that this number doesn’t really matter. “Wandering the cold aisles of Lenoir, I realize that the magic number, if it is even obtainable, is basically meaningless,” he writes. “Today’s machines, with multicore processors and other advances, have many times the power and utility of earlier versions. A single Google server circa 2012 may be the equivalent of 20 servers from a previous generation. In any case, Google thinks in terms of clusters—huge numbers of machines that act together to provide a service or run an application.” And he’s right. But on another level, it does matter.

Because Google designs its own servers — and because it now run cloud services that other companies can use in lieu of servers — it’s driving a massive shift in the worldwide hardware market. According to Intel bigwig Diane Bryant, Google is now Intel’s fifth largest server chip customer, a clear sign that Google is now one of the world’s largest hardware makers — and that it’s siphoning business from the likes of Dell and HP.

Apparently, Google contracts with outside manufacturers when it comes time to actually build its machines. This has encouraged many other companies — includes such names as Facebook and Goldman Sachs — to go straight to “original design manufacturers” in Asia for their own hardware. But this summer, Hölzle told us that Google doesn’t necessarily use Asian ODMs for all its gear. Presumably, the company is using a contract manufacturer located in Canada or Mexico or perhaps South America. Celestica, a manufacturer based in Canada, comes to mind.

How many data centers does Google operate? It owns six in the U.S. and three in Europe, and four more are under construction (three in Asia and one in South America). But the company declines to say how many other “colocation” data centers it uses, sharing data center space with other outfits. When it does co-lo, you can bet it does so discreetly.

The other big point to be made is that Google is in the process of overhauling its infrastructure. Andthat’s a secret too.


21 responses to “ Google about the Googlenet and mystery networking device called the Pluto Switch: “We will communicate the idea, but not the implementation.” ”

  1. Chau says:

    Write more, thats all I have to say. Literally, it seems as though you relied on the video to
    make your point. You obviously know what youre talking about, why waste your intelligence on just posting videos
    to your blog wuen you could be giving us something enlightening to read?

  2. Allen says:

    Hi there, every time i used to check web site posts here in the early hours in the
    break of day, for the reason that i enjoy to gaiin knowledge of more and more.

  3. Linda Saviano says:

    We’re a group of volunteers and starting a new scheme
    in ourr community. Your website offered us with valuable information to work on. You’ve done a formidable job and our whole community will
    be thankful to you.

  4. hack fortnite says:

    What’s up to every body, it’s mmy first pay a quick visit
    of this web site; this web site carries remarkable and
    truly good material for readers.

  5. Arnoldo says:

    Undeniably believe that which you said. Your favorite reason appeared to be
    on the web the easiest thing to be aware of.
    I say to you, I definitely get irked while people think about worries that they just
    do not know about. You managed to hit the nail upon the top as well
    as defined out the whole thing without having side effect , people can take a signal.
    Will likely be back to get more. Thanks

  6. Brenda says:

    If some one needs to be updated with hottest technologies they must be visit this
    web site and be up to date everyday.

  7. Carmine says:

    Your style is really unique in comparison too other folks I have read stuff from.
    Many thanks for posting when you’ve got the opportunity, Guess I
    will just bookmark this site.

  8. Marcela says:

    Hi there to evvery body, it’s my first visit
    of this blog; this website carries remarkable and really good material for visitors.

  9. Lilliana says:

    Good day! This is my first comment here so I just wanted to
    give a quick shout out and say I truly enjoy reading through your articles.

  10. Shareholder says:

    Its such as you read my thoughts! You appear to grasp so much approximately this,
    such as you wrote the guide in it or something. I believe that you simply could do with a few
    p.c. to power the message home a bit, but instead
    of that, this is wonderful blog. A great read. I will certainly be back.

  11. Kieran says:

    I couldn’t refrain from commenting. Very well written!

  12. jetzt says:

    Excellent post. I was checking constantly this blog and I’m impressed!
    Extremely useful information specifically the last part 🙂 I care for such info much.
    I was looking for this certain info for a very long time.
    Thank you and best of luck.

  13. Mr.E says:

    Its such as you learn my mind! You seem to know so much approximately this,
    such as you wrote the book in it or something. I tthink that this
    is great blog. An excellent read. I will definitely be back.

  14. Lina says:

    Saved as a favorite, I love your site!

  15. Attention says:

    Stunning story there. What occurred after? Good luck!

  16. migos x gucci mane type beat says:

    Hi mates, good article and pleasant arguments commented at this place,
    I am truly enjoying by these.

  17. Caitlin says:

    It is in reality a great and useful piece of info. I’m glad that you shared this helpful information with us.

    Please keep us informed like this. Thank you for sharing.

  18. Evolution Rage 5 Review says:

    I wanted to thank you for this excellent read!!
    I certainly enjoyed every little bit of it.

    I have you book-marked to look at new things
    you post…

  19. Jeffrey says:

    Wow , que es lo que estaba buscando explorando para,
    qué cosas información ! existente aquí en este página web , gracias administrador de este sitio web
    página web.

  20. Riley says:

    Ӏ benefit from reading your web ѕіtes. Regards!

  21. Myrtle says:

    Gгeetings! Ι’ve ƅeen reading yоur web site fоr a lοng time nߋw and finally gοt
    tthe courage tօ go ahead aand gіve you a shout oսt frߋm Austin Texas!

    Јust wantеd to mention кeep սp the fantastic job!

Leave a Reply

Your email address will not be published. Required fields are marked *