One of the most exciting developments in hardware in the last five years has just been announced … by Facebook. No, it’s not yet another smartphone or any kind of personal electronic gadget. It’s something much more important, something with the potential to change the very bedrock of the Internet.
This revolutionary hardware doesn’t sound very impressive — an “open-source modular switch platform” — but what it could do for the Internet is extremely impressive. If it works as Facebook expects it to, it will make the Internet faster, cheaper, cleaner and more reliable.
How could something as boring as a switch change the world? It helps to remember that the Internet is really just a giant computer network, billions of computers all connected to one another by lengths of wire and strands of glass fibre. And wherever these wires and fibres meet, there are switches.
Like electronic traffic lights, switches direct the flow of data across the Internet. They make sure that the photo you’re downloading reaches your computer (or phone) and doesn’t just disappear into the aether or appear on someone else’s computer instead.
Compared to the computers they connect, switches have always been fairly dumb. Little more than glorified plumbing, they are necessary but not very sexy — until now. Facebook’s new platform transforms switches from traffic lights into traffic cops, making them nearly as intelligent as the computers.
This intelligence is incredibly useful because it allows those computers to concentrate on their core functions rather than spending energy directing traffic. This makes the entire network more robust and efficient, because the switches can automatically and intelligently react to changes on the network — a large spike in traffic, for instance — rather than relying on the computers to do so.
True to its frat boy roots Facebook has named the project “6-pack”. Other hardware projects are named things like “Group Hug”. And switches are only part of the equation — Facebook has also designed its own servers, racks and power supplies.
But why would Facebook go to all this trouble to mess around with the plumbing of the Internet? Simple: commercially available switches are not good enough. When more than a billion users log on to your service every day, your data centre geeks quickly learn more about networking than virtually anyone else on the planet, including the people who normally design switches.
Commercial switches have another huge drawback for Facebook: they are closed-source. In other words, the companies that build them own the software that runs them, and they don’t want anyone to mess with it. This reduces Facebook’s ability to customise and control their behaviour, and it explains why Facebook has opted for an open-source model.
Facebook isn’t the only (or even the first) Internet company to build their own hardware. Google has been doing so right from the start in the 1990s, as has Amazon. The size and scale of their needs is not something the traditional hardware makers have ever been able to comprehend or design for.
As a result, both Google and Amazon have hundreds of patents on the custom designed hardware they use in their massive server farms. But Facebook has taken a different route — instead of jealously guarding its innovations, it is giving them away for free.
In 2011, Facebook founded the Open Compute Project, with the aim of sharing its knowledge about running huge data centres with other companies and thus “maximising innovation and reducing operational complexity in the scalable computing space”.
You might question Facebook’s altruism here. It wants data centres that are cheaper to run because it has so many servers that even a 1% saving amounts to millions of dollars. For instance, the data centre it uses to test these innovations already uses 38% less energy than its other facilities. Facebook knows that by sharing the information with other engineers it is more likely to improve its designs faster.
But whatever Facebook’s underlying motives, the Open Compute Project can only be good for the whole planet in the long run. By some estimates, the Internet already consumes more than 2% of the world’s electricity. Within a couple of decades it could be more like 10%. When you’re dealing with tens of billions of switches and computers, every tiny efficiency has huge ramifications.
There’s only one group of people who will not benefit from this burst of innovation — traditional switch manufacturers. Innovations like 6-pack make their products obsolete. Because Facebook does not actually care about the networking market — it’s merely a means to an end — it drives down the prices while ramping up innovation.
As such Facebook joins a long line of corporate giants which, almost accidentally, improved the world on the way to their main goals. Henry Ford invented the moving assembly line, and ushered in the age of mass production while simultaneously doubling his workers’ wages and creating a new middle class.
Ford was not a nice guy — in fact, he was a bigot and a tyrant. All he really wanted was to make his cars better and faster, even if it meant paying people more. The good things that came of that urge were happy accidents, not intentional acts of largesse.
Like Ford Motor Corporation, companies like Facebook, Google and Apple are now so large that they end up changing the industries around them — often by accident. But while some of these changes are painful or even harmful, many are positive. In a couple of decades Facebook may be a distant memory, but its switches will still be powering the Internet.