Virtual Data Centers Could Replace Big Box Model

CNBC:

Even as more communities rise up against the proliferation of massive, energy- and water-sucking data centers, some big players in housing are betting consumers would be willing to put mini data centers right on the walls of their homes.

Span is a California-based startup that originally launched with “smart” electrical panels designed to help homeowners save money on their electricity bills. Now, with the help of Nvidia, it has come up with something new — small, fractional data centers, or “nodes,” called XFRA units, that can be put on the side of residential homes and small commercial businesses. 

The idea is to take advantage of unused electrical capacity on local grids, which the Span smart panels can pinpoint. The rapid growth of artificial intelligence has strained power grids nationwide and, in some cases, resulted in higher electricity bills for homeowners. 

A network of these nodes, communicating with each other across the country, is the equivalent of a small to mid-sized traditional data center, which could either augment an existing center or negate the need to build a new one, Span says. Hyperscalers and AI cloud providers just tap into the network as they would a traditional data center. 

“Fundamentally, it’s an infrastructure play,” said Arch Rao, founder and CEO of Span. “We’re uniquely positioned to build infrastructure that can simultaneously help us meet what is clearly an insatiable demand for more compute, much more cost effectively, while benefiting individual consumers.”

The small, white XFRA boxes with the hardware inside are put on the outside of homes, alongside regular HVAC and electrical systems. Span says it can install 8,000 XFRA units about six times faster and at five times lower cost than the construction of a typical centralized 100 megawatt data center of the same size. 

Span collaborated with Nvidia, using its technology in the system, including one of the first-to-market uses of liquid-cooled Nvidia RTX PRO 6000 Blackwell Server Edition GPUs. These require no fans, so there is no noise.

“We’re trying to get access to power, and there’s a lot of power right now on the grid. But, unfortunately, to come up with large loads for big data centers — it’s a challenge,” said Marc Spieler, senior managing director of global energy industry at Nvidia. “The ability to leverage existing locations that have access to power makes a lot of sense. … We believe that we can bring on AI solutions quicker, and it should add to the affordability story.”

One thought on “Virtual Data Centers Could Replace Big Box Model”

Leave a Reply to jimbillsCancel reply

Discover more from This is Not Cool

Subscribe now to keep reading and get access to the full archive.

Continue reading