Head over to our on-demand library to view periods from VB Remodel 2023. Register Right here
The growing use of synthetic intelligence (AI) means a speedy improve in knowledge use and a brand new period of potential knowledge middle business progress over the following two years and past.
This shift marks the start of the “AI Period,” after a decade of business progress pushed by cloud and cell platforms, the “Cloud Period.” Over the previous decade, the most important public cloud service suppliers and web content material firms propelled knowledge middle capability progress to unprecedented ranges, culminating in a flurry of activity from 2020 to 2022 because of the surge in on-line service utilization and low-interest-rate financing for tasks.
Nevertheless, there have been important shifts throughout the business prior to now yr, together with a rise in financing prices, construct prices and construct instances, mixed with acute energy constraints in core markets. For instance, typical greenfield knowledge middle construct instances have prolonged to 4 or extra years in lots of world markets, roughly twice so long as a number of years in the past when energy and land had been much less constrained.
In the meantime, the most important web firms are partaking in an accelerating race to safe knowledge middle capability in strategic geographies. For every of the worldwide know-how firms, AI is each an existential alternative and a risk with distinctive challenges for data center capacity planning. These dynamics are prone to end in a interval of elevated volatility and uncertainty for the business, and the stakes and diploma of issue of navigating this atmosphere are increased than ever earlier than.
Versatile knowledge middle capability planning can permit for altering inputs in quickly altering markets. Trying again, the Cloud Period gave rise to a totally new set of market-propelling clients with totally different wants than earlier generations. Trade gamers that had been in a position to tackle these evolving wants received an outsized share over the past business cycle.
Key concerns for knowledge middle business executives and their buyers ought to be:
- State of affairs planning to capitalize on the evolving wants of the market.
- Proactive, but versatile, methods for market choice, facility design and different future choices.
New period of shopping for knowledge middle capability: Programmatic shopping for is over
Throughout the Cloud Period, public cloud service suppliers grew to become extra subtle in forecasting the ramp-up of demand and adopted a extra programmatic method to procuring capability. For a number of years, these consumers usually procured comparatively customary quantities of third-party capability structured with an preliminary dedication, adopted by a reservation and a proper of first provide for the same amount. Nevertheless, as demand ultimately outpaced the unique forecasts, cloud service suppliers (CSPs) needed to return to the marketplace for extra capability.
Over the previous two years, buyer conduct has notably shifted: With the good thing about hindsight, knowledge middle clients at the moment are more and more prepared to signal considerably bigger offers, notably in markets the place energy is presently comparatively extra out there to keep away from last-minute scrambles for extra capability and complex footprints. They’ve additionally demonstrated a willingness to lease capability at increased costs in markets the place capability is constrained.
Key consideration for executives and buyers:
- Prior fashions and expectations may have adjustment to replicate this Evolution in buyer shopping for conduct.
Self-build knowledge middle growth approaches are evolving
The biggest cloud and web firms, the hyperscale consumers within the knowledge middle business, have traditionally most well-liked to construct capability themselves in markets the place there may be important anticipated demand, potential financial benefit and manageable threat.
Nevertheless, intense competitors has led these gamers to rely extra on leased capability from third events to get a extra environment friendly path to market. In response, there are indicators that the self-build technique could also be shifting.
Hyperscaler organizations acknowledge that it’s unrealistic to self-build the whole lot, and leasing will proceed to play an vital position in capability procurement. Consequently, hyperscalers are relying extra closely on leasing for velocity to market benefit, whereas additionally contemplating smaller self-builds to doubtlessly offset future demand. This means a possible improve within the whole variety of self-builds and a extra heterogeneous mixture of self-builds and leased capability inside cloud areas and even particular person availability zones. For third-party suppliers, assessing the specter of potential future migration threat, given this dynamic, can be more and more vital.
Key consideration for executives and buyers:
- The shifting mixture of self-build vs. leasing throughout the business and inside particular native markets could alter the dimensions of the addressable market, execution decision-making, and potential dangers.
Elevated energy demand for AI workloads, cooling shift to liquid
AI workloads require power-hungry graphics processor items (GPU), leading to a lot increased energy density necessities inside the knowledge middle. At present, the AI market is comparatively homogenous on the server infrastructure degree, with Nvidia holding about 95% of the GPU market for machine studying (ML).
Due to this fact, the vast majority of high-end AI workloads are run on comparable {hardware}: Particularly, chassis consisting of eight of Nvidia’s newest AI-specific GPUs (H100s), with every chassis consuming 5 to 6kW of energy. As much as six chassis can slot in a single knowledge middle rack, leading to whole rack densities within the 30 to 40kW vary, in comparison with roughly 10kW/rack densities for commodity public cloud workloads.
Consequently, hyperscalers and knowledge middle operators should discover methods to successfully cool the tools. Some main hyperscalers have introduced plans to shift to liquid cooling options or increase the temperatures inside their knowledge facilities to help these increased densities.
Key concerns for executives and buyers:
- Present designs ought to help the longer term wants of power-dense workloads as densities shift over time.
- Deciding on totally different cooling know-how choices may have to think about each financial and sustainability issues.
Environmental, Social and Governance (ESG) calls for
The information middle business ESG concerns are primarily centered on sustainability. To attain their sustainability objectives, business contributors have introduced ambitions associated to renewable power utilization, water utilization and discount of their carbon footprints. Knowledge middle operators are using quite a lot of methods, the place out there, to fulfill these objectives:
- Effectivity enhancements
- Power-efficient designs utilizing applied sciences akin to free cooling, environment friendly energy distribution and environment friendly lighting techniques
- Renewable power utilization
- Procuring renewable power from the grid
- On-site renewable technology, together with photo voltaic and wind
- Energy buy agreements (PPAs) for long-term renewable power, specifying quantity and worth
- Water utilization
- Air-cooled techniques
- Closed-loop water techniques to scale back water use
- Rainwater harvesting and water recycling
- Water-free cooling, akin to evaporative cooling or adiabatic cooling
- Carbon neutrality
- Power restoration utilizing warmth from IT tools
- Waste discount
- The flexibility to make the most of these methods will range broadly by market relying on native local weather, native power combine and different elements akin to the necessity for employee security.
Key concerns for executives and buyers:
- ESG technique ought to be differentiated from rivals.
- An ESG technique ought to try to handle desired, measurable change, or it could run the danger of being labeled as “greenwashing.”
AI plugins: Subsequent wave of ecosystems
OpenAI has lately introduced plugins to help third-party companies, akin to widespread on-line ordering and reservation purposes. These plugins are designed to assist builders entry and combine exterior knowledge feeds immediately into OpenAI’s language mannequin, permitting for extra subtle coaching and prompting capabilities.
This new performance might doubtlessly reshape current knowledge middle ecosystems round particular industries or knowledge sources. As this dynamic evolves, will probably be important for operators to determine future “magnets” for these communities of curiosity and provide a related set of connectivity merchandise to help the wants of those ecosystem contributors.
Key concerns for executives and buyers:
- To help ecosystem growth, the suitable set of merchandise, companions and infrastructure is essential.
- It is very important determine the highest-value clients on this new market atmosphere and decide how the gross sales group is provided to focus on them.
Conclusion
The stakes have by no means been increased for knowledge middle business contributors to develop proactive, versatile methods to navigate this new period and construct the suitable knowledge middle capability in the suitable markets. AI is driving elevated knowledge storage demand, which is positioned to outstrip provide within the close to time period. Builders, buyers and customers will profit from versatile knowledge middle infrastructure methods that may harness the AI revolution and result in outsized progress.
Gordon Bell is EY-Parthenon principal for technique and transactions at Ernst and Younger LLP.
Lillie Karch is EY-Parthenon senior supervisor for technique and transactions at Ernst and Younger LLP
The views mirrored on this article are the views of the authors and don’t essentially replicate the views of Ernst & Younger LLP or different members of the worldwide EY group.