About real-world results and future products
Amazon Web Services, Oracle, Microsoft, Alibaba, Tencent, Equinix, Baidu, ByteDance, Cloudflare, and others are deploying and testing Arm-based technology for the cloud. While some hyperscale datacenters are designing their own chips, others are collaborating with Arm partners such as NVIDIA, Ampere, and Marvell.
Social networking site Snap reduced CPU utilization by 10% with the better performance delivered by Neoverse-based Graviton2 instances at AWS. Navitime, which provides navigation services, saw throughput increase by 15% and costs decrease by 20%. Photo giant SmugMug/Flickr experienced a 40% boost in price performance.
You can see what Twitter, Netflix, Formula One, Intuit, Coinbase, S-Cube (seismic modeling), NextRoll (cloud services), Nielsen, ParkMobile (smart parking), and others have to say about Neoverse-based Graviton2 instances here.
Arm also plays a leading role in smart NICs and DPUs for offloading networking, security, and storage.
NVIDIA is using Neoverse to build Grace, a chip that aims to deliver a 10x performance boost to clouds and supercomputers. NVIDIA also uses Arm CPUs in its Bluefield DPUs to accelerate cloud and 5G workloads: a Bluefield DPU with 16 Arm CPUs can replace up to 300 traditional processors.
Neoverse increases the performance and output of 5G infrastructure while keeping a lid on equipment and energy costs. This gives carriers and companies with private 5G networks the headroom to integrate 5G into their operations or launch IoT services.
Lenovo uses Arm technology in its FutureCore 5G products. The company is also deploying its Arm-based 5G systems in its office buildings and factories to explore how 5G can improve security, employee health, productivity, energy consumption, and meet other goals. Sunsea AIoT, one of China’s largest IoT companies, CommAgility, Altran, and others are developing Neoverse-based equipment, "networks in a box", and software for enhancing Arm-based 5G systems.
Additionally, Neoverse is helping carriers migrate 5G infrastructure to the cloud. DISH, which is constructing a 5G network on AWS, will use Arm-based Graviton2-based instances to power its compute workloads.
Raj Singh, EVP of the Processors Business Group at Marvell, explains how its Neoverse N2-based DPU provides 3x more performance and 4x better per watt performance over previous generations. Marvell, NVIDIA, and Arm are also collaborating on enhancing 5G with AI.
High performance computing teams today need to reach unprecedented levels of performance while at the same time fit within strict budget, time, and power envelopes.
Arm technology gives designers the ability to reach these seemingly contradictory goals by enabling them to create customized processors to suit their specific research and policy goals.
Arm technology is also helping cloud providers deliver HPC as a service to give a wider spectrum of customers the ability to conduct complex simulations or other compute-intensive tasks.
Arm HPC partners and customers include RIKEN (Japan), Fujitsu, Meity (India), NVIDIA, SiPearl (EU), Swiss National Supercomputing Centre, ETRI (Republic of Korea), University of Bristol, Stony Brook University, Oak Ridge National Laboratory, and the University of Regensberg.
The K-Artificial Brain 21, based on Neoverse processors, aims to deliver a 2.5x increase in performance while reducing power by 60%.
SiPearl is designing processors based on Neoverse V1 for European exascale computers, autonomous driving, and other applications.
An estimated 75% of data will be processed outside centralized datacenters by 20257 with around one-third of telco servers8 going to the edge to boost speed and performance while lowering cost.
As a result, edge servers will be everywhere: in unoccupied retail spaces, in strongboxes in business corridors, and major traffic junctions. Heat, power, and water (for cooling) will be at a premium. So will reliability: over-the-air upgrades and remote management will be the norm. The power/performance Arm delivers have made it a technology leader.
Among other projects, Arm is participating in the Magma Core Foundation (part of the Linux Foundation) with Facebook Connectivity and others on fixed wireless access, 5G, and private LTE network solutions to help bring internet access to the nearly half of the world's population which remains unconnected. Arm is also developing universal customer premise equipment (uCPE) to extend the life and value of networking equipment while reducing e-waste.
Arm’s Project Cassini establishes a framework for the edge by defining the hardware, software, and security specifications for building cloud-native gateways, servers, and other edge devices. Over 100 companies have joined the effort.
1. Gartner, ZDNet
2. International Energy Agency
3. Arm, Nature, IEA, customer estimates.
4. AWS, other Arm customers.
5. RIKEN
6. IEEE Spectrum, Top 500
7. Gartner
8. Computer Weekly.