Cloud Spending Patterns in Q3 of 2022
Cloud costs are a growing and often mysterious budget item that engineering, operations, and finance teams grapple with even as their organizations reap the cloud's many benefits. Vantage is a cloud cost management and optimization platform with a unique dataset of cloud spending patterns. To discuss this report in more detail, join our growing Slack Community of over 1,000 FinOps and cloud professionals here.
Today Vantage is releasing the inaugural Cloud Cost Report for Q3 which uses anonymized, real-world data to quantify how cloud spending is shifting and changing. This report analyzes interesting trends to provide engineering leaders, FinOps professionals, and CFOs with emerging and evolving patterns. This inaugural report focuses initially on AWS, with hopes to extend to other other providers for subsequent quarters.
On-demand compute costs are decreasing as a percentage of total compute spend, despite still being at relatively high levels in aggregate. On-demand compute as a share of costs has decreased from 50.19% a year ago to 44.66% at the end of Q3.
As bottom lines have come more into focus as financial markets correct we've seen more customers opt to make commitments in the form of AWS Savings Plans and Reserved Instances.
We expect this trend to continue as compute spend remain the major area of optimization for most organizations.
TweetIntel remains dominant among traditional servers even with the much-hyped rollout of ARM Graviton processors on AWS. AMD holds onto 20% of the compute market share.
While we see more forward thinking organizations make shifts over to AWS Graviton, its adoption is still low in comparison at less than 1% of represents EC2 costs.
TweetAlthough newer generation instances have often been available for a while, companies are slow to move to them. In our data the c5, m5, and r5 instances make up the vast majority of compute costs, with c6, m6, and r6 instances only beginning to make a dent this past quarter.
In contrast with serverless workloads, EC2 instance upgrades are not happening as quickly even though newer generations offer better performance and lower costs than previous generation instances.
TweetNewer and more cost effective GP3 volumes have been available since 2020 but the majority of block storage costs are still on older GP2 volumes as presumably most customers don't fully grasp price-to-performance implications.
Despite the fact that customers can save 20% on block storage and achieve higher I/O performance for their volumes by upgrading, many customers are slow to transition.
TweetThere are many GPU types available in the cloud. While AI training and inference are leading use-cases, a large share of spend is devoted to g4 instances which are best for graphics workloads. For example, virtual workstations (or "cloud desktops") help organizations adapt to remote-work quickly and in some cases provide repeatable development environments for developers.
Today's large models need p3 or p4 machines which contain NVIDIA's latest server-class boards and provide the amount of video memory and tensor cores needed to train large language models like GPT3 or generative image networks like Stable Diffusion.
TweetFor serverless workloads on AWS, the CPU picture is much different than EC2. Since these applications are as highly abstracted from the hardware as possible, switching to the best price-to-performance CPU is easier. Here we find that the share of Lambda costs on Graviton are on track to exceed the share of costs on x86 among Vantage users.
The belief here is that adopters of AWS Lambda tend to be more forward-thinking and modern organizations and are cognizant of the price-to-performance benefits that Graviton offers.
The vast majority of S3 storage costs were accrued on the standard storage tier - which is the default tier for S3. AWS offers services like S3 Intelligent Tiering, which automatically moves objects to cheaper storage tiers based on access patterns has been available since 2018.
There is an added monitoring cost with Intelligent Tiering but this was de-minimis as a sum-total of S3 costs.
S3 Storage Class | Share of Costs | S3 Intelligent Tiering |
---|---|---|
Standard Storage | 80.95% | |
Standard Infrequent Access | 6.07% | |
Standard Frequent Access | 4.17% | Yes |
Glacier Deep Archive | 1.85% | |
Glacier Flexible Retrieval | 2.51% | |
Infrequent Access | 1.91% | Yes |
Archive Instant Access | 0.52% | Yes |
One Zone Infrequent Access | 0.52% | |
Archive Access | 0.11% | Yes |
Other | 1.39% |