{"id":15047,"date":"2026-08-08T12:01:19","date_gmt":"2026-08-08T12:01:19","guid":{"rendered":"https:\/\/news.theck1.no\/?p=15047"},"modified":"2026-08-08T12:01:19","modified_gmt":"2026-08-08T12:01:19","slug":"amazon-cracks-down-on-cpu-waste-among-engineers-as-agentic-ai-crunch-intensifies-cpu-demand-makes-low-utilization-ec2-instances-a-hot-commodity-updated","status":"publish","type":"post","link":"https:\/\/news.theck1.no\/?p=15047","title":{"rendered":"Amazon cracks down on &#8216;CPU waste&#8217; among engineers as agentic AI crunch intensifies \u2014 CPU demand makes low-utilization EC2 instances a hot commodity [Updated]"},"content":{"rendered":"<div style=\"margin-bottom:1em; color:#666; font-size:0.9em;\">\n<strong> Jake Roach <\/strong><br \/>\n &bull;<br \/>\nAugust 7, 2026\n<\/div>\n<hr\/>\n<p><!--more--><\/p>\n<article>\n<p>Amazon Web Services is cracking down on internal use of EC2 instances among its engineers. In May, the company reportedly met with engineers and told them to reduce CPU waste to ensure AWS has enough CPU capacity to meet customer demand, <a href=\"https:\/\/www.theinformation.com\/articles\/aws-tells-engineers-cut-cpu-waste-amid-crunch\">The Information reports<\/a>. The message comes as demand for CPUs in the data center has hit a fever pitch, with the traditional eight-to-one or four-to-one ratio of GPUs to CPUs moving closer to parity. <\/p>\n<div  class=\"fancy-box\">\n<div class=\"fancy_box-title\">Go deeper with TH Premium: CPU<\/div>\n<div class=\"fancy_box_body\">\n<figure class=\"van-image-figure \"  >\n<div class='image-full-width-wrapper'>\n<div class='image-widthsetter' >\n<p class=\"vanilla-image-block\" style=\"padding-top:56.25%;\"><img decoding=\"async\" id=\"Xh2MupWrRjJPiLLuopmKRB\" name=\"W1103180\" caption=\"\" alt=\"A hand holding the Ryzen 7 9850X3D.\" src=\"https:\/\/cdn.mos.cms.futurecdn.net\/Xh2MupWrRjJPiLLuopmKRB.jpg\" mos=\"\" link=\"\" align=\"\" fullscreen=\"\" width=\"\" height=\"\" attribution=\"\" endorsement=\"\" class=\"pinterest-pin-exclude\"><\/p>\n<\/div>\n<\/div><figcaption itemprop=\"caption description\" class=\"\"><span class=\"credit\" itemprop=\"copyrightHolder\">(Image credit: Tom&#8217;s Hardware)<\/span><\/figcaption><\/figure>\n<p class=\"fancy-box__body-text\">\n<ul>\n<li><a data-analytics-id=\"inline-link\" href=\"https:\/\/www.tomshardware.com\/tech-industry\/cpu-scaling-with-dlss-investigating-cpu-performance-in-the-age-of-upscaling?utm_source=edit-links&#038;utm_medium=boxout&#038;utm_term=cpu\" target=\"_blank\">CPU scaling with DLSS<\/a><\/li>\n<li><a data-analytics-id=\"inline-link\" href=\"https:\/\/www.tomshardware.com\/pc-components\/cpus\/ryzen-to-the-top-how-amd-innovated-in-the-gaming-cpu-market?utm_source=edit-links&#038;utm_medium=boxout&#038;utm_term=cpu\" target=\"_blank\">Ryzen to the top: How AMD innovated in the gaming CPU market<\/a><\/li>\n<li><a data-analytics-id=\"inline-link\" href=\"https:\/\/www.tomshardware.com\/tech-industry\/semiconductors\/how-arm-is-working-its-way-into-pcs-and-data-centers-inside-the-products-and-trends-behind-the-hype?utm_source=edit-links&#038;utm_medium=boxout&#038;utm_term=cpu\" target=\"_blank\">How ARM is working its way into PCs<\/a><\/li>\n<li><a data-analytics-id=\"inline-link\" href=\"https:\/\/www.tomshardware.com\/tech-industry\/amd-ces-2026-gaming-trends-press-q-and-a-roundtable-transcript-we-see-a-little-bit-of-an-uptick-in-the-percentage-of-am4-versus-am5-platforms?utm_source=edit-links&#038;utm_medium=boxout&#038;utm_term=cpu\" target=\"_blank\">AMD CES 2026 gaming trends press Q&#038;A roundtable transcript<\/a><\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p>EC2 instances make up a large chunk of the modern internet, and they&#8217;re used in private deployments, as well. Traditionally, AWS engineers have been able to spin up their own instances for development, leveraging the relatively low CPU utilization required for web infrastructure to use more virtual machines. Now, engineers say they&#8217;re waiting days to get access when they previously could get access within hours. One engineer told <em>The Information<\/em> that they&#8217;ve never had to wait this long for an instance, even after several years of working at Amazon.<\/p>\n<p>Amazon deploys several different types of CPUs in EC2 instances, including AMD and Intel options and its<a href=\"https:\/\/www.tomshardware.com\/pc-components\/cpus\/amazon-unveils-192-core-graviton5-cpu-with-massive-180-mb-l3-cache-in-tow-ambitious-server-silicon-challenges-high-end-amd-epyc-and-intel-xeon-in-the-cloud\"> <u>relatively new Graviton5 chip<\/u><\/a>. Graviton5 is Amazon&#8217;s most powerful CPU to date, and it uses an Arm-based architecture along the lines of Nvidia&#8217;s Vera CPU and<a href=\"https:\/\/www.tomshardware.com\/tech-industry\/semiconductors\/arm-launches-its-first-data-center-cpu\"> <u>Arm&#8217;s own AGI<\/u><\/a>.<\/p>\n<p>The increased demand for CPU comes on the back of AI agents, a new paradigm in productivity that even companies as large as Amazon are struggling to reckon with. Last month, for instance, a coding agent blew through<a href=\"https:\/\/www.tomshardware.com\/tech-industry\/artificial-intelligence\/amazon-accidentally-spent-usd1-8-million-using-claude-for-menial-coding-task-went-860-percent-over-budget-catastrophically-expensive-coding-blunders-discovered-in-internal-amazon-ai-usage-metrics\"> <u>$1.8 million in token costs at Amazon, surpassing a development budget by 860%<\/u><\/a>.<\/p>\n<p>Much of the AI infrastructure currently in place is designed around inference, a workload that&#8217;s accelerated by GPUs. With the four-to-one ratio, the CPU served as a way to keep the GPUs fed, and nothing more. However, agentic workloads are much more complex. They often involve tool calls that run on the CPU, as well as more complex orchestration of inference on GPUs. This is what has brought CPUs center stage in the agentic era. Intel, AMD, and others have echoed what we&#8217;ve heard from memory and storage companies over the past several months: the demand is so high for CPUs that most companies will take whatever they can get.<\/p>\n<p>The major players are capitalizing on that demand. AMD just recently unveiled its portfolio of<a href=\"https:\/\/www.tomshardware.com\/pc-components\/cpus\/amds-256-core-epyc-9996-venice-claims-up-to-a-3-4x-jump-over-intel-xeon-competition-20-percent-over-nvidia-vera-zen-6-comes-with-up-to-1024mb-of-l3-16-channel-memory-and-5ghz-clock-speeds\"> <u>Zen 6 &#8216;Venice&#8217; CPUs for the data center<\/u><\/a>, marking the first time AMD has launched a new architecture in the data center before the client market in decades. Nvidia has also pivoted its messaging away from accelerators and<a href=\"https:\/\/www.tomshardware.com\/pc-components\/cpus\/nvidia-spills-the-beans-on-vera-cpu-spec-benchmarks-revealed-olympus-architecture-detailed-and-more\"> <u>toward its new Vera CPU<\/u><\/a>, vying to stake its claim in an expanding market of agentic AI infrastructure.<\/p>\n<p>Although Amazon is wrestling with CPU capacity across its internal engineers and external customers, The Information reports that shortages are largely a problem for spot instances. A consultant told the outlet that contracted capacity hasn&#8217;t experienced any shortages.<\/p>\n<p>Following publication, an Amazon Web Services spokesperson reached out with the following statement: <\/p>\n<p>&#8220;Demand for AWS services, including EC2, is incredibly strong and growing. Even with this heavy demand, we continue to satisfy the overwhelming majority of compute needs for both our internal and external customers. We work closely with internal teams to meet their compute needs while ensuring they use EC2 resources as efficiently as possible, such as reclaiming idle instances, right-sizing, and scaling up and down as needs change \u2013 just as we\u2019ve always done. These efficiencies help manage capacity for internal and external customers alike, and any suggestions that these long-standing efforts reflect new capacity constraints is simply wrong.  <\/p>\n<p>This premise is sensationalized. Frugality is in our DNA since Day 1. We have always encouraged our teams to operate efficiently. We also share best practices for how customers can optimize resources to external customers. This isn\u2019t a new directive, and encouraging efficient use of resources isn\u2019t unique to Amazon.&#8221;<\/p>\n<p>We pressed Amazon on if engineers had been given deadlines to reduce their compute usage, as <em>The Information <\/em>originally reported. An AWS spokesperson responded: &#8220;This narrative on EC2 is inaccurate. As part of our normal business operations, and backed by our leadership principle of frugality, we are always driving efficiency across our resources to ensure teams are optimizing capacity.&#8221; <\/p>\n<\/article>\n<p style=\"margin-top:1.5em;\"><a href=\"https:\/\/www.tomshardware.com\/pc-components\/cpus\/amazon-cracks-down-on-cpu-waste-among-engineers-as-agentic-ai-crunch-intensifies-cpu-demand-makes-low-utilization-ec2-instances-a-hot-commodity\" target=\"_blank\" rel=\"noopener\">Read the full article &rarr;<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Jake Roach &bull; August 7, 2026<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-15047","post","type-post","status-publish","format-standard","hentry","category-it-hardware"],"_links":{"self":[{"href":"https:\/\/news.theck1.no\/index.php?rest_route=\/wp\/v2\/posts\/15047","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/news.theck1.no\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/news.theck1.no\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/news.theck1.no\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/news.theck1.no\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=15047"}],"version-history":[{"count":0,"href":"https:\/\/news.theck1.no\/index.php?rest_route=\/wp\/v2\/posts\/15047\/revisions"}],"wp:attachment":[{"href":"https:\/\/news.theck1.no\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=15047"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/news.theck1.no\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=15047"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/news.theck1.no\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=15047"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}