Array
(
    [content] => 
    [params] => Array
        (
            [0] => /forum/threads/arm-releases-first-ever-ai-chip-with-meta-as-initial-customer.24822/
        )

    [addOns] => Array
        (
            [DL6/MLTP] => 13
            [Hampel/TimeZoneDebug] => 1000070
            [SV/ChangePostDate] => 2010200
            [SemiWiki/Newsletter] => 1000010
            [SemiWiki/WPMenu] => 1000010
            [SemiWiki/XPressExtend] => 1000010
            [ThemeHouse/XLink] => 1000970
            [ThemeHouse/XPress] => 1010570
            [XF] => 2030970
            [XFI] => 1060170
        )

    [wordpress] => /var/www/html
)

Arm Releases First Ever AI Chip, With Meta As Initial Customer

soAsian

Well-known member
For more than 35 years, Arm has licensed its chip architecture and collected royalties on every processor made by customers like Apple, Nvidia, Google, Amazon, Intel and Microsoft. Now Arm is becoming their competitor, making physical silicon of its own for the first time, with Meta as the initial customer. CNBC got an exclusive first look at Arm's new AGI CPU that's "ruthlessly optimized" for running AI inference in data centers, and toured the $71 million lab in Austin, Texas, that Arm built for its new CPU.


Golden age!?
 
I don't get it. These chips are just a bunch of Neoverse V3 cores. Nothing really special. I'm having trouble seeing advantages it has beyond the AWS Graviton 5. And then there's Ampere, also owned by SoftBank, which has custom Arm cores, which are supposedly superior to Neoverse V3 cores. Arm and SoftBank confuse me. Or am I missing something?
 
I am watching the livecast of Arm AGI CPU lunch,I think they want to join the competition of AI Server Architechture system,so they need CPU to provide total solutions.
 
I don't get it. These chips are just a bunch of Neoverse V3 cores. Nothing really special. I'm having trouble seeing advantages it has beyond the AWS Graviton 5. And then there's Ampere, also owned by SoftBank, which has custom Arm cores, which are supposedly superior to Neoverse V3 cores. Arm and SoftBank confuse me. Or am I missing something?
It's hard to get really good info on this ARM "AGI CPU", but it *looks* like the differences are:

- Graviton is more focused on general purpose, while ARM AGI is more biased towards Inference via improved inter-chip and off-chip bandwidth
- Graviton appears to be used exclusively by Amazon for AWS, where ARM AGI is the "public market offering" that anyone can use

It doesn't seem very special but it is at least a "general offering" that any server/cloud provider could buy/use.

.. and yes Ampere definitely has strong overlap with both Graviton and ARM AGI ..
 
It's hard to get really good info on this ARM "AGI CPU", but it *looks* like the differences are:

- Graviton is more focused on general purpose, while ARM AGI is more biased towards Inference via improved inter-chip and off-chip bandwidth
- Graviton appears to be used exclusively by Amazon for AWS, where ARM AGI is the "public market offering" that anyone can use

It doesn't seem very special but it is at least a "general offering" that any server/cloud provider could buy/use.

.. and yes Ampere definitely has strong overlap with both Graviton and ARM AGI ..
I think the marketing gimmick of tagging it as the "AGI CPU" is just silly. I can call myself young and good-looking, but as the Linda Ronstadt song goes, all it would take is "Just One Look" to know I'm full of you-know-what. Even Intel Xeon 6s have hardware accelerators which make it them better for AI than these "AGI" CPUs. I have trouble typing the AGI letters without chuckling. Arm, seriously, fire your marketing team.
 
I think the marketing gimmick of tagging it as the "AGI CPU" is just silly. I can call myself young and good-looking, but as the Linda Ronstadt song goes, all it would take is "Just One Look" to know I'm full of you-know-what. Even Intel Xeon 6s have hardware accelerators which make it them better for AI than these "AGI" CPUs. I have trouble typing the AGI letters without chuckling. Arm, seriously, fire your marketing team.
100% agree on marketing getting stupid. Though "AI" itself is already an incorrect term for LLMs..
 
Back
Top