Connect with us

News

Elon Musk’s xAI activates “most powerful AI training cluster in the world” with 100k Nvidia H100 GPUs

Credit: xAI/X

Published

on

Elon Musk’s artificial intelligence startup, xAI, has activated its supercomputer cluster in Memphis, Tennessee, which is comprised of 100,000 Nvidia H100 GPUs. Tesla CEO Elon Musk confirmed the milestone in a post on social media platform X. 

xAI had a busy weekend, with the AI startup announcing a hiring ramp on X. Musk highlighted these efforts on Monday morning, stating that xAI was looking to increase its human talent advantage. Interestingly enough, Musk also encouraged those who are interested in AI to apply to Tesla and X. 

Musk then mentioned that a collaboration between teams from xAI, X, and Nvidia has enabled the Memphis Supercomputer cluster to start training at 4:20 a.m. local time. As per Musk, the supercomputer cluster features 100,000 Nvidia H100 GPUs, effectively making it the most powerful AI training cluster in the market today. 

“Nice work by xAI team, X team, Nvidia team, and supporting companies getting Memphis Supercluster training started at ~4:20 a.m. local time. With 100k liquid-cooled H100s on a single RDMA fabric, it’s the most powerful AI training cluster in the world! This is a significant advantage in training the world’s most powerful AI by every metric by December this year,” Musk wrote in a post on X. 

xAI’s supercomputer cluster is expected to be used to train the company’s large language model, Grok, which is currently rolled out as a feature for X Premium subscribers. Earlier this month, Musk noted in a post on X that xAI’s Grok 3 would be trained on 100,000 H100 GPUs so “it should be really something special.” 

Advertisement

Previous reports from Memphis back in early June suggested that xAI would be building a supercomputer cluster informally dubbed the “Gigafactory of Compute” at the 785,000-square-foot former Electrolux Memphis facility. In a press release, the Greater Memphis Chamber stated that xAI’s supercomputer project represents the city’s largest capital investment by a new-to-market company in Memphis history. 

xAI’s investment is substantial. As per a Benzinga report, each Nvidia H100 GPU is estimated to cost between $30,000 to $40,000. Considering that xAI is using 100,000 Nvidia H100 units, Elon Musk’s AI startup appears to have spent about $3 billion to $4 billion for the project.

Don’t hesitate to contact us with news tips. Just send a message to simon@teslarati.com to give us a heads up.

Simon is an experienced automotive reporter with a passion for electric cars and clean energy. Fascinated by the world envisioned by Elon Musk, he hopes to make it to Mars (at least as a tourist) someday. For stories or tips--or even to just say a simple hello--send a message to his email, simon@teslarati.com or his handle on X, @ResidentSponge.

Advertisement
Comments

News

Elon Musk shuts down Tesla ‘AMG’ division speculation: ‘Focus is autonomy’

“I think it’s best to leave that to the custom shops. Tesla’s focus is autonomous cars, building futuristic autonomous cars. We want the future to look like the future.”

Published

on

Credit: Unplugged Performance

Tesla CEO Elon Musk was asked by Joe Rogan late last week whether the company would ever consider establishing an “AMG division” like Mercedes-Benz has established for powerful, race-inspired vehicles.

However, Musk turned down any talk of that, highlighting that the company is laser-focused on autonomous vehicles, seemingly hinting that any distraction from autonomy would be a detriment to the future.

Rogan drives a Tesla Model S himself, but it is not your run-of-the-mill all-electric sedan. Already outfitted with the Plaid powertrain that Tesla developed, Rogan took his vehicle to Unplugged Performance for a true performance outfitting.

The vehicle is completely overhauled with performance parts and seats. Known as the Model S-APEX, Rogan took delivery of it from Unplugged in January.

Rogan asked Musk on Friday during his most recent appearance on the Joe Rogan Experience podcast whether Tesla would ever establish an “AMG division” that would focus on catering Teslas to performance-based standards.

Musk said:

“I think it’s best to leave that to the custom shops. Tesla’s focus is autonomous cars, building futuristic autonomous cars. We want the future to look like the future.”

Tesla fans have said for years that the company should consider acquiring Unplugged Performance and its Upfit Tesla division, which recently outfitted the Las Vegas Metropolitan Police Department’s fleet of Cybertruck cruisers.

However, it seems Tesla will keep things separate. Musk is primarily focused on autonomy, which will drive the technology forward and drive shareholder growth. Something like an outfitter for performance would be a cool thing for the owners who have the interest and the money.

It’s not a tremendous revenue driver or anything that would contribute to the financial state of the company. Mercedes-Benz, for example, is more accessible for consumers as it sold over 140,000 units from its AMG brand in 2024.

Tesla Model Y driver starts race in reverse, still wins against AMG SUV

It helps with driving revenue higher by as much as 15 percent compared to similar models that are not AMGs. However, would Tesla see this much of a benefit? Likely not, because the Performance trim already caters to many owners.

Continue Reading

Cybertruck

Tesla Cybertruck fleet takes over at SpaceX’s Starbase

Interestingly, the Cybertruck uses the same exterior, a stainless steel alloy, as SpaceX rockets. This synergy between the two companies and their very different products shows a very unified mentality between Musk companies.

Published

on

Credit: @derek1ee | X

Tesla Cybertrucks have taken over at SpaceX’s Starbase facility in Texas, as hundreds of the all-electric pickup trucks were spotted late last week rounding out a massive fleet of vehicles.

The Cybertruck fleet is geared toward replacing gas vehicles that are used at Starbase for everyday operations. The only surprise about this is that it was not done sooner:

Deliveries have been going on for a few weeks, as Cybertrucks have made their way across the state of Texas from Austin to Starbase so they could be included in SpaceX’s fleet of vehicles at the facility.

Interestingly, the Cybertruck uses the same exterior, a stainless steel alloy, as SpaceX rockets. This synergy between the two companies and their very different products shows a very unified mentality between Musk companies.

However, there are some other perspectives to consider as SpaceX is utilizing such a massive fleet of Cybertrucks. Some media outlets (unsurprisingly) are seeing this as a move of weakness by both Tesla and SpaceX, as the aerospace company is, in a sense, “bailing out” lagging sales for the all-electric pickup.

It’s no secret that Tesla has struggled with the Cybertruck this year, and deliveries have been underwhelming in the sense that the company was anticipating between 1 million and 2 million orders for the vehicle before it was widely produced.

A lot of things changed with the Cybertruck between its 2019 unveiling and 2023 initial deliveries, most notably, price.

The price of the Cybertruck swelled significantly and priced out many of those who had pre-ordered it. Some have weighed the option of whether this purchase was a way to get rid of sitting inventory.

However, it seems more logical to consider the fact that SpaceX was likely always going to transition to Teslas for its fleet, especially at Starship, at some point.

It doesn’t seem out of the question that one Musk company would utilize another Musk company’s products, especially considering the Cybertruck has been teased as the vehicle that would be present on Mars.

Continue Reading

Elon Musk

Elon Musk subtly confirms one of Tesla AI8’s uses, and it’s literally out of this world

Elon Musk appears to have subtly confirmed that Tesla’s upcoming AI8 chip won’t be limited to vehicles or robots alone.

Published

on

Tesla-Chips-HW3-1
Image used with permission for Teslarati. (Credit: Tom Cross)

Elon Musk appears to have subtly confirmed that the uses of Tesla’s upcoming AI8 chip won’t be limited to vehicles or humanoid robots alone.

If Musk’s recent responses on X are any indication, it would appear that Tesla’s AI8 will be used by the CEO’s other companies, and its applications would literally extend out of this world.

Tesla’s AI8 could extend beyond vehicles

Musk’s update came on the heels of his recent comments, where he revealed that Tesla was not just working on its AI5 and AI6 chips. The company is also designing AI7 and AI8. This comment caught a lot of attention, with some wondering why Tesla feels the need to design an AI8 chip when AI4 seems on track to be a good fit for autonomous driving. 

Amidst these speculations, an X user suggested that Elon Musk’s comment about AI8 being out of this world could actually be quite true in the literal sense, as it could be used as the chip for SpaceX’s orbit data centers. Musk subtly confirmed this, as he responded to the X user’s post with a bullseye emoji.

Musk’s subtle confirmation that AI8 will be used by SpaceX’s in-space data centers presents a pretty interesting future for the electric vehicle maker. Synergy among Elon Musk-led companies is nothing new, but having Tesla produce chips for SpaceX is undoubtedly something that’s never really been done before.

Advertisement

SpaceX’s space-based computing with Starlink V3 satellites

Musk previously stated that SpaceX plans to use its Starlink V3 satellites to develop space-based data centers. In response to an Ars Technica report on autonomous space construction, he wrote on X: “Simply scaling up Starlink V3 satellites, which have high-speed laser links, would work. SpaceX will be doing this.”

The concept, while ambitious, could address growing energy and cooling constraints facing Earth-based data centers amid the AI boom. Space-based clusters could also cut down on land and water usage, though critics have questioned their cost and maintainability.

Musk recently called the orbital data center project “a very big deal,” and given SpaceX’s history of turning improbable ideas into operational systems, it may not be too far-fetched at all, especially since SpaceX’s Starlink V3 platform is capable of up to 1 terabit per second (Tbps) throughput.

Continue Reading

Trending