News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
SpaceX just combined Grok, Cursor, and X into one mega plan
SpaceXSI merges Grok, Cursor, and X Premium into one plan, raising questions for Tesla owners.
SpaceX Super Intelligence has rolled out The X Subscription, a single plan that combines Grok, Grok Bot, Cursor, and X Premium.
There are five levels, including a free plan that includes daily Grok access and a starter allowance for Cursor’s coding agents. Plus is $8 per month, Premium is $30, Super is $100, and Ultra is $200. Usage scales as you move up, with Premium offering four times the Plus allowance, Super 15 times, and Ultra 50 times. Annual billing brings the prices down a bit further, with Premium at $300 per year.
We’ve unified plans across Grok, Cursor, and X Premium.
Introducing The X Subscription. https://t.co/SvkrVvBa0p
— SpaceX Super Intelligence (@SpaceXSI) October 12, 2026
The $30 Premium tier is where SpaceXSI says it packs the benefits of SuperGrok, Cursor Pro, and X Premium+, which previously added up to $90 per month. Grok Bot, the agent that handles tasks like ordering food or managing a calendar, is included from Premium upward but not on Plus. Paid plans share one weekly usage pool across Grok and Cursor, and each plan includes at least twice the coding usage of the comparable Cursor plan. Third party models in Cursor remain available on Premium and above, but they are billed separately at API list prices.
That last detail matters because of what has happened around Cursor this year. SpaceX exercised its option to buy the company for $60 billion in June, and the deal closed in August. Weeks later, OpenAI said it will cut Cursor’s access to its models on November 12. Bundling Cursor with Grok usage gives SpaceXSI a reason to steer developers toward its own models.
Tesla integrates Grok Bot into its vehicles for the ultimate personal assistant
For Tesla owners, the connection is Grok Bot. Tesla brought it into its vehicles last month, and at that point access inside the car was limited to SuperGrok Heavy subscribers. Grok Bot is now enabled across every Cybercab and the rest of the Model Y Robotaxi fleet. Neither SpaceXSI nor Tesla has said how the new plans change inside the car access for owners, or whether a $30 Premium subscription now covers Grok Bot in a personal Tesla. That is the question owners will want answered first.
The company is also changing its name along the way. The rollout follows the rebrand Musk announced on October 4, when he said SpaceXAI would become SpaceXSI, and the plan page now carries that branding.
The X Subscription is available to new customers starting now, and SpaceXSI says it will reach everyone globally over the next few days. Existing SuperGrok, Cursor, and X Premium subscribers do not have to switch. The option to move will appear gradually in billing settings, with a prorated refund for the unused time on the old plan. Switching is permanent once the accounts are unified, and old plans are closed to new sign ups.
Energy
Taiwan power firm bets big on Tesla Megapacks as AI data center thirst grows
Taiwan’s Apollo Power orders 260 Tesla Megapacks, betting AI data centers will need more electricity.
A Taiwanese power company has ordered 260 Tesla Megapack 2XL units, roughly 1GWh of storage, betting that electricity rather than chips will decide how fast AI data centers come online. Apollo Power signed the contract with Tesla’s Taiwan energy arm on October 8, according to the company’s filing with the Taiwan stock exchange.
The filing says the units are meant for behind the meter storage and resilient grid projects, with delivery in batches from the end of 2027 and sites operating in 2028. Apollo and Tesla did not disclose a price, citing a confidentiality agreement. Apollo plans to pay for the equipment through a cash capital increase and bank financing, and it noted the purchase is not revenue and does not mean it holds firm orders from its partners.
Biggo reported that only about 33 units are under signed customer contracts, with roughly 150 more in negotiation. The same report put total project investment near NT$130 billion, but that figure includes installation work, with the equipment itself making up about 40 to 50 percent. In other words, a large share of this order is Apollo reserving supply ahead of demand. Apollo’s chairman told local media global large storage supply is tight, which is why the company locked in the units early, according to Yahoo Taiwan Finance.
Apollo also launched an AI data center and grid resilience alliance with Phison, Gigabyte and Shihlin Electric. The pitch rests on a pilot at Phison’s Zhunan plant, where Apollo and Tesla Energy Taiwan installed grid forming Megapack 2XLs in June. Tesla Energy Taiwan general manager Sun Hsiao-Han said the project went from demo to 1GWh in four months, and that Tesla Energy has deployed more than 50GWh worldwide.
Taiwan’s cabinet has approved amendments that would require large energy users to install their own generation and storage, which gives enterprise storage a regulatory tailwind.
The deal fits a pattern Teslarati has tracked. Tesla’s Megablock targets 1GWh commissioned in 20 business days, a pitch aimed squarely at fast moving data center builds. Megapacks already back xAI’s Colossus in Memphis and a 400MW AI campus in Brazil. Sun Media adds that Megapack 2XL was named among the first products in Nvidia’s DSX Ready qualification for battery storage in AI factories.
Deliveries are more than a year away, so the real test is how much of that 260 unit order turns into signed customer contracts.
For a century, the car has asked the same thing of its owner, which is basically to pay attention. Even the best ride-hailing app like Uber or Lyft only moved the problem into someone else’s hands. You stopped driving, but you still sat in a stranger’s car, while half listening, and wondering whether to take a phone call in the car without being rude. The Cybercab has no wheel, no pedals and no driver. With Grok @bot now live inside it, it becomes something else entirely, and I think that matters more than the fleet count that everyone is tracking.
Grok @bot is an agent, not a voice assistant. A rider signs in once, and from then on can say what they need and watch it happen. Order dinner from a favorite restaurant. Fill the grocery cart. Move money, answer email, adjust a calendar, push a work project forward. Tesla engineer Yun-Ta Tsai confirmed it is enabled across every Cybercab and the rest of the Model Y fleet, and Tesla’s own pitch is that Full Self-Driving handles the commute while Grok handles the errands.
Think about what that does to a thirty minute ride. Uber sells you a trip, while Waymo sells you the same trip in a more private setting. Tesla is selling the thirty minutes themselves, returned to you with an assistant attached. Errands that used to eat a Saturday get done between pickup and drop off. The ride stops being dead time between two places and becomes a place of its own.
Tesla integrates Grok Bot into its vehicles for the ultimate personal assistant
Best of all, your Bots follow you into any Cybercab, and presumably your own Tesla, then logs you out automatically when you step out. Anyone can bolt a chatbot onto a screen, but much harder to own the vehicle, the autonomy stack and the assistant at once. It also quietly ties SpaceX’s Super Intelligence business to Tesla’s fleet, after Tesla converted its xAI stake into SpaceX equity. The relationship between those two companies is getting harder to describe as separate.
This is also where the hard questions start, because an agent that can spend your money in a vehicle other people also ride in needs some answers. How does it handle a voice it shouldn’t trust? What gets recorded, who can see it, and for how long? What happens when a rider leaves halfway through a task?
If Tesla gets those answers right, the scoreboard changes. We have been counting Cybercabs and wait times. The more telling number may be what riders accomplish per trip. That is data almost no one else will ever have, and it is the real reason to watch Grok @bot.
What do you think? Leave me a comment.
SpaceX just combined Grok, Cursor, and X into one mega plan
Taiwan power firm bets big on Tesla Megapacks as AI data center thirst grows
Tesla Cybercab and Robotaxi’s real advantage won’t be the ride service
The Pentagon taps Elon Musk to design the battlefield of the future
Tesla Roadster’s new patent preps white-knuckle speeds, keeping it grounded
