News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
Elon Musk
The Tesla and SpaceX merger everyone is talking about is quietly building
Tesla and SpaceX may be closer to merging than Wall Street or either company is admitting.
Elon Musk has reportedly discussed merging Tesla and SpaceX with people close to him, according to CNBC, which cited sources familiar with the conversation. Tesla employees have long expected such a transaction and the topic is openly discussed internally, according to internal sources. With SpaceX is days away from kicking off its Wall Street roadshow for what could be the largest IPO in market history, this would be the first time the company will have public market currency to execute a stock-for-stock deal with Tesla.
The financial logic for a merger would make sense. A combined SpaceX and Tesla would create a conglomerate spanning rockets, satellites, electric vehicles, AI infrastructure, and energy storage valued at roughly $3.35 trillion to $3.6 trillion based on SpaceX’s IPO target range and Tesla’s current market capitalization. The two companies are already more intertwined than most people realize. SpaceX bought $697 million worth of Tesla Megapack systems for xAI data centers and $131 million worth of Cybertrucks. Tesla invested $2 billion in xAI, which subsequently merged with SpaceX. Past transactions also include Tesla selling solar equipment and parts to SpaceX, and SpaceX helping with Cybertruck materials.
Will Tesla join the fold? Predicting a triple merger with SpaceX and xAI
Musk himself signaled where this was heading in November 2025 when he posted on X, “My companies are, surprisingly in some ways, trending towards convergence.” Tesla and SpaceX announced a joint semiconductor fabrication facility in Austin called Terafab on the Gigafactory Texas campus, covering two advanced chip factories, with one serving Tesla’s AI needs for vehicles and Optimus robots, the other targeting space-based data centers under SpaceX’s infrastructure vision.
Wedbush analyst Dan Ives places the probability of a merger at 80% to 90% with a target completion in the first half of 2027. The mechanics of a deal became possible the moment SpaceX filed its S-1. Legal experts said a merger likely would not spark antitrust issues but would raise concerns among shareholders in each company, with questions around which company would be the parent, how a stock swap would take place, and who determines the appropriate price. Musk holds about 20% of Tesla’s equity but controls 85.1% of SpaceX’s voting power through a super-voting share class, meaning he would largely be negotiating the terms with himself.
Not everyone is convinced the timing is imminent. Traders on Kalshi place only 33% odds that a merger will happen before May 2027. The more immediate concern for Tesla shareholders is whether the SpaceX IPO pulls capital and Musk’s attention away from Tesla before any merger consolidates the upside for both.
What is clear is that the structural groundwork is already being laid. The Terafab announcement, the xAI merger, the shared supply chain, the cross-company balance sheet transactions, and now the IPO all point in the same direction. Whether the merger follows in 2027 or later, the two companies are already operating more like divisions of a single entity than independent competitors.
Elon Musk
SpaceX to become America’s Military data backbone for missiles, drones, and warfighters
The Space Force just handed SpaceX $2.29 billion to build the military’s space internet backbone.
The U.S. Space Force awarded SpaceX a $2.29 billion contract on May 26, 2026 to build the backbone of its Space Data Network, a satellite-based communications system designed to keep American military forces connected anywhere on Earth in real time. The contract is firm-fixed-price and requires SpaceX to deliver a fully operational prototype by the end of 2027.
In plain terms, the SDN Backbone is the plumbing behind the military’s space-based internet. It functions as a low Earth orbit satellite constellation providing robust, high-capacity, and low-latency data transport for the Joint Force, connecting sensors and weapons systems continuously, globally, and securely. Think of it as a private, hardened version of Starlink built specifically for battlefield communications, one that soldiers, ships, and aircraft can rely on even in contested environments where ground-based networks have been disrupted.
SpaceX is quietly becoming the U.S. Military’s only reliable rocket
The Space Force was direct about why SpaceX was selected. “The SDN Backbone leverages the best of commercial innovation and delivers a strong foundation for the SDN mission set — a huge benefit and enabler for our warfighters,” said USSF Col. Ryan Frazier.
“We aren’t trading speed for scale; we are demanding both. By using rapid prototyping and Other Transaction Authorities, we are ensuring our advanced solutions are integrated and delivered to the warfighter as fast as possible,” added USSF Lt. Col. Fry, SDN Backbone system program manager.
The SDN Backbone will work alongside the Space Development Agency’s Transport Layer, with the two systems forming a unified open architecture to provide critical data transport for current and future Department of War missions.
As Teslarati has reported, this is not SpaceX’s first Space Force contract of 2026. In April, the Space Force awarded SpaceX $178.5 million to launch missile tracking satellites, and SpaceX is already embedded in the Golden Dome missile defense software group. The $2.29 billion SDN Backbone award puts SpaceX at the center of how the American military communicates in space, a position with direct implications for its reported $1.75 trillion IPO valuation as the company heads toward a public offering as early as June 2026.
Tesla’s dedicated factory for building up to ten million Optimus units is officially under construction at Gigafactory Texas.
Drone footage released on May 27 by Giga Texas observer Joe Tegtmeyer captures the significant milestone of the first steel structure officially standing at Tesla’s new Optimus factory on the North Campus of the facility.
Phase two of land reclamation is advancing steadily, and the progress will let the new building extend nearly the full length of the main Giga Texas factory, potentially exceeding 4,000 feet, while measuring somewhere between 50 and 70 meters narrower. Extensive foundation work is proceeding as well.
Big news at the new Optimus 10m/y factory construction site today! The 1st steel structure has been erected & as expected the second phase of land reclamation is underway.
This will allow this new factory to grow to nearly the same length as the main Giga Texas factory,… pic.twitter.com/FidRLV6XpU
— Joe Tegtmeyer 🚀 🤠🛸😎 (@JoeTegtmeyer) May 27, 2026
This facility forms a central element of Tesla’s broader North Campus expansion at Giga Texas. The project will add more than 5.2 million square feet of new industrial space. It sits alongside other advanced developments, including a Terafab for next-gen AI chips. The scale reflects Tesla’s commitment to transforming humanoid robotics into a core pillar of the company’s future.
Musk has said that Optimus will be the biggest product in the world on several occasions. He believes it will be Tesla’s biggest valuation contributor.
Tesla prepares to expand Giga Texas with new Optimus production plant
Tesla plans to build about 10 million robots at the site annually once it is completed, which would be about 27,000 units each day.
The Optimus plant at Giga Texas is part of Tesla’s phased strategy for Optimus manufacturing. In an effort to start production of the robot well before the Giga Texas plant is complete, Tesla ended production of the Model S and Model X vehicles, which were built in Fremont, California, to make way for initial Optimus manufacturing efforts.
Production there will start in either July or August of this year, and early units will support internal factory tasks while the team gathers real-world data to refine processes. The Gigafactory Texas facility will house a second-gen production line. It targets high-volume output starting in Summer 2027.
Musk has repeatedly described Optimus as potentially more valuable than Tesla’s entire vehicle business. Current versions are already completing minor tasks around various facilities, while Tesla continues to refine its abilities and add new features.
Tesla’s total investment could reach several billion dollars. Significant challenges lie ahead, including the creation of an entirely new manufacturing ecosystem, the refinement of AI systems for dependable autonomy, and the development of reliable supply chains for actuators, sensors, and other components.
Nevertheless, the visible progress at Giga Texas highlights Tesla’s capacity to translate ambitious concepts into physical reality.
Tesla’s Optimus factory stands as much more than a simple expansion project, as it is quite literally the second phase of what could potentially be the biggest product ever. With construction beginning, 2027 is poised to become a transformative year for Tesla, as it evolves even further from an electric vehicle leader into a pioneer of intelligent, general-purpose machines.
The Tesla and SpaceX merger everyone is talking about is quietly building
SpaceX to become America’s Military data backbone for missiles, drones, and warfighters
