News
Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features
A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.
The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.
“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”
-
- A method flow chart from Tesla’s autonomous 3D labeling patent. | Image: Tesla/USPTO
-
- A method flow chart from Tesla’s Smart Summon patent application. | Image: Tesla/USPTO
The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.
“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”
Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.
When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:
- Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
- Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
- Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
- Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.
One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.
Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.
News
Tesla aims to combat common Full Self-Driving problem with new patent
Tesla writes in the patent that its autonomous and semi-autonomous vehicles are heavily reliant on camera systems to navigate and interact with their environment.
Tesla is aiming to combat a common Full Self-Driving problem with a new patent.
One issue with Tesla’s vision-based approach is that sunlight glare can become a troublesome element of everyday travel. Full Self-Driving is certainly an amazing technology, but there are still things Tesla is aiming to figure out with its development.
Unfortunately, it is extremely difficult to get around this issue, and even humans need ways to combat it when they’re driving, as we commonly use sunglasses or sun visors to give us better visibility.
Cameras obviously do not have these ways to fight sunglare, but a new patent Tesla recently had published aims to fight this through a “glare shield.”
Tesla writes in the patent that its autonomous and semi-autonomous vehicles are heavily reliant on camera systems to navigate and interact with their environment.
The ability to see surroundings is crucial for accurate performance, and glare is one element of interference that has yet to be confronted.
Tesla described the patent, which will utilize “a textured surface composed of an array of micro-cones, or cone-shaped formations, which serve to scatter incident light in various directions, thereby reducing glare and improving camera vision.”
The patent was first spotted by Not a Tesla App.
The design of the micro-cones is the first element of the puzzle to fight the excess glare. The patent says they are “optimized in size, angle, and orientation to minimize Total Hemispherical Reflectance (THR) and reflection penalty, enhancing the camera’s ability to accurately interpret visual data.”
Additionally, there is an electromechanical system for dynamic orientation adjustment, which will allow the micro-cones to move based on the angle of external light sources.
This is not the only thing Tesla is mulling to resolve issues with sunlight glare, as it has also worked on two other ways to combat the problem. One thing the company has discussed is a direct photon count.
CEO Elon Musk said during the Q2 Earnings Call:
“We use an approach which is direct photon count. When you see a processed image, so the image that goes from the sort of photon counter — the silicon photon counter — that then goes through a digital signal processor or image signal processor, that’s normally what happens. And then the image that you see looks all washed out, because if you point the camera at the sun, the post-processing of the photon counting washes things out.”
Future Hardware iterations, like Hardware 5 and Hardware 6, could also integrate better solutions for the sunglare issue, such as neutral density filters or heated lenses, aiming to solve glare more effectively.
Elon Musk
Delaware Supreme Court reinstates Elon Musk’s 2018 Tesla CEO pay package
The unanimous decision criticized the prior total rescission as “improper and inequitable,” arguing that it left Musk uncompensated for six years of transformative leadership at Tesla.
The Delaware Supreme Court has overturned a lower court ruling, reinstating Elon Musk’s 2018 compensation package originally valued at $56 billion but now worth approximately $139 billion due to Tesla’s soaring stock price.
The unanimous decision criticized the prior total rescission as “improper and inequitable,” arguing that it left Musk uncompensated for six years of transformative leadership at Tesla. Musk quickly celebrated the outcome on X, stating that he felt “vindicated.” He also shared his gratitude to TSLA shareholders.
Delaware Supreme Court makes a decision
In a 49-page ruling Friday, the Delaware Supreme Court reversed Chancellor Kathaleen McCormick’s 2024 decision that voided the 2018 package over alleged board conflicts and inadequate shareholder disclosures. The high court acknowledged varying views on liability but agreed rescission was excessive, stating it “leaves Musk uncompensated for his time and efforts over a period of six years.”
The 2018 plan granted Musk options on about 304 million shares upon hitting aggressive milestones, all of which were achieved ahead of time. Shareholders overwhelmingly approved it initially in 2018 and ratified it once again in 2024 after the Delaware lower court struck it down. The case against Musk’s 2018 pay package was filed by plaintiff Richard Tornetta, who held just nine shares when the compensation plan was approved.
A hard-fought victory
As noted in a Reuters report, Tesla’s win avoids a potential $26 billion earnings hit from replacing the award at current prices. Tesla, now Texas-incorporated, had hedged with interim plans, including a November 2025 shareholder-approved package potentially worth $878 billion tied to Robotaxi and Optimus goals and other extremely aggressive operational milestones.
The saga surrounding Elon Musk’s 2018 pay package ultimately damaged Delaware’s corporate appeal, prompting a number of high-profile firms, such as Dropbox, Roblox, Trade Desk, and Coinbase, to follow Tesla’s exodus out of the state. What added more fuel to the issue was the fact that Tornetta’s legal team, following the lower court’s 2024 decision, demanded a fee request of more than $5.1 billion worth of TSLA stock, which was equal to an hourly rate of over $200,000.
Delaware Supreme Court Elon Musk 2018 Pay Package by Simon Alvarez
News
Tesla Cybercab tests are going on overdrive with production-ready units
Tesla is ramping its real-world tests of the Cybercab, with multiple sightings of the vehicle being reported across social media this week.
Tesla is ramping its real-world tests of the Cybercab, with multiple sightings of the autonomous two-seater being reported across social media this week. Based on videos of the vehicle that have been shared online, it appears that Cybercab tests are underway across multiple states.
Recent Cybercab sightings
Reports of Cybercab tests have ramped this week, with a vehicle that looked like a production-ready prototype being spotted at Apple’s Visitor Center in California. The vehicle in this sighting was interesting as it was equipped with a steering wheel. The vehicle also featured some changes to the design of its brake lights.
The Cybercab was also filmed testing at the Fremont factory’s test track, which also seemed to involve a vehicle that looked production-ready. This also seemed to be the case for a Cybercab that was spotted in Austin, Texas, which happened to be undergoing real-world tests. Overall, these sightings suggest that Cybercab testing is fully underway, and the vehicle is really moving towards production.
Production design all but finalized?
Recently, a near-production-ready Cybercab was showcased at Tesla’s Santana Row showroom in San Jose. The vehicle was equipped with frameless windows, dual windshield wipers, powered butterfly door struts, an extended front splitter, an updated lightbar, new wheel covers, and a license plate bracket. Interior updates include redesigned dash/door panels, refined seats with center cupholders, updated carpet, and what appeared to be improved legroom.
There seems to be a pretty good chance that the Cybercab’s design has been all but finalized, at least considering Elon Musk’s comments at the 2025 Annual Shareholder Meeting. During the event, Musk confirmed that the vehicle will enter production around April 2026, and its production targets will be quite ambitious.
Tesla aims to combat common Full Self-Driving problem with new patent
Delaware Supreme Court reinstates Elon Musk’s 2018 Tesla CEO pay package
