Connect with us

News

Tesla Smart Summon patent highlights progress in 3D labeling for full self-driving features

Tesla Smart Summon in action. (Credit: Rody Davis/YouTube)

Published

on

A recently published Tesla patent application details the machine learning methods behind Smart Summon, specifically highlighting the progress being made with 3D labeling in training data.

The application, titled “Autonomous and User Controlled Vehicle Summon to a Target,” utilizes machine learning methods explicitly detailed in two other recent Tesla patent publications in its functionality. This series of three inventions altogether describes an automated way of generating training data which is then used by a machine learning model to accomplish an expansive list of self-driving capabilities in Summon.

“Traditionally, much of the effort to curate a training data set is done manually by reviewing potential training data and properly labeling the features associated with the data,” Tesla’s first application in the series states. “The effort required to create a training set with accurate labels can be significant and is often tedious… Therefore, there exists a need to improve the process for generating training data with accurate labeled features.”

The application goes on to describe how labeled training data is made autonomously in their invention using sensors and the collection of what’s called a “time series,” i.e., a series of images captured over a period of time.

“Using data captured by sensors on a vehicle to capture the environment of the vehicle and vehicle operating parameters, a training data set is created,” it explains. “In some embodiments, a three-dimensional representation of a feature, such as a lane line, is created from the group of time series elements that corresponds to the ground truth… As one example, a series of images for a time period, such as 30 seconds, is used to determine the actual path of a vehicle lane line over the time period the vehicle travels…a single image of the group and the actual path taken can be used as training data to predict the path of the vehicle.”

Advertisement

Tesla CEO Elon Musk has previously mentioned that better labeling is one of the keys to speeding up the rollout of self-driving functionality and features like Reverse Summon. “We need to finish work on Autopilot core foundation code & 3D labeling, then functionality will happen quickly. Not long now,” Musk wrote on Twitter in March this year. With better labeling (more accurate training data) comes safer and more capable software due to improved predictions from the modeling.

Tesla Owners Silicon Valley Smart Summon Model 3s (Credit: @MinimalDuck)

When it comes to Tesla’s Smart Summon, prediction modeling is essential considering there isn’t a driver in the vehicle during its operation. The patent publication covering Summon embodies the first application’s time series functionality and a second application’s implementation of the time series’ training data in its methods, demonstrating one of the numerous potential uses for the machine learning invention. Hints about future developments using Smart Summon are also detailed in the application. Examples include:

  • Syncing the Smart Summon with a calendar so the vehicle “automatically navigates to arrive at the location at the ending time, such as the end of a dinner party, a wedding, a restaurant reservation, etc.”
  • Implementing a multi-part destination into the Summon instructions such as waypoints at an airport to pick up multiple passengers.
  • Monitoring the heartbeat of a Summon user to ensure they are maintaining a connection with the vehicle while operating the feature.
  • Customizing the vehicle’s arrival settings such as interior lighting, exterior lighting, hazard lights, welcome music, and climate control preferences.

One of the more unique bits about the Smart Summon patent application is the appearance of Elon Musk as an inventor. While the CEO is known to be intimately involved in nearly all aspects of vehicle design, software features, and business operations, his name is unexpectedly absent from most of the company’s inventions. However, this is apparently on purpose. “I generally try my best not to be on patents,” he revealed on Twitter in reply to a post about the Smart Summon application. Notably, inventorship is a legal definition based on the conception of an invention, i.e., not the person/people who suggested or directed its creation, but the person/people who devised the means to accomplish it.

Prior to the most recent patent publication, Musk contributed inventorship to the door and body styling of the Model X. He also contributed the same to both the design and function of Tesla’s vehicle charge inlets.

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
Comments

News

Waymo temporarily halts service in select San Francisco and LA areas amid protests

The suspensions came after several Waymo Jaguar I-Pace robotaxis were vandalized and set ablaze during the demonstrations.

Published

on

Credit: ABC7/YouTube

Waymo, Alphabet’s autonomous vehicle subsidiary, has suspended its driverless taxi operations in parts of Los Angeles and San Francisco amid violent protests linked to U.S. Immigration and Customs Enforcement (ICE) raids in the state. 

The suspensions came after several Waymo Jaguar I-Pace robotaxis were vandalized and set ablaze during the demonstrations.

Waymo Catches Strays Amid Anti-ICE Protests

Protests erupted in Los Angeles and San Francisco in response to the Trump administration’s immigration raids, which ultimately resulted in California Governor Gavin Newsom calling the White House’s deployment of National Guard troops unconstitutional. 

Amidst the protests, images and videos emerged showing several Waymo robotaxis being defaced and destroyed. At least five Waymo robotaxis ended up being caught in the crossfire, and at least one vehicle ended up being burned to the ground. 

The incident resulted in the Los Angeles Police Department advising people to avoid downtown areas due to toxic fumes from the robotaxis’ burning lithium-ion batteries. As noted in a KRON4 report, Waymo ultimately halted service in affected areas “out of an abundance of caution.”

Advertisement

Robotaxi Sentiments

The cost of the attacks is notable. Each Waymo robotaxi is valued between $150,000 and $200,000, per a 2024 Wall Street Journal report. Interestingly enough, this is not the first time that Waymo’s robotaxis ended up on the receiving end of angry protesters. On February 24, a Jaguar I-PACE robotaxi was set ablaze and vandalized by a crowd in San Francisco. Videos taken at the time showed a mob of people attacking the vehicle. 

Despite the recent attacks on its robotaxis, Waymo has stated it has “no reason to believe” its vehicles were specifically targeted during the protests, as per a report from The Washington Post. A company spokesperson also noted that some of the Waymo robotaxis that were defaced and destroyed during the violent demonstrations had been completing drop-offs near the protest zones.

Continue Reading

Investor's Corner

xAI targets $5 billion debt offering to fuel company goals

Elon Musk’s xAI is targeting a $5B debt raise, led by Morgan Stanley, to scale its artificial intelligence efforts.

Published

on

(Credit: xAI)

xAI’s $5 billion debt offering, marketed by Morgan Stanley, underscores Elon Musk’s ambitious plans to expand the artificial intelligence venture. The xAI package comprises bonds and two loans, highlighting the company’s strategic push to fuel its artificial intelligence development.

Last week, Morgan Stanley began pitching a floating-rate term loan B at 97 cents on the dollar with a variable interest rate of 700 basis points over the SOFR benchmark, one source said. A second option offers a fixed-rate loan and bonds at 12%, with terms contingent on investor appetite. This “best efforts” transaction, where the debt size hinges on demand, reflects cautious lending in an uncertain economic climate.

According to Reuters sources, Morgan Stanley will not guarantee the issue volume or commit its own capital in the xAI deal, marking a shift from past commitments. The change in approach stems from lessons learned during Musk’s 2022 X acquisition when Morgan Stanley and six other banks held $13 billion in debt for over two years.

Morgan Stanley and the six other banks backing Musk’s X acquisition could only dispose of that debt earlier this year. They capitalized on X’s improved operating performance over the previous two quarters as traffic on the platform increased engagement around the U.S. presidential elections. This time, Morgan Stanley’s prudent strategy mitigates similar risks.

Advertisement

Beyond debt, xAI is in talks to raise $20 billion in equity, potentially valuing the company between $120 billion and $200 billion, sources said. In April, Musk hinted at a significant valuation adjustment for xAI, stating he was looking to put a “proper value” on xAI during an investor call.

As xAI pursues this $5 billion debt offering, its financial strategy positions it to lead the AI revolution, blending innovation with market opportunity.

Continue Reading

News

SpaceX to debut new Dragon capsule in Axiom Space launch

Ax-4’s launch marks the debut of SpaceX’s latest Crew Dragon and pushes Axiom closer to building its own space station.

Published

on

spacex-dragon-axiom-ax-4-mission-iss
(Credit: SpaceX)

Axiom Space’s Ax-4 mission targets the International Space Station (ISS) with a new SpaceX Crew Dragon capsule.

The Axiom team will launch a new SpaceX Dragon capsule atop a Falcon 9 rocket from NASA’s Kennedy Space Center in Florida on Wednesday at 8:00 a.m. EDT (1200 GMT). The Ax-4 mission launch was initially set for Tuesday, June 10, but was delayed by one day due to expected high winds.

As Axiom Space’s fourth crewed mission to the ISS, Ax-4 marks the debut of an updated SpaceX Crew Dragon capsule. “This is the first flight for this Dragon capsule, and it’s carrying an international crew—a perfect debut. We’ve upgraded storage, propulsion components, and the seat lash design for improved reliability and reuse,” said William Gerstenmaier, SpaceX’s vice president of build and flight reliability.

Axiom Space is a Houston-based private space infrastructure company. It has been launching private astronauts to the ISS for research and training since 2022, building expertise for its future station. With NASA planning to decommission the ISS by 2030, Axiom has laid the groundwork for the Axiom Station, the world’s first commercial space station. The company has already begun construction on its ISS replacement.

Advertisement

The Ax-4 mission’s research, spanning biological, life, and material sciences and Earth observation, will support this ambitious goal. Contributions from 31 countries underscore the mission’s global scope. The four-person crew will launch from Launch Complex 39A, embarking on a 14-day mission to conduct approximately 60 scientific studies.

“The AX-4 crew represents the very best of international collaboration, dedication, and human potential. Over the past 10 months, these astronauts have trained with focus and determination, each of them exceeding the required thresholds to ensure mission safety, scientific rigor, and operational excellence,” said Allen Flynt, Axiom Space’s chief of mission services.

The Ax-4 mission highlights Axiom’s commitment to advancing commercial space exploration. By leveraging SpaceX’s Dragon capsule and conducting diverse scientific experiments, Axiom is paving the way for its Axiom Station. This mission not only strengthens international collaborations but also positions Axiom as a leader in the evolving landscape of private space infrastructure.

Continue Reading

Trending