Connect with us

News

Elon Musk-led xAI unveils Grok 1.5V featuring visual processing

Credit: Elon Musk | X

Published

on

Elon Musk’s artificial intelligence (AI) company xAI is set to introduce a version of its Grok language model that can process visuals, as shared by the company this week.

In a press release shared on its website on Friday, xAI announced Grok 1.5V, or Grok 1.5 Vision, its first AI model to process video alongside processing text. The news means that Grok can now process visual information such as documents, photos, diagrams and more, along with making the model competitive with other multimodal platforms.

“Introducing Grok-1.5V, our first-generation multimodal model,” writes xAI in the release. “In addition to its strong text capabilities, Grok can now process a wide variety of visual information, including documents, diagrams, charts, screenshots, and photographs. Grok-1.5V will be available soon to our early testers and existing Grok users.”

While it isn’t yet publicly released, xAI says that Grok 1.5V will soon become available to early testers and existing Grok users.

The post also includes detailed benchmarking information comparing Grok 1.5V with multimodal competitors such as OpenAI’s ChatGPT-4V, Anthropic’s Claude 3 Sonnet and Claude 3 Opus, and the Google-owned Gemini Pro 1.5. In addition, the release shares seven different examples of how Grok 1.5V can use visual information, including the use of real-world images or translating charts into code.

Advertisement
-->

You can see the Grok 1.5V benchmarking chart below, along with two of the examples of visual processing.

Credit: xAI

Credit: xAI

Credit: xAI

The multimodal model arrives after Musk said earlier this year that xAI was preparing to launch Grok 1.5. In an interview held earlier this week, Musk also said that he believes we’ll have AI that’s smarter than any one human by the end of 2025, while he thinks the compute power of AI will exceed all humans in just five years.

Last month, xAI officially made Grok’s base model weights and network architecture open source, after Musk’s many criticisms and even a lawsuit of former non-profit OpenAI for abandoning its not-for-profit mission and avoiding making its own GPT models open source.

Following reports in January that claimed xAI had been raising capital, Musk denied the allegations, adding that the company has no plans to raise funding at this time. Musk debuted xAI last July, and the company went on to launch Grok as its first product in November.

Advertisement
-->

Updated 5:02 p.m. MT: Seventh paragraph edited for clarity.

What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send your tips to us at tips@teslarati.com.

Zach is a renewable energy reporter who has been covering electric vehicles since 2020. He grew up in Fremont, California, and he currently lives in Colorado. His work has appeared in the Chicago Tribune, KRON4 San Francisco, FOX31 Denver, InsideEVs, CleanTechnica, and many other publications. When he isn't covering Tesla or other EV companies, you can find him writing and performing music, drinking a good cup of coffee, or hanging out with his cats, Banks and Freddie. Reach out at zach@teslarati.com, find him on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Advertisement
Comments

News

Tesla hosts Rome Mayor for first Italian FSD Supervised road demo

The event marked the first time an Italian mayor tested the advanced driver-assistance system in person in Rome’s urban streets.

Published

on

Credit: @andst7/X

Tesla definitely seems to be actively engaging European officials on FSD’s capabilities, with the company hosting Rome Mayor Roberto Gualtieri and Mobility Assessor Eugenio Patanè for a hands-on road demonstration. 

The event marked the first time an Italian mayor tested the advanced driver-assistance system in person in Rome’s urban streets. This comes amid Tesla’s push for FSD’s EU regulatory approvals in the coming year.

Rome officials experience FSD Supervised

Tesla conducted the demo using a Model 3 equipped with Full Self-Driving (Supervised), tackling typical Roman traffic including complex intersections, roundabouts, pedestrian crossings and mixed users like cars, bikes and scooters.

The system showcased AI-based assisted driving, prioritizing safety while maintaining flow. FSD also handled overtakes and lane decisions, though with constant driver supervision.

Investor Andrea Stroppa detailed the event on X, noting the system’s potential to reduce severe collision risks by up to seven times compared to traditional driving, based on Tesla’s data from billions of global fleet miles. The session highlighted FSD’s role as an assistance tool in its Supervised form, not a replacement, with the driver fully responsible at all times.

Advertisement
-->

Path to European rollout

Tesla has logged over 1 million kilometers of testing across 17 European countries, including Italy, to refine FSD for local conditions. The fact that Rome officials personally tested FSD Supervised bodes well for the program’s approval, as it suggests that key individuals are closely watching Tesla’s efforts and innovations.

Assessor Patanè also highlighted the administration’s interest in technologies that boost road safety and urban travel quality, viewing them as aids for both private and public transport while respecting rules.

Replies on X urged involving Italy’s Transport Ministry to speed approvals, with one user noting, “Great idea to involve the mayor! It would be necessary to involve components of the Ministry of Transport and the government as soon as possible: it’s they who can accelerate the approval of FSD in Italy.”

Continue Reading

News

Tesla FSD (Supervised) blows away French journalist after test ride

Cadot described FSD as “mind-blowing,” both for the safety of the vehicle’s driving and the “humanity” of its driving behaviors.

Published

on

Credit: Grok Imagine

Tesla’s Full Self-Driving (Supervised) seems to be making waves in Europe, with French tech journalist Julien Cadot recently sharing a positive first-hand experience from a supervised test drive in France. 

Cadot, who tested the system for Numerama after eight years of anticipation since early Autopilot trials, described FSD as “mind-blowing,” both for the safety of the vehicle’s driving and the “humanity” of its driving behaviors.

 

Julien Cadot’s FSD test in France

Cadot announced his upcoming test on X, writing in French: “I’m going to test Tesla’s FSD for Numerama in France. 8 years I’ve been waiting to relive the sensations of our very first contact with the unbridled Autopilot of the 2016s.” He followed up shortly after with an initial reaction, writing: “I don’t want to spoil too much because as media we were allowed to film everything and I have a huge video coming… But: it’s mind-blowing! Both for safety and for the ‘humanity’ of the choices.”

His later posts detailed FSD’s specific maneuvers that he found particularly compelling. These include the vehicle safely overtaking a delivery truck by inches, something Cadot said he personally would avoid to protect his rims, but FSD handled flawlessly. He also praised FSD’s cyclist overtakes, as the system always maintained the required 1.5-meter distance by encroaching on the opposite lane when clear. Ultimately, Cadot noted FSD’s decision-making prioritized safety and advancement, which is pretty remarkable.

Advertisement
-->

FSD’s ‘human’ edge over Autopilot

When asked if FSD felt light-years ahead of standard Autopilot, Cadot replied: “It’s incomparable, it’s not the same language.” He elaborated on scenarios like bypassing a parked delivery truck across a solid white line, where FSD assessed safety and proceeded just as a human driver might, rather than halting indefinitely. This “humanity” impressed Cadot the most, as it allowed FSD to fluidly navigate real-world chaos like urban Paris traffic. 

Tesla is currently hard at work pushing for the rollout of FSD to several European countries. Recent reports have revealed that Tesla has received approval to operate 19 FSD test vehicles on Spain’s roads, though this number could increase as the program develops. As per the Dirección General de Tráfico (DGT), Tesla would be able to operate its FSD fleet on any national route across Spain. Recent job openings also hint at Tesla starting FSD tests in Austria. Apart from this, the company is also holding FSD demonstrations in Germany, France, and Italy.

Continue Reading

Elon Musk

Tesla Optimus shows off its newest capability as progress accelerates

Published

on

Credit: Tesla

Tesla Optimus showed off its newest capability as progress on the project continues to accelerate toward an ultimate goal of mass production in the coming years.

Tesla is still developing Optimus and preparing for the first stages of mass production, where units would be sold and shipped to customers. CEO Elon Musk has always marketed the humanoid robot as the biggest product in history, even outside of Tesla, but of all time.

He believes it will eliminate the need to manually perform monotonous tasks, like cleaning, mowing the lawn, and folding laundry.

However, lately, Musk has revealed even bigger plans for Optimus, including the ability to relieve humans of work entirely within the next 20 years.

Development at Tesla’s Artificial Intelligence and Robotics teams has progressed, and a new video was shown of the robot taking a light jog with what appeared to be some pretty natural form:

Optimus has also made several public appearances lately, including one at the Neural Information Processing Systems, or NeurIPS Conference. Some spectators shared videos of Optimus’s charging rig, as well as its movements and capabilities, most interestingly, the hand:

The hand, forearm, and fingers have been one of the most evident challenges for Tesla in recent times, especially as it continues to work on its 3rd Generation iteration of Optimus.

Musk said during the Q3 Earnings Call:

“I don’t want to downplay the difficulty, but it’s an incredibly difficult thing, especially to create a hand that is as dexterous and capable as the human hand, which is incredible. The human hand is an incredible thing. The more you study the human hand, the more incredible you realize it is, and why you need four fingers and a thumb, why the fingers have certain degrees of freedom, why the various muscles are of different strengths, and fingers are of different lengths. It turns out that those are all there for a reason.”

The interesting part of the Optimus program so far is the fact that Tesla has made a lot of progress with other portions of the project, like movement, for example, which appears to have come a long way.

However, without a functional hand and fingers, Optimus could be rendered relatively useless, so it is evident that it has to figure this crucial part out first.

Continue Reading