Connect with us

News

Elon Musk-led xAI unveils Grok 1.5V featuring visual processing

Credit: Elon Musk | X

Published

on

Elon Musk’s artificial intelligence (AI) company xAI is set to introduce a version of its Grok language model that can process visuals, as shared by the company this week.

In a press release shared on its website on Friday, xAI announced Grok 1.5V, or Grok 1.5 Vision, its first AI model to process video alongside processing text. The news means that Grok can now process visual information such as documents, photos, diagrams and more, along with making the model competitive with other multimodal platforms.

“Introducing Grok-1.5V, our first-generation multimodal model,” writes xAI in the release. “In addition to its strong text capabilities, Grok can now process a wide variety of visual information, including documents, diagrams, charts, screenshots, and photographs. Grok-1.5V will be available soon to our early testers and existing Grok users.”

While it isn’t yet publicly released, xAI says that Grok 1.5V will soon become available to early testers and existing Grok users.

The post also includes detailed benchmarking information comparing Grok 1.5V with multimodal competitors such as OpenAI’s ChatGPT-4V, Anthropic’s Claude 3 Sonnet and Claude 3 Opus, and the Google-owned Gemini Pro 1.5. In addition, the release shares seven different examples of how Grok 1.5V can use visual information, including the use of real-world images or translating charts into code.

You can see the Grok 1.5V benchmarking chart below, along with two of the examples of visual processing.

Credit: xAI

Credit: xAI

The multimodal model arrives after Musk said earlier this year that xAI was preparing to launch Grok 1.5. In an interview held earlier this week, Musk also said that he believes we’ll have AI that’s smarter than any one human by the end of 2025, while he thinks the compute power of AI will exceed all humans in just five years.

Last month, xAI officially made Grok’s base model weights and network architecture open source, after Musk’s many criticisms and even a lawsuit of former non-profit OpenAI for abandoning its not-for-profit mission and avoiding making its own GPT models open source.

Following reports in January that claimed xAI had been raising capital, Musk denied the allegations, adding that the company has no plans to raise funding at this time. Musk debuted xAI last July, and the company went on to launch Grok as its first product in November.

Advertisement
-

Updated 5:02 p.m. MT: Seventh paragraph edited for clarity.

What are your thoughts? Let me know at zach@teslarati.com, find me on X at @zacharyvisconti, or send your tips to us at tips@teslarati.com.

Zach is a renewable energy reporter who has been covering electric vehicles since 2020. He grew up in Fremont, California, and he currently lives in Colorado. His work has appeared in the Chicago Tribune, KRON4 San Francisco, FOX31 Denver, InsideEVs, CleanTechnica, and many other publications. When he isn't covering Tesla or other EV companies, you can find him writing and performing music, drinking a good cup of coffee, or hanging out with his cats, Banks and Freddie. Reach out at zach@teslarati.com, find him on X at @zacharyvisconti, or send us tips at tips@teslarati.com.

Advertisement
Comments

News

Tesla Theater might be getting plenty more streaming platforms

Published

on

Credit: YouTube/Tesla Theater

The in-car Tesla Theater is among the most unique features available within the cars. When charging, parked, camping, or just hanging out, vehicle occupants can access a variety of streaming platforms on the large center screen, helping keep them entertained during downtime.

However, the Theater might be getting plenty more streaming platforms, something that owners have requested for some time.

Tesla owners recently discovered that visiting Apple TV in the vehicle browser can launch a fullscreen interface that looks and behaves like a dedicated application rather than an ordinary webpage:

The experience drops the usual address bar and browser chrome, presenting catalogs, continue watching rows, and playback controls in the same window Tesla Theater already uses for its listed services. Independent testers soon found similar treatment for HBO Max, Paramount+, Peacock, Disney+, and Prime Video when those sites are opened from the car browser.

This shift is a plausible early signal that Tesla is widening Theater support without a formal software note. Theater has long been a set of web views rather than native applications, so recognizing extra domains and stripping the browser frame is a small server-side change that can expand the catalog quickly.

Owners still lack permanent Theater icons for the newly recognized services, and video remains limited to Park, yet the smoother launch is a meaningful step toward a broader lounge while charging.

Tesla Theater arrived with software version 10 in September 2019. The first video services were Netflix, YouTube, and Hulu, available only while parked and originally tied to WiFi. Spotify arrived in the same era as music rather than Theater video. Disney+ joined officially in July 2021 with the 2021.24 update, giving owners another major catalog on the center screen. Twitch and TikTok later appeared among the default Theater tiles, and Tesla Tutorials remained a persistent educational tile.

Advertisement
-

Not every addition stayed put. In December 2023, a Holiday software build removed the Disney+ tile for many United States owners after a public dispute involving advertising on X. Hulu stayed visible even though Disney owned it. Visiting disneyplus.com in the browser often restored the tile, which suggested the removal was a recognition list change rather than a complete block. Owners have also reported occasional blank Theater grids after updates, usually fixed by language toggles, resets, or later firmware.

Tesla axes Disney+ from vehicles with Musk-Iger rivalry, but there’s a workaround

Code archives from 2024 listed many unused source names, including Apple TV and Prime Video, that never became official icons, which now looks like groundwork for the current fullscreen browser behavior.

Now that this hint toward an expanded Theater experience has been recognized, Tesla could follow through with these additional shortcuts as a sign that more streaming platforms are available in Teslas than ever before.

Continue Reading

News

Tesla Semi’s biggest adoptee gives an update on production timeline

Published

on

Credit: Tesla

Tesla recently received its largest order for the all-electric Semi from Einride, a Swedish transport service, for 500 units, a groundbreaking invoice to receive before the first deliveries begin.

Even more remarkable, Einride CEO Roozbeh Charli said in a recent interview that he expects his company to take delivery of all 500 — the entire order — before the end of 2027. He even expects to have 75 Tesla Semi units in the Einride fleet before the end of this year.

Charli said the Tesla partnership was part of a broader push, along with its earlier partnership with Amazon. Einride is assisting Amazon with the use of its Saga AI platform, which helps eliminate questions about budgeting and forecasting for logistics companies.

The Semi, as well as Tesla’s production and subsequent delivery of the units to Einride, will help the company “to have a good supply of vehicles that we can deploy on the [Saga AI] platform,” Charli said. “Tesla is also a relationship we’ve had for a while, and as the Tesla Semi deliveries are firming up, we decided to do a larger commitment to that and deploy that on our platform.”

In its initial announcement, Einride said it anticipated taking delivery of the trucks over the next two years, but now it appears the company is expecting all 500 units within the next 16 months.

Tesla Semi gets its largest order yet

Built at a dedicated factory in Sparks, Nevada, the Tesla Semi has been perhaps the biggest and most intensive testing process the company has ever had for a single vehicle model. For the past several years, Tesla has been working with many companies, most notably Frito-Lay and PepsiCo, to gain knowledge on the performance on regional routes.

Advertisement
-

Tesla plans to launch the Semi officially on September 24, five months after production started ramping.

Additionally, drivers have said they are happy about the Semi’s performance and that its numerous safety and productivity features have made their jobs and routes much easier.

Continue Reading

News

Tesla Cybercab uses a unique strategy for picking up the right rider

Published

on

Credit: ARTSIMAGE | X

Tesla Cybercab is using a unique strategy for picking up the correct rider, which is a crucial part of ride-hailing to ensure people end up in the right place and are charged the correct price.

Cybercab will utilize an RGB strip in its front light bar that will illuminate in a variety of different colors to mark itself.

This identifying mark will also appear in the Robotaxi app, giving riders in the same location a notable distinction in an effort to avoid any confusion regarding who should get in each vehicle.

Other ride-hailing services use similar strategies: Lyft and Uber rides are recognizable through driver identity, vehicle type and color, as well as license plate. Waymo will display the rider’s initials on top of the vehicle, letting them know that the specific vehicle for them has arrived.

Tesla’s strategy is unique and interesting, but there are some flaws. Cybercab’s main purpose is aimed toward being an autonomous ride for all, including those who have disabilities like being blind or even color blind.

Tesla will likely have something in the pipeline for those who cannot see colors or have limited vision. There will definitely be multiple ways to identify which vehicle is the one that “you” specifically ordered.

Cybercab is set to start giving public rides next Thursday, September 3, in Austin, as it announced a dedicated event last week and invited many members of the Tesla community.

Advertisement
-

Tesla will launch Cybercab on September 3

Additionally, members of the public will be invited as well. Tesla has been offering employee rides in Cybercab for nearly two months.

Continue Reading