Connect with us

News

Mars travelers can use ‘Star Trek’ Tricorder-like features using smartphone biotech: study

Published

on

Plans to take humans to the Moon and Mars come with numerous challenges, and the health of space travelers is no exception. One of the ways any ill-effects can be prevented or mitigated is by detecting relevant changes in the body and the body’s surroundings, something that biosensor technology is specifically designed to address on Earth. However, the small size and weight requirements for tech used in the limited habitats of astronauts has impeded its development to date.

A recent study of existing smartphone-based biosensors by scientists from Queen’s University Belfast (QUB) in the UK identified several candidates under current use or development that could be also used in a space or Martian environment. When combined, the technology could provide functionality reminiscent of the “Tricorder” devices used for medical assessments in the Star Trek television and movie franchises, providing on-site information about the health of human space travelers and biological risks present in their habitats.

Biosensors focus on studying biomarkers, i.e., the body’s response to environmental conditions. For example, changes in blood composition, elevations of certain molecules in urine, heart rate increases or decreases, and so forth, are all considered biomarkers. Health and fitness apps tracking general health biomarkers have become common in the marketplace with brands like FitBit leading the charge for overall wellness sensing by tracking sleep patterns, heart rate, and activity levels using wearable biosensors. Astronauts and other future space travelers could likely use this kind of tech for basic health monitoring, but there are other challenges that need to be addressed in a compact way.

The projected human health needs during spaceflight have been detailed by NASA on its Human Research Program website, more specifically so in its web-based Human Research Roadmap (HRR) where the agency has its scientific data published for public review. Several hazards of human spaceflight are identified, such as environmental and mental health concerns, and the QUB scientists used that information to organize their study. Their research produced a 20-page document reviewing the specific inner workings of the relevant devices found in their searches, complete with tables summarizing each device’s methods and suitability for use in space missions. Here are some of the highlights.

A chart showing the classification of scientific articles about relevant smartphone-based biosensors used in the Queen’s University Belfast study. | Credit: Biosensors/Queen’s University Belfast

Risks in the Spacecraft Environment

During spaceflight, the environment is a closed system that has a two-fold effect: One, the immune system has been shown to decrease its functionality in long-duration missions, specifically by lowering white blood cell counts, and two, the weightless and non-competitive environment make it easier for microbes to transfer between humans and their growth rates increase. In one space shuttle era study, the number of microbial cells in the vehicle able to reproduce increased by 300% within 12 days of being in orbit. Also, certain herpes viruses, such as those responsible for chickenpox and mononucleosis, have been reactivated under microgravity, although the astronauts typically didn’t show symptoms despite the presence of active viral shedding (the virus had surfaced and was able to spread).

Frequent monitoring of the spacecraft environment and the crew’s biomarkers is the best way to mitigate these challenges, and NASA is addressing these issues to an extent with traditional instruments and equipment to collect data, although often times the data cannot be processed until the experiments are returned to Earth. An attempt has also been made to rapidly quantify microorganisms aboard the International Space Station (ISS) via a handheld device called the Lab-on-a-Chip Application Development-Portable Test System (LOCAD-PTS). However, this device cannot distinguish between microorganism species yet, meaning it can’t tell the difference between pathogens and harmless species. The QUB study found several existing smartphone-based technologies generally developed for use in remote medical care facilities that could achieve better identification results.

Advertisement
-
NASA astronaut Karen Nyberg uses a fundoscope to image her eye while in orbit to study Visual Impairment Intracranial Pressure (VIIP) Syndrome. Smaller 3D printed retinal imaging adaptors for smartphones are being developed to perform the testing done by large devices similar to the instrument used here. | Credit: NASA

One of the devices described was a spectrometer (used to identify substances based on the light frequency emitted) which used the smartphone’s flashlight and camera to generate data that was at least as accurate as traditional instruments. Another was able to identify concentrations of an artificial growth hormone injected into cows called recominant bovine somatrotropin (rBST) in test samples, and other systems were able to accurately detect cyphilis and HIV as well as the zika, chikungunya, and dengue viruses. All of the devices used smartphone attachments, some of them with 3D-printed parts. Of course, the types of pathogens detected are not likely to be common in a closed space habitat, but the technology driving them could be modified to meet specific detection needs.

The Stress of Spaceflight

A group of people crammed together in a small space for long periods of time will be impacted by the situation despite any amount of careful selection or training due to the isolation and confinement. Declines in mood, cognition, morale, or interpersonal interaction can impact team functioning or transition into a sleep disorder. On Earth, these stress responses may seem common, or perhaps an expected part of being human, but missions in deep space and on Mars will be demanding and need fully alert, well-communicating teams to succeed. NASA already uses devices to monitor these risks while also addressing the stress factor by managing habitat lighting, crew movement and sleep amounts, and recommending astronauts keep journals to vent as needed. However, an all-encompassing tool may be needed for longer-duration space travels.

As recognized by the QUB study, several “mindfulness” and self-help apps already exist in the market and could be utilized to address the stress factor in future astronauts when combined with general health monitors. For example, the popular FitBit app and similar products collect data on sleep patterns, activity levels, and heart rates which could potentially be linked to other mental health apps that could recommend self-help programs using algorithms. The more recent “BeWell” app monitors physical activity, sleep patterns, and social interactions to analyze stress levels and recommend self-help treatments. Other apps use voice patterns and general phone communication data to assess stress levels such as “StressSense” and “MoodSense”.

A Tricorder-like setup is imagined by scientists at Queens University Belfast, utilizing the functionalities of existing smartphone-based biosensors. | Credit: Biosensors/Queens University Belfast

Advances in smartphone technology such as high resolution cameras, microphones, fast processing speed, wireless connectivity, and the ability to attach external devices provide tools that can be used for an expanding number of “portable lab” type functionalities. Unfortunately, though, despite the possibilities that these biosensors could mean for human spaceflight needs, there are notable limitations that would need to be overcome in some of the devices. In particular, any device utilizing antibodies or enzymes in its testing would risk the stability of its instruments thanks to radiation from galactic cosmic rays and solar particle events. Biosensor electronics might also be damaged by these things as well. Development of new types of shielding may be necessary to ensure their functionality outside of Earth and Earth orbit or, alternatively, synthetic biology could also be a source of testing elements genetically engineered to withstand the space and Martian environments.

The interest in smartphone-based solutions for space travelers has been garnering more attention over the years as tech-centric societies have moved in the “app” direction overall. NASA itself has hosted a “Space Apps Challenge” for the last 8 years, drawing thousands of participants to submit programs that interpret and visualize data for greater understanding of designated space and science topics. Some of the challenges could be directly relevant to the biosensor field. For example, in the 2018 event, contestants are asked to develop a sensor to be used by humans on Mars to observe and measure variables in their environments; in 2017, contestants created visualizations of potential radiation exposure during polar or near-polar flight.

While the QUB study implied that the combination of existing biosensor technology could be equivalent to a Tricorder, the direct development of such a device has been the subject of its own specific challenge. In 2012, the Qualcomm Tricorder XPRIZE competition was launched, asking competitors to develop a user-friendly device that could accurately diagnose 13 health conditions and capture 5 real-time health vital signs. The winner of the prize awarded in 2017 was Pennsylvania-based family team called Final Frontier Medical Devices, now Basil Leaf Technologies, for their DxtER device. According to their website, the sensors inside DxtER can be used independently, one of which is in a Phase 1 Clinical Trial. The second place winner of the competition used a smartphone app to connect its health testing modules and generate a diagnosis from the data acquired from the user.

The march continues to develop the technology humans will need to safely explore regions beyond Earth orbit. Space is hard, but it was hard before we went there the first time, and it was hard before we put humans on the moon. There may be plenty of challenges to overcome, but as the Queen’s University Belfast study demonstrates, we may already be solving them. It’s just a matter of realizing it and expanding on it.

Advertisement
-

Accidental computer geek, fascinated by most history and the multiplanetary future on its way. Quite keen on the democratization of space. | It's pronounced day-sha, but I answer to almost any variation thereof.

Advertisement
TESLARATI MARKETPLACE LIMITED-TIME OFFER

Give the gift of Tesla upgrades.

Shop for someone else or treat yourself. Get more shopping power with a Teslarati gift card.

YOU PAY $250
+
FREE BONUS $75
$325 TOTAL VALUE
Digital gift card delivered by email. Promotional terms apply.
View gift card details →
Comments

News

Tesla Full Self-Driving v15: Reality View review, new features explained

Published

on

Tesla has officially started rolling out the Full Self-Driving version 15 update, and we were lucky enough to get it in the first wave on Saturday night. It comes with a lot of new features, but the biggest is Tesla Reality View, a real-time AI video generation of the outside world that uses less compute than even the earliest versions of FSD driving visualization.

The release notes, which we covered on Saturday, revealed Reality View, Speed Camera Recognition and Slowdown, and a new Bike Rack Mode.

After spending plenty of time with the suite over the last 18 hours, I have a pretty good grasp of the new features and what you should expect from them when you get them on your Tesla. CEO Elon Musk said that it will wide release in December with the 2026 Holiday Update.

Advertisement
-

NOTE: If you’re looking for a review on FSD v15.0.1’s driving performance, I will have a small section breaking down what I noticed over the first drives I took, but I would rather hold off on making any real declarations about it until I have a few hundred miles under my belt. It just feels like I can’t make any real distinctions on anything other than a handful of things Tesla claims in its release notes.

Tesla Reality Vision

Let’s start what I know we are all here for: Tesla Reality Vision is here and it’s absolutely insane. Elon and Co. have also shed a lot of really cool tidbits about the development of it and some of its more intimate details. It’s pretty remarkable what they’re saying about it.

My first impression of Reality View was that it was incredibly detailed. It is honestly hard to believe, at first glance, that there is not a drone following your car. However, once you reach any sort of signage, it’s pretty obvious that it is not a puzzling of camera angles but exactly what Musk says it is:

Advertisement
-

My first rides with it revealed quite a few things.

  • It’s very impressive how realistic the texturing of the environment is. The grass, trees, buildings, and all of nature is really well rendered. You can see the shifting as you are moving; I’ve seen a lot of people compare it to the early versions of the Will Smith Spaghetti AI Videos, and that feels like a good comparison. It’s very, very good for a first attempt, and if it looks like this now, it isn’t unrealistic to say that it will look very close to realistic in the future. I would think within the next 8 months is probably somewhat realistic.
  • There is some input lag, and Musk has already addressed that by stating: “Currently, the latency is a bit high due to compute constraints, but we have ways to interleave newer UVE features along the diffusion transformer layers to cut roughly 35% of the latency.”
    • The lag is not something that is a dealbreaker or even that bad, but it is definitely noticeable. It’s still much better than many OEMs UI, which is as simplistic as menus and has tremendously more lag. It sounds like Musk already has a plan that should alleviate this, so that could come soon.

Advertisement
-

One of the coolest features of the Reality View is that it will orient itself based on whether you’re moving forward or backward. When backing out of a space, the drone view switches to the front of the car:

Another really nice touch is the quieter turn signal chimes, which start at a normal volume and then subtly get quieter until they are barely noticeable. It’s a very peaceful touch that Tesla added with the v15 update:

First Thoughts on Driving Performance

Overall, I have only noticed a handful of things. Driving performance feels very similar to recent FSD versions, but these are two things I caught:

  • When taking a left-hand turn from the middle of an intersection with a lot of room, the car didn’t just turn left, it actually turned right a little bit and then turned left. This is something you see a lot of very inexperienced drivers do; they’ll be in a Honda Civic and they act like they need to swing it wide to make a very straightforward turn. I have never seen FSD do this. This turn is one I take each day, as it is on my way to the gym. It was absolutely crazy and I was really thrown off by it. I hope this isn’t a new thing.
  • I didn’t get to see many potholes but I did see a lot of manhole covers, and FSD didn’t do anything to avoid them. In our YouTube video down below, you’ll notice it runs over many manhole covers. I was hoping it was try to avoid these, but I didn’t seem to get that impression.

In the coming days, I’ll do a longer review on the driving performance and whether or not v15.0.1 includes the things that Tesla explicitly mentioned in the Release Notes.

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 rollout begins: full release notes and improvements

Published

on

Tesla Reality View with FSD v15 (Credit: Tesla)

Tesla has announced that Full Self-Driving version 15 is now rolling out, after CEO Elon Musk said earlier today that the wide rollout would occur in December.

Now, Tesla is rolling out to Early Access Program (EAP) members v15’s first builds, and there are a lot of new improvements.

Tesla explicitly stated that safety improvements come in the form of “25x better handling of safety critical cases.” It is also rolling out “Tesla Reality View,” a new version of the Driver Visualization that appears to be much more realistic and could potential use Unreal Engine, according to the teaser video Tesla posted on social media. This “adds a live visualization of the drive that lets you see & control what FSD is planning to do.”

Advertisement
-

Perhaps the biggest improvements that Tesla mentioned, however, are that of Navigation fixes and better detection and aversion from potholes, debris, and animals, as well as “more natural speed handling in school zones and inclement weather.”

Tesla also added a new “Bike Rack Mode,” which will enable FSD’s use when bike racks or other hitch accessories are attached.

Tesla also revealed the full Release Notes for v15:

  • Upgraded vision encoder shared between FSD, Robotaxi, and Optimus, which is trained on millions of internet videos for improved generalization and data efficiency, improving the critical intervention rate by 25x.
  • Introduced Tesla Augmented Reality, replacing all of the explicit model signals into a single end-to-end visualization using less total compute.
  • Improved navigation by using an end-to-end learned model based on route preference data from the fleet.
  • Improved parking location selection by using personalized parking history, and the map will now display multiple parking options at your destination.
  • Improved driver monitoring by increasing vision-based attention monitoring availability with hats and sunglasses and decreasing strictness in higher speed driver profiles.
  • Improved detection of road signs, small animals, road debris, and chains.
  • Improved detection of potholes, road details, and avoidance of deep standing water.
  • Improved speed handling for each driver profile, school zones and speed limits, and inclement weather.
  • Improved Autoshift functionality by unifying with FSD-based gear predictions.
  • Tesla Reality View New: real-time generative driving visualization that continuously streams a view from an arbitrary virtual camera situated above your vehicle, enabling you to see and control what FSD is planning to do. Select between fullscreen visualizations, maps or a split view – or choose quiet mode for a calming cabin experience. Upcoming navigation turns display directly in the driving visualization. Turn signals are quieter and fade out after a few clicks.
  • Speed Camera Slowdown: FSD (Supervised) can now slow down when it detects a speed camera. Press the accelerator or increase your speed profile to cancel the slowdown. If you cancel twice at the same camera, your Tesla saves that location and will not slow down there again. To remove saved cameras, go to Controls > Service > Manage Saved Locations.
  • Bike Rack Mode With Bike Rack Mode, you can now engage FSD (Supervised) when a bike rack or similar hitch accessory is installed. When Bike Rack Mode is enabled, FSD (Supervised) pulls over near your destination and does not reverse. Autopark, Summon, and Backup chimes and warnings will be disabled.

It sounds like there are some really great improvements, and this is probably just a handful of what other improvements will come from these upgrades. For example, the UI changes will likely come with some other features that will be discovered upon the public having hands-on experience with it.

Musk said this morning that a wide release would occur sometime in December.

We’re looking forward to testing it when it arrives to us!

Advertisement
-

Continue Reading

Elon Musk

Tesla Full Self-Driving v15 gets release date from Elon Musk

Published

on

Tesla Full Self-Driving v15 has received an official release date from CEO Elon Musk, who says the newest and most capable version of the suite will go wide in December with the 2026 Holiday Update.

That means the first iterations of the suite could actually come sooner, as the Early Access Program is the initial batch of owners to receive a new FSD release. Musk’s comments released a few tidbits of information, but nothing overwhelmingly revealing about its capabilities.

Musk was talking about supervised fine-tuning, stating that it is like “getting a haircut with a chainsaw,” before stating that FSD v15 will roll out wide for owners next month:

Musk’s Confirmed Changes and Fixes

Musk simply confirmed the new Full Self-Driving version would roll out with the 2026 Holiday Update, and the only two explicit changes he confirmed were updates to the User Interface (UI) and two small changes.

Musk’s comments on the UI confirm there are big changes coming to it, as he stated:

Advertisement
-

The UI changes will likely upgrade AMD Ryzen-equipped Tesla vehicles running AI4 to visualize vehicles using the Unreal Engine, something that was found in coding last year:

Tesla plans to use Unreal Engine for driver visualization with crazy upgrade

Advertisement
-

Additionally, one user stated that their biggest complaints with v14’s most recent releases is that they have to “stop refusing to use the HOV lane” and last-second lane changes to merge or turn happen too frequently. Musk said these should be fixed in v15.

In the past, we’ve also gotten small bits of detail about the v15 release, including from Tesla’s Head of AI, Ashok Elluswamy, who stated back in September that there are improved safety and collision avoidance systems coming with the v15 release.

Tesla plans big safety improvements for Full Self-Driving v15

Advertisement
-

The big prediction for v15 is whether this will enable at least some unsupervised driving in personal Teslas. There are likely to be some massive jumps in capability, although FSD has already proven itself to be a great way to travel. Nevertheless, there are a lot of things it could do better.

FSD still struggles with parking, it has routine bugs from update to update, it does not recognize potholes or large bumps on the road, speed control is a common complaint, and Navigation has been one of the biggest pain points.

However, v15 will likely bring massive improvements to capability and give people more options, like potentially parking orientation and more refined spot selection. We can only wait and see what Tesla will include.

Advertisement
-
Continue Reading