Tag: University of Michigan

My Notes from an XRHQ Live Streaming Event on LinkedIn and YouTube — Pixels & Pills: Breaking Research on Immersive Treatment for Mental Health, using the Apple Vision Pro and Explore POV (January 29th, 2026)

PLEASE NOTE: This is now a somewhat edited first draft of the notes I was frantically taking during this livestream, because I wanted to get the information out there on this very interesting application of the Apple Vision Pro! Yesterday I came across this announcement of how the Apple Vision Pro was being used in research to determine its effectiveness as a support for those suffering from anxiety and depression. As an avid AVP user, as a subscriber to Explore POV, and as a mental health consumer, I was definitely not going to miss this presentation, which was being streamed on LinkedIn (a first for me; usually I am on Microsoft Teams or Zoom for this sort of online event).

I was originally thinking I would go in using my AVP’s Virtual Display feature with my MacBook Pro (my usual work setup lately, what with my neck and shoulder pain), and then I thought: naaah, let’s not overcomplicate things. Apparently, this is also being streamed to YouTube, which I will look for later. UPDATE: Added the YouTube link at the end.

Any omissions and errors are my fault; sorry guys, I can only take notes so quickly!

The speakers in the livestream were:

Hala Darwish, Associate Professor, School of Nursing/Neurology/Neuroscience Graduate Program, University of Michigan (currently conducting research, still in its very earliest stages)

Jeremy Dalton, XRHQ (moderator of the event; formerly PwC Head of Immersive Technologies)

James Hustler, Explore POV (3D video creator, whose app was chosen as the Apple Vision Pro App of the Year 2025, https://exploreimmersive.com)

Event description: By immersing patients in breathtaking natural environments using the Apple Vision Pro, research is now underway to discover whether these experiences can support those suffering from anxiety and depression. Join James Hustler, creator of the award-winning Explore POV app, and Dr. Hala Darwish, Associate Professor at the University of Michigan, for a live discussion hosted by Jeremy Dalton from XRHQ. Together, we will explore the technology, the clinical thinking that inspired it, and what it could mean for the future of digital therapeutics.

(Unfortunately, I missed the first few minutes while I was fiddling with my sound settings, and trying to get my earbuds to work properly, so I missed Jeremy’s and Hala’s introductions.)

James Hustler travels the world to record amazing 3D videos and share them via his subscription service, Explore POV (which I have written about before here). He had been living in a motor home in New Zealand during the pandemic, when he had started recording 3D videos to share with friends.

Hala is in early stage research, interested in the relationship between mental health and the environment. Many people do not have access to certain environments (e.g. an urban environment with very little nature). Also, people can have access issues (e.g. a disability). Hala was looked into VR as an alternative to real-life nature experiences, and in 2019 when she started, the tech wasn’t quite ready (they tried with 360-degree videos, and she felt it didn’t really work well, i.e. low resolution; caused motion sickness, etc.). She then tried computer-generated nature graphics for patients with MS (multiple sclerosis). In 2023, the Apple Vision Pro was released, and Hala had a demo. The decision was made to switch from 360-degree VR video to 180-degree VR video.

James: The VR 360-degree video format is not new, but until recently, it hasn’t been at a high-enough resolution to create a true sense of presence. i.e., it changes from an intellectual response to an emotional response of being there. Explore POV is now recording at 16K resolution, and experimenting with Apple Immersive Video. The goal is to capture a scene so that the user feels like it’s lifelike and real to them.

Hala: transporting the individual to these natural environments does appear to have health benefits (mental and physical health, stress relief, etc.). In addition to anxiety and depression relief, Hala’s area of research, VR is also being used for the treatments of phobias (exposure therapy), performance anxiety (e.g. fear of public speaking), and as a method of pain management and distraction, among other uses.

James, when asked about feedback to his videos: Explore POV was created as a travel app, but people by the hundreds are contacting him about the mental and emotional response to the VR video scenes, telling him it’s the first time they’ve climbed a mountain or paddled a kayak. People have told James that they use the Explore POV app to relax after a stressful day’s work. This sort of feedback has opened James’ eyes to the possibilities of 3D video in VR. He had originally approached his work from a technical challenge (e.g. how do I create the highest-resolution 3D videos in VR?). He stressed that all these responses are anecdotal, but that we need scientific evidence.

Hala, in talking about her research: we want to run clinical trials (but we are currently testing feasibility and safety with a limited number of patients with progressive multiple sclerosis and depression). If we give AVPs to patients to use at home (e.g. with disability), how are they going to be able to use the headsets? The first study splits the patients into three groups. It’s a cross-over study: one group gets standard treatments first, then VR treatment, the second group gets VR treatment first, then standard treatments. The third group has just standard treatments, with no VR intervention. It is an early-stage feasibility study, with 14, 14, and 12 patients in the three categories of patients being looked at. She is also interested in researching longer-term responses to VR treatment.

Hala: in my opinion, exposure to natural scenes in VR appears to be a good adjunct to standard therapy. It’s still too early to come to any definitive conclusion. We first want to see if it has an impact on stress and anxiety levels, and then eventually expand to a larger number of patients (right now it’s a small number).

Which environments create greater impacts? James: we would expect to see what we’ve seen compared to previous academic research studies using real-life nature scenes (e.g. MRI brain scans after exposure to nature, e.g. taking a hike). There is already a good body of academic literature dealing with the impact of real-life nature on people’s anxiety and depression.

But we don’t have anything beyond anecdotal results for the use of nature in VR so far, nothing scientific; this research is still in its very earliest stages. For example, one early patient had a very good response to a desert environment (but it’s only a sample size of one!). James: if we’re aiming for calmness, certain VR video environments would probably help with that, e.g. flowing water, watching a sunset while sitting on a mountain, etc.). But again, at this point it’s purely anecdotal.

I asked a question in the text chat during the livestream that was actually asked of James, the creator of Explore POV, which was: Has James created specific VR video environments for Hala’s research? The answer was no; James has not yet created specific VR video environments for Hala’s research. However, they’ve now shot approximately 200 videos in 20 different countries so far for the Explore POV app (I think he said 200, but it was hard to take accurate notes!). He notes that they are a small, nimble team who can rapidly adjust to meet any requests from Hala’s research team, if needed in the future.

My question got asked!!

In response to a question from another user about the use of Apple’s SharePlay feature, where you can share an experience together with other Apple users via their Personas: James would love to add this feature, if he can. Yes, he would love to make Explore POV more of a multiplayer experience, if possible. He talks about people sequentially experiencing the same VR video in Explore POV, and thereby “sharing” the experience with others (e.g. a father and his daughter, if I remember correctly).

James: for people who can’t physically travel due to disability or for soke other reason, the technology is unlocking experiences that they might never experience otherwise. He thinks that it’s an amazing position to be in where we can give some of these people a taste of visiting remote places, with impacts in not just healthcare but also conservation, education, etc.

Hala: the academic research process is slow due to recruitment bottlenecks, but she estimates 2 years for the duration of the study (before results are published). he notes that most of the time, the people who most need the nature exposure do not have the opportunity to access it (for example they cannot afford an Apple Vision Pro).

(Unfortunately, Hala crashed out of the stream soon her comments, and the other two speakers wrapped it up!)

Conservation, education and healthcare are the three areas of what James wants to focus on with Explore Immersive. In addition to working with Hala on her research study, he’s also working on conservation and education applications as well. He hopes to start new partnerships in these three key areas, and wants to make Explore POV more than “just a travel app.”

Here’s the 53-minute YouTube video, in case you missed the livestream (unfortunately, you do have to actually go over and watch it on YouTube, as I am not allowed to embed it into my blogpost). Sorry! I do very strongly urge you to go over and watch it, though; it was amazing and inspiring.

The University of Michigan’s XR Initiative and the Extended Reality Nuclear Reactor Laboratory Project

The University of Michigan‘s Center for Academic Innovation founded an XR Initiative in September 2019, to work with all the U of M’s schools and colleges to fund new projects and provide consultation on the use of VR/AR/MR technology to support teaching and research.

The State of XR and Immersive Learning Outlook Report 2021 (available to download here), recently published by the Immersive Learning Research Network, describes one such project:

At the University of Michigan, the Center for Academic Innovation seeded six new XR projects in spring 2020 as part of an ongoing effort to fully embrace immersive education. One upcoming project explores the challenges of working within nuclear reactors. The school’s Ford Nuclear Reactor in Michigan permanently shut down in 2003 and was decommissioned in the years following, leaving the top-ranked university program without a research reactor. This XR project will develop an Extended Reality Nuclear Reactor Laboratory simulation where students can virtually walk around the reactor, look into the core, and interact with the control panel.

As Brendan Kochunas, project manager and assistant professor in the Department of Nuclear Engineering and Radiological Sciences described it (2020): “In reality, one does not simply walk up next to an operating nuclear reactor core, but in virtual reality one can. We can also overlay simulation results on the virtualized physical systems allowing students to experience neutron fields or temperature fields visually, where in reality this is not possible.”

The faculty and staff newspaper UM Record provides some more background:

The College of Engineering is home to the No. 1 nuclear engineering program in the country. For several decades up to the early 2000s, the program included training at a physical nuclear reactor. The Ford Nuclear Reactor, originally established as a WWII memorial under the Michigan Memorial Phoenix Project, permanently shut down in 2003.

It was decommissioned over the next four years, leaving U-M as one of the only programs without a research reactor, both in the Top 5-ranked university programs and the Big 10, said Brendan Kochunas, project manager and assistant professor in the Department of Nuclear Engineering and Radiological Sciences.

The Extended Reality Nuclear Reactor Laboratory simulation would allow some retired courses that used the Ford Nuclear Reactor to be taught again to upper level undergraduates and graduate students.

“I hope to gain experience and insight into how to apply XR technologies in a practical way to enhance education and research in the field of nuclear engineering,” Kochunas said. “I think XR has such potential for this area of science, or really any area of science where the reality is you have a physical system that is expensive or potentially hazardous.”

An article by Sara Norman on the University of Michigan College of Engineering website describes the project in more technical detail:

Over the past year, a project team within the U-M Department of Nuclear Engineering & Radiological Sciences (NERS) has been working with the XR Initiative in the Center for Academic Innovation to develop the Extended Reality Nuclear Reactor Laboratory—a virtual representation of the now decommissioned Ford Nuclear Reactor (FNR) that was once the center of the Michigan Memorial Phoenix Project (MMPP).

Yuxuan Liu, a member of the project team and an Assistant Research Scientist within NERS, has received a Simulation Grant from the Office of the Associate Dean for Undergraduate Education (ADUE) to develop a simulation of heat transfer in the original FNR. Understanding the heat transfer in a nuclear power reactor is essential to its operation and maintaining safety, making this virtual experience an important lesson of the NERS Extended Reality Nuclear Reactor Laboratory course. The other member of the project team is NERS Prof. Brendan Kochunas.

The XR Initiative is a good example of a university-wide program to make XR technology more accessible on campus and encourage its use in higher education, working with university faculty to actively look for new ideas and opportunities to support immersive learning projects, and enhance students’ learning experience. I look forward to seeing other such initiatives spring up on university campuses!