My Notes from an XRHQ Live Streaming Event on LinkedIn and YouTube — Pixels & Pills: Breaking Research on Immersive Treatment for Mental Health, using the Apple Vision Pro and Explore POV (January 29th, 2026)

PLEASE NOTE: This is now a somewhat edited first draft of the notes I was frantically taking during this livestream, because I wanted to get the information out there on this very interesting application of the Apple Vision Pro! Yesterday I came across this announcement of how the Apple Vision Pro was being used in research to determine its effectiveness as a support for those suffering from anxiety and depression. As an avid AVP user, as a subscriber to Explore POV, and as a mental health consumer, I was definitely not going to miss this presentation, which was being streamed on LinkedIn (a first for me; usually I am on Microsoft Teams or Zoom for this sort of online event).

I was originally thinking I would go in using my AVP’s Virtual Display feature with my MacBook Pro (my usual work setup lately, what with my neck and shoulder pain), and then I thought: naaah, let’s not overcomplicate things. Apparently, this is also being streamed to YouTube, which I will look for later. UPDATE: Added the YouTube link at the end.

Any omissions and errors are my fault; sorry guys, I can only take notes so quickly!

The speakers in the livestream were:

Hala Darwish, Associate Professor, School of Nursing/Neurology/Neuroscience Graduate Program, University of Michigan (currently conducting research, still in its very earliest stages)

Jeremy Dalton, XRHQ (moderator of the event; formerly PwC Head of Immersive Technologies)

James Hustler, Explore POV (3D video creator, whose app was chosen as the Apple Vision Pro App of the Year 2025, https://exploreimmersive.com)

Event description: By immersing patients in breathtaking natural environments using the Apple Vision Pro, research is now underway to discover whether these experiences can support those suffering from anxiety and depression. Join James Hustler, creator of the award-winning Explore POV app, and Dr. Hala Darwish, Associate Professor at the University of Michigan, for a live discussion hosted by Jeremy Dalton from XRHQ. Together, we will explore the technology, the clinical thinking that inspired it, and what it could mean for the future of digital therapeutics.


(Unfortunately, I missed the first few minutes while I was fiddling with my sound settings, and trying to get my earbuds to work properly, so I missed Jeremy’s and Hala’s introductions.)

James Hustler travels the world to record amazing 3D videos and share them via his subscription service, Explore POV (which I have written about before here). He had been living in a motor home in New Zealand during the pandemic, when he had started recording 3D videos to share with friends.

Hala is in early stage research, interested in the relationship between mental health and the environment. Many people do not have access to certain environments (e.g. an urban environment with very little nature). Also, people can have access issues (e.g. a disability). Hala was looked into VR as an alternative to real-life nature experiences, and in 2019 when she started, the tech wasn’t quite ready (they tried with 360-degree videos, and she felt it didn’t really work well, i.e. low resolution; caused motion sickness, etc.). She then tried computer-generated nature graphics for patients with MS (multiple sclerosis). In 2023, the Apple Vision Pro was released, and Hala had a demo. The decision was made to switch from 360-degree VR video to 180-degree VR video.

James: The VR 360-degree video format is not new, but until recently, it hasn’t been at a high-enough resolution to create a true sense of presence. i.e., it changes from an intellectual response to an emotional response of being there. Explore POV is now recording at 16K resolution, and experimenting with Apple Immersive Video. The goal is to capture a scene so that the user feels like it’s lifelike and real to them.

Hala: transporting the individual to these natural environments does appear to have health benefits (mental and physical health, stress relief, etc.). In addition to anxiety and depression relief, Hala’s area of research, VR is also being used for the treatments of phobias (exposure therapy), performance anxiety (e.g. fear of public speaking), and as a method of pain management and distraction, among other uses.

James, when asked about feedback to his videos: Explore POV was created as a travel app, but people by the hundreds are contacting him about the mental and emotional response to the VR video scenes, telling him it’s the first time they’ve climbed a mountain or paddled a kayak. People have told James that they use the Explore POV app to relax after a stressful day’s work. This sort of feedback has opened James’ eyes to the possibilities of 3D video in VR. He had originally approached his work from a technical challenge (e.g. how do I create the highest-resolution 3D videos in VR?). He stressed that all these responses are anecdotal, but that we need scientific evidence.

Hala, in talking about her research: we want to run clinical trials (but we are currently testing feasibility and safety with a limited number of patients with progressive multiple sclerosis and depression). If we give AVPs to patients to use at home (e.g. with disability), how are they going to be able to use the headsets? The first study splits the patients into three groups. It’s a cross-over study: one group gets standard treatments first, then VR treatment, the second group gets VR treatment first, then standard treatments. The third group has just standard treatments, with no VR intervention. It is an early-stage feasibility study, with 14, 14, and 12 patients in the three categories of patients being looked at. She is also interested in researching longer-term responses to VR treatment.

Hala: in my opinion, exposure to natural scenes in VR appears to be a good adjunct to standard therapy. It’s still too early to come to any definitive conclusion. We first want to see if it has an impact on stress and anxiety levels, and then eventually expand to a larger number of patients (right now it’s a small number).

Which environments create greater impacts? James: we would expect to see what we’ve seen compared to previous academic research studies using real-life nature scenes (e.g. MRI brain scans after exposure to nature, e.g. taking a hike). There is already a good body of academic literature dealing with the impact of real-life nature on people’s anxiety and depression.

But we don’t have anything beyond anecdotal results for the use of nature in VR so far, nothing scientific; this research is still in its very earliest stages. For example, one early patient had a very good response to a desert environment (but it’s only a sample size of one!). James: if we’re aiming for calmness, certain VR video environments would probably help with that, e.g. flowing water, watching a sunset while sitting on a mountain, etc.). But again, at this point it’s purely anecdotal.

I asked a question in the text chat during the livestream that was actually asked of James, the creator of Explore POV, which was: Has James created specific VR video environments for Hala’s research? The answer was no; James has not yet created specific VR video environments for Hala’s research. However, they’ve now shot approximately 200 videos in 20 different countries so far for the Explore POV app (I think he said 200, but it was hard to take accurate notes!). He notes that they are a small, nimble team who can rapidly adjust to meet any requests from Hala’s research team, if needed in the future.

My question got asked!!

In response to a question from another user about the use of Apple’s SharePlay feature, where you can share an experience together with other Apple users via their Personas: James would love to add this feature, if he can. Yes, he would love to make Explore POV more of a multiplayer experience, if possible. He talks about people sequentially experiencing the same VR video in Explore POV, and thereby “sharing” the experience with others (e.g. a father and his daughter, if I remember correctly).

James: for people who can’t physically travel due to disability or for soke other reason, the technology is unlocking experiences that they might never experience otherwise. He thinks that it’s an amazing position to be in where we can give some of these people a taste of visiting remote places, with impacts in not just healthcare but also conservation, education, etc.

Hala: the academic research process is slow due to recruitment bottlenecks, but she estimates 2 years for the duration of the study (before results are published). he notes that most of the time, the people who most need the nature exposure do not have the opportunity to access it (for example they cannot afford an Apple Vision Pro).

(Unfortunately, Hala crashed out of the stream soon her comments, and the other two speakers wrapped it up!)

Conservation, education and healthcare are the three areas of what James wants to focus on with Explore Immersive. In addition to working with Hala on her research study, he’s also working on conservation and education applications as well. He hopes to start new partnerships in these three key areas, and wants to make Explore POV more than “just a travel app.”

Here’s the 53-minute YouTube video, in case you missed the livestream (unfortunately, you do have to actually go over and watch it on YouTube, as I am not allowed to embed it into my blogpost). Sorry! I do very strongly urge you to go over and watch it, though; it was amazing and inspiring.

Virtual Cultures in Pandemic Times: A New, Feature-Length Documentary by Draxtor Despres Looks at Second Life and Animal Crossing Users During the Coronavirus Pandemic

HOUSEKEEPING NOTE: The RyanSchultz.com blog will be on an indefinite hiatus, as I am working on a brand new project: writing up a proposal for a VR lab for my university library system! More details here. I’ll be back as soon as I can, folks!

Image source: the official website for the documentary

The full-length documentary by Bernhard Drax (a.k.a. Draxtor Despres in Second Life), titled Virtual Cultures in Pandemic Times, has now been released on YouTube, where you can watch it for free! (I first wrote about the film here.)

It’s 1 hour and 24 minutes long, so go get yourself some popcorn, and settle in!

According to the official website for the film:

Virtual Cultures in Pandemic Times is a new feature length documentary by media maker Draxtor.

Since March 2020, Draxtor has been following researchers Tom Boellstorff, Evan Conaway, Chandra Middleton and Sandy Wenger (based in the Department of Anthropology at the University of California, Irvine) around Animal Crossing and Second Life to find out how COVID-19 is reshaping online interaction.

In the 85 minute film, protagonists from all over the world speak openly about their anxieties and everyday challenges during this global crises and about what virtual worlds and social games mean to them in the context of a pandemic.

Mixed reality interviews and group discussions provide the basis for a sprawling narrative: a mosaic of impressions, shared by people from all walks of life, some well known figures from science, arts and culture, some just regular folks (like the research team itself), trying to make sense of a new age dominated by uncertainty and physical isolation.

Enjoy!

P.S. If you watch the documentary, you can see my main SL avatar, Vanity Fair, sitting in the audience at the Virtual Ability 10th Annual Mental Health Symposium: Mental Health in Trying Times virtual conference, held on April 16th, 2021 (at which I also was a presenter on the topic of acedia). At exactly the 25:10 mark in Virtual Cultures in Pandemic Times, you can see Vanity, busily knitting away… 😉 I’m tickled pink that I made a (brief) cameo in Drax’s documentary!

Screen capture of Vanity Fair (with her animated knitting needles!) sitting in the audience at the Virtual Ability Annual Mental Health Symposium (taken from Drax’s documentary)

P.P.S. Starting at the 1:17:42 mark of Drax’s documentary, in the discussion of social media/networks versus virtual worlds, Drax has an image of my popular list of metaverse platforms appearing on the screen of a virtual television set in Second Life! He even scrolls down the listing! My blog got a cameo!!!

My list of metaverse platforms gets a cameo in Drax’s documentary!

Thanks for the cameos, Drax! 😉

Virtual Cultures in Pandemic Times: A New Feature-Length Documentary by Draxtor Despres, Premiering on YouTube and in Second Life on April 2nd, 2022

Second Life filmmaker Bernhard Drax (better known by his Second Life name, Draxtor Despres) will be premiering a new, feature-length documentary on April 2nd, 2022, titled Virtual Cultures in Pandemic Times. I have written about Drax many times before on this blog, notably when he released his previous feature-length documentary, Our Digital Selves: My Avatar Is Me. Drax is a truly indefatigable chronicler of Second Life, who often creates promotional short films (a.k.a. machinima) about various aspects of Second Life for Linden Lab. He is also an insatiable reader, who hosts the popular weekly Second Life Book Club.

According to the official website for the film:

Virtual Cultures in Pandemic Times is a new feature length documentary by media maker Draxtor.

Since March 2020, Draxtor has been following researchers Tom Boellstorff, Evan Conaway, Chandra Middleton and Sandy Wenger (based in the Department of Anthropology at the University of California, Irvine) around Animal Crossing and Second Life to find out how COVID-19 is reshaping online interaction.

In the 85 minute film, protagonists from all over the world speak openly about their anxieties and everyday challenges during this global crises and about what virtual worlds and social games mean to them in the context of a pandemic.

Mixed reality interviews and group discussions provide the basis for a sprawling narrative: a mosaic of impressions, shared by people from all walks of life, some well known figures from science, arts and culture, some just regular folks (like the research team itself), trying to make sense of a new age dominated by uncertainty and physical isolation.

The online premiere of Virtual Cultures in Pandemic Times will be happening on YouTube and in the virtual world of Second Life, at 1:00 p.m. Pacific Time/SL Time on April 2nd, 2022.

For more information on the project, and to register for the premiere, please refer to the official website for the film. You can also search Twitter for the hashtag #VCinPandemicTimes for the latest tweets about the film and the people it profiles. You can also check out Drax’s voluminous output over on his YouTube channel (including a playlist of teaser clips from Virtual Cultures in Pandemic Times!).

UPDATED! Academic Research in Social VR: Crowdsourcing Virtual Reality Experiments Using VRChat at Northeastern University

I am still working away on my presentation on the various uses of social VR in higher education, which I am to deliver on Sept. 8th, 2021 to my university’s senate committee on academic computing. Over the summer I have highlighted a number of interesting and innovative projects at various universities and colleges (you can find a number of them here, all tagged with the tag “Higher Education”). And I am especially heartened to see more and more published academic research on virtual reality, triggered by the increasing uptake of consumer-market VR headsets!

Conducting experiments in VR can sometimes be difficult, involving the purchase and setup of sometimes expensive hardware (particularly if multiple headsets need to be bought). University budgets can only go so far, even at the best of times. One way to get around this is to use existing commercial social VR platforms and their users as volunteers (who, of course, already have their own equipment).

This is a different form of what is called crowdsourcing: dividing up a task among a larger group of volunteers. In this case, researchers at Northeastern University in Boston, Massachusetts did a small demonstration experiment to prove the idea that recruiting study volunteers via VRChat was possible, publishing a paper at a computer science conference held last year. The following research paper is unfortunately not free to access and read, but you can always use your friendly local public or academic library to obtain a copy of it! Here’s the citation:


Saffo, D., Yildirim, C., Di Bartolomeo, S., & Dunne, C. (2020). Crowdsourcing virtual reality experiments using VRChat. Conference on Human Factors in Computing Systems – Proceedings, 1–8. https://doi.org/10.1145/3334480.3382829


According to the conference paper’s abstract:

Research involving Virtual Reality (VR) headsets is becoming more and more popular. However, scaling VR experiments is challenging as researchers are often limited to using one or a small number of headsets for in-lab studies. One general way to scale experiments is through crowdsourcing so as to have access to a large pool of diverse participants with relatively little expense of time and money. Unfortunately, there is no easy way to crowdsource VR experiments. We demonstrate that it is possible to implement and run crowdsourced VR experiments using a preexisting massively multiplayer online VR social platform—VRChat. Our small (n = 10) demonstration experiment required participants to navigate a maze in VR. Participants searched for two targets then returned to the exit while we captured completion time and position over time. While there are some limitations with using VRChat, overall we have demonstrated a promising approach for running crowdsourced VR experiments.

One of many delightful images illustrating this research paper!

One of the features which attracted the researchers to VRChat was the ability to build custom virtual worlds or rooms:

VRChat also has a special feature that sparked our interest: it allows users to upload custom rooms built with Unity by using a proprietary VRChat SDK. The SDK contains special triggers and event handlers that can be triggered by users, in addition to giving the possibility to upload rooms made of and containing any kind of 3D models made by a creator. We started asking ourselves if we could leverage the vast amount of VRChat users who already own VR equipment and use them as experiment participants by building a custom room that contained the implementation of our experiment, in order to run crowdsourced experiments in VRChat.

And so they built a maze and ran a simple experiment:

The participants in the experiment were asked to run through a VR maze, find two targets inside the maze, and go back to the exit. The experiment was run using two point of views, immersive and non-immersive, and compared the timing between a group of self-declared gamers and non-gamers. Our reasoning for choosing this experiment over others was that it was simple enough to avoid having too many variables influencing the results, and it would give us a quick way to evaluate the process of conducting a user study on the platform.

A researcher would then visit public world in VRChat, asking users present if they would be willing to run the maze.

After joining a public world, we began by looking for users using HMDs. We did this by asking users directly if they were using VR, or by observing their in-game movements as VR users have full head and sometimes hand tracking. We found that most users we approached were willing and eager to participate. After users had joined our world, they would spawn in a waiting room where we could give them further instructions. At this stage researchers conducting a user study may also present digital consent forms for participants to read and sign.

The researchers noted that, at the time of the proof-of-concept experiment, they were somewhat limited by the relatively narrow scope of what they could build using the then-available version of the VRChat SDK (software development kit). However, they noted that the next-generation graphical SDK (called Udon) offered the ability to build more complex interactive worlds, thereby expanding the possible uses for VR experiments.

The researchers also noted the relative ease and cost effectiveness with which VRChat could be used for academic research into the growing field of social or collaborative virtual reality:

It is particularly exciting to note that VRChat can also be
used to implement collaborative VR studies. Previously,
such studies would require custom multiplayer platform development. VRChat not only provides an SDK to create
worlds but also all the network capabilities to have several concurrent users all in the same virtual space.

UPDATE 2:02 p.m.: I’ve just discovered a recent five-minute YouTube video featuring the Northeastern researchers, explaining the concept of using existing social VR platforms for their experiments:

This video mentions and summarizes a second, follow-up research paper, which I have not yet read (again, you will have to pay to access this conference paper; you should be able to obtain a copy via your local public or academic library). Here’s the citation for you:


Saffo, D., Bartolomeo, S. Di, Yildirim, C., & Dunne, C. (2021). Remote and collaborative virtual reality experiments via social VR platforms. Conference on Human Factors in Computing Systems – Proceedings. https://doi.org/10.1145/3411764.3445426


I’m quite eager to read this second research paper! According to the description of the YouTube video, a preprint of this conference paper and all supplemental materials are available at the following URL: osf.io/c2amz (so you might not need to pay for a copy via interlibrary loan/document delivery from your local library, after all).

Of course, it’s not just VRChat that could be repurposed as an academic testbed. Any number of commercially available social VR platforms can be used as cost-effective platforms to conduct VR experiments! The researchers at Northeastern University are to be commended for their proof-of-concept work, and I very much look forward to seeing other uses of social VR platforms in various areas of academic virtual reality research.