UPDATED: Leaked Internal Memos from Meta Detail Problems with Horizon Worlds and Horizon Workrooms

Yesterday, Alex Heath of the tech news website The Verge covered the current state of Meta’s social VR sister platforms, Horizon Worlds (for consumers) and Horizon Workrooms (for business users), and things are not looking good.

In the article, titled Meta’s flagship metaverse app is too buggy and employees are barely using it, says exec in charge, Alex quotes at length from internal memos sent around the company by executives such as Vishal Shah, Meta’s Vice President of Metaverse, which detail the many quality assurance issues plaguing the products.

In one of the memos to employees dated September 15th, Meta’s VP of Metaverse, Vishal Shah, said the team would remain in a “quality lockdown” for the rest of the year to “ensure that we fix our quality gaps and performance issues before we open up Horizon to more users.”

It would appear that there are numerous bugs in the software:

“But currently feedback from our creators, users, playtesters, and many of us on the team is that the aggregate weight of papercuts, stability issues, and bugs is making it too hard for our community to experience the magic of Horizon. Simply put, for an experience to become delightful and retentive, it must first be usable and well crafted.”

OUCH. Even worse, it would appear that many of the people building the product are not using it very much (known as “eating your own dogfood”, or “dogfooding”):

A key issue with Horizon’s development to date, according to Shah’s internal memos, is that the people building it inside Meta appear to not be using it that much. “For many of us, we don’t spend that much time in Horizon and our dogfooding dashboards show this pretty clearly,” he wrote to employees on September 15th. “Why is that? Why don’t we love the product we’ve built so much that we use it all the time? The simple truth is, if we don’t love it, how can we expect our users to love it?”

In a follow-up memo dated September 30th, Shah said that employees still weren’t using Horizon enough, writing that a plan was being made to “hold managers accountable” for having their teams use Horizon at least once a week. “Everyone in this organization should make it their mission to fall in love with Horizon Worlds. You can’t do that without using it. Get in there. Organize times to do it with your colleagues or friends, in both internal builds but also the public build, so you can interact with our community.”

It’s never a good sign when you have to basically ORDER your employees to use a product that they are building, is it? The article goes on to say:

He went on to call out specific issues with Horizon, writing that “our onboarding experience is confusing and frustrating for users” and that the team needed to “introduce new users to top-notch worlds that will ensure their first visit is a success.”

Shah said the teams working on Horizon needed to collaborate better together and expect more changes to come. “Today, we are not operating with enough flexibility,” his memo reads. “I want to be clear on this point. We are working on a product that has not found product market fit. If you are on Horizon, I need you to fully embrace ambiguity and change.”

I wonder if part of the problem is that there is such a large team working on Horizon Worlds and Horizon Workrooms, part of a large multinational corporation, with all the bureaucracy that such an organization entails. In addition, there have been rumours of turmoil and turnover in Meta’s staffing, with a number of senior executive departures, such as Vivek Sharma, the former Vice President of Meta Horizon, who left in August 2022. You might remember the kerfuffle when Meta’s CEO Mark Zuckerberg tweeted out a lacklustre picture to promote Horizon World’s expansion into France and Spain (which you can see in the screen capture of Alex’s article above; I wrote about it here). Meta then had to scramble to assure people that they were working on improving the graphics within its social VR platforms.

Well, at the upcoming Meta Connect 2022 conference, to be held on October 11th, many will tune in to see how Mark and his executive team are going to spin what clearly are some serious development problems with their social VR platforms.

UPDATE Oct. 10th, 2022: Both The Wall Street Journal and The New York Times have published recent articles about Meta’s metaverse woes:

The WSJ article is a short read, but the NYT one is excellent, giving an in-depth, inside look (using anonymous sources) at what’s going on in Meta as they attempt to pivot to the metaverse. Both are highly recommended reading.

UPDATED! Not Taking “No” for an Answer: The Developers Behind The Expanse Have an Unexpected Hit on Their Hands with SideQuest

This story is a perfect example of not taking “no” for an answer, and how what could have been a setback was instead turned into a golden opportunity for one company!

Photo by Nadine Shaabana on Unsplash

I first wrote about The Expanse social VR platform back in April. The company behind The Expanse, a fledgling virtual world, had wanted to launch their product on the Oculus Quest, but they were among the many software developers told “No” by Facebook, which appears to have taken a much more stringent approach to curating content on their new standalone headset. UploadVR reports:

“Originally it was intended to provide a way for us to get our game The Expanse to users of the Oculus Quest headset as our submission pitch was declined by Oculus – something we understood as many more well established apps were also being declined. It then struck me that maybe some of those other developers could also benefit from a super easy sideloading process with things like drag and drop and several apps inbuilt,” Harris wrote to me in a message on his Discord group. “SideQuest is a sideloading tool at heart and actually works with any android device but it has evolved into an unofficial source for apps that you wouldn’t otherwise get on Quest. I would love to see it fill the niche of a testbed for pre-release/alpha/beta testing or for deploying demos for users to try out. I have no plans to monetize SideQuest like a traditional app store as I don’t want to affect the Oculus bottom line and I would love to work with Oculus to become an alternative route for apps and games that have been declined or otherwise or just want to test cutting edge features. I think there has been a lot of discussion around games being declined and I would love if SideQuest could provide a more positive spin for Oculus and Facebook in those scenarios. I guess i see it as a stepping stone to a application for the full oculus store down the line.”

Sideloading is the process of adding apps to your Oculus Quest that are not currently in the Oculus Store. And, as it turns out, there happen to be a lot of software developers (and end users) out there who wanted to be able to sideload their applications. And that’s when the SideQuest project really took off in popularity, and gained a life of its own! (There are other ways to sideload apps on the Quest, but SideQuest makes it simple to do. In fact, in the short few weeks that the Quest has been out, there have already been several iterations to the software to make it even easier to use.)

One very popular feature of the SideQuest software is the ability to add custom songs to the collection of music by which you can play the rhythm VR game Beat Saber. The SideQuest app links directly to the BeastSaber community website, and adding new tracks is as simple as setting up a developer account for your Quest, connecting your Quest to your Windows, Mac, or Linux computer, and clicking a few buttons! Here’s the page with all the details. And here’s a step-by-step YouTube tutorial by the Virtual Reality Oasis:

Congratulations to the team at The Expanse! The SideQuest software is free, but if you want to support their work, here is a link to their Patreon, or you can send a donation via PayPal. If you want more details on The Expanse and SideQuest as they evolve, you can join their Discord channel.

And this whole episode reminds me yet again of the lesson that Friendster never learnedthe people who create the software platforms (in this case, Facebook) think they have control, but it’s really the end users who shape the service and build the community that they want to see. Past a certain point, there’s very little that Facebook can do to stop this, short of completely shutting developers out, which they won’t do. And if they’re smart, Facebook will welcome this, and work with it.

UPDATE 6:43 p.m.: This last paragraph has brought a swift rebuttal from a commenter on the Oculus Quest subReddit, who says:

FFS, no. Facebook is 100% in control. They allow SideQuest. Go ask PSVR Beat Saber players how they “shaped the service” to get custom songs on the PS4. Hint: they didn’t. Sony has that shit locked down like Fort Knox. Oculus could easily require sideloaded apps to be signed with a development license to run. It’s only by their good graces that sideloading and modding is as easy as it is, so don’t pretend for a minute that you’re sticking it to the man. Be grateful there’s some cool folk at Oculus who want us to be able to do this.