Virtual Reality and the reimagining of Story – part 3

by Oct 11, 2016Storygeist, Virtual Reality0 comments

VR & Storytelling as seen through a filmmaker’s eyes

In the first installment of this series I wrote about how seasoned game fanatics were turned into crying babies by the power of the VR medium, thereby proving what potential psychologically this medium holds. I also touched upon the utterly heart wrenching semi-interactive story “That Dragon Cancer” which proved that some artists do have something wortwhile to tell.

In the second installment, I went into the hurdles which the VR-medium poses on the storyteller. I also laid out a humble appeal to the future VR-filmmakers for  stories which search for, and question, something deeper, more humane, existential and morally complex, than what most games/interactive stories have to offer right now

As promised in this third part, I would like to see what the future holds for VR.  And with this, I would like to draft my own personal vision, a rough crystal ball, of a new kind of movie/hyper-reality experience which I believe VR is headed for during this decade.  In my opinion this experience holds so much promies on so many levels, that this just might be the place where the true screenwriting/actor/theater/film talent will be heading for.

In order to get to an experience which might have a shot at showing the full potential of VR,  we need to take a look at a few of the emerging technologies which are happening around the world right this moment.

Hurdle number one – 1:1 room scale environments

In my personal opinion, there are two major hurdles to overcome. The physicality of the world. Meaning the expierence needs to deliver a 1:1 room scale environment which imitates the Virtual space. And second, the psychology and interactions which need to take place in this world have to mimic the real world. Let’s take a closer look at both of them. Let’s dive into the first of those.

This year has given us a promising glimpse into what the true potential of VR holds. The Occulus, the HTC Vive, and a myriad others have materialized onto the market. You can install each one of them at home. Despite the steep access prize, and  the high-end gear requirements, it’s available right this moment for you to enjoy at home.

All of these systems deliver different  levels of  immersion, but where everyone of them ultimately fails is the sense of being in the environmet at 1:1 scale. HTC Vive can map your movement onto your surroundings, so you can actually walk around. That’s a big step in the right direction. But this is also limited to the space confined within a couple of meters. Whenever you need to move further,  you have to teleport within the game. And to say the least, this obliterates any feeling of being in the Virtual environment.

But there are some guys in the US who are working hard and chipping away at this challenge. And they might have just solved it with their Hyper-reality.

Image from the company the Void, depicting their experience, coined Hyper-Reality

Stepping into Hyper-Reality

The Void is the name of the relatively new start up from Salt Lake City, US, and it is also the name of the VR experience they are creating.  But to call their vision VR wouldn’t be quite doing it proper justice. Instead they coin their experience, Hyper-Reality. And rightly so. In my opinion, this is VR done right, in the sense that they have built a physical theme park from the ground up which corresponds exactly 1:1 to the digital environment in their Virtual world.

This means that when you step into this theme park, put on the vest, and the VR goggles named Rapture, you are transported into a world which you can walk around, run, and most of all, touch. When you pass through a door, you can literaly touch the door handle, push the door frame open. When you approach a wall, it will be there, exatly as you would expect it.

Check out the Video on the Void to get a better understanding of what I am talking about.

So it goes without saying that this kind of immersion puts us in a completely different category of experience.

“While the phenomenon of “presence” in VR is well-documented, inducing shared presence—experienced among people in different physical spaces, and bolstered by the immersive power of physical feedback—is the milestone that will unlock the medium for good.” Wired

Image from the Ghostbusters VR experience playing in London and done by the people from Void. This experience puts a small team of players into a fully immersive environment which is built as an exact replica of the VR-space.

Another hurdle – this time psychological

But the second point is a bit more tricky. I am talking about the psychology and interactions which need to take place in this VR-world and mimic the real world. It is absolutely necessary to be able to communicate with other characters in a believable way, in order to play out the dramatic narratives.

The interactions between characters playing in the Void, with their team interactions, point us in the right direction. The cooperative game and the multiplayer social experience is what will draw the masses to these theme parks. But this kind of approach can only get us as far as the First Person Shooter genre or Horror VR-experiences like Paranormal Activity VR.

If we want to go further, and create genuine human drama, we need to have proper human interaction. And I am not talking about the A.I.-level of human dialog/communication which is available at this moment. That simply won’t cut it. While I am a strong believer in Artificial Intelligence, I also think that Kurzweil is wildly optimistic. I just don’t think that we will see A.I. advanced enough to pull off a true dramatic narrative for at least two more decades. (Still, I do hope I am way off on this)

But I don’t think we need one. And we might have all the tools available to do something which might be inherently more believable and at the same time social. A new kind of theatre. But this time,  interactive theatre.

Image from Ninja Theory’s game “Hellblade”. The character and its facial and body animation was real-time mo-capped as proof of concept.

Real-time Cinematography

For this to happen we need to look closer at a small company named Ninja Theory who have are working on some amazing tools developed specifically for Unreal Engine.

A new concept of motion capture has been making the rounds at SIGGRAPH 2016(premiere meeting place for the Visual FX industry). Coined “Real-time cinematography”, and done by the Ninja’s Theory team, it is a based on the well known technological innovations of motion capture, both facial and full body. But Ninja Theory’s approach has an added, all important twist. The actor performing the mocap is actually acting out his performance in real time. Only so his facial, and body expressions can be transposed onto a digital character.

Take a look at the video below to see a glimpse of what I am talking about.

Rightly so, they coin this Real-time cinematography. A way to record and immediately play the mocap sequences, without any rendering which could sometimes take weeks. Only this time, the director and the team are able to see the result instantly. And what’s more important, make immediate adjustments, direct and create a story right before their eyes.

 

And the glue that holds it all together

So with the Void and Ninja Theory’s tech we might have the necessary tools at hand to create a new kind of experience. Something which would convince the most demanding directors working in film today to experiment with their scripts in VR as an interactive experience akin to theatre/film.

With this in mind, please stay tuned to for the next installment of this story where I want to talk about the concept of Dungeon Masters, lifted from the age old game Dungeons & Dragons.  Because, I think personally that therein lies the key to the glue that will hold all of this together and form a new kind of narrative.

I would love to hear what you think, so drop me a line. And if you want more stories like this, please subscribe to the newsletter on the front page!

Latest News

Łukasz Maciejewski recommends I AM REN

Łukasz Maciejewski recommends I AM REN

I am proud to announce that the well-known french Film Sales Agent outfit Reel Suspects has taken on our feature film project I am REN (Panacea). Reel Suspects will be responsible for the world sales and will already start with private screenings of a rough-cut of REN at Festival de Cannes 2019.

read more

Storygeist blog

Storygeist – a bird’s eye view

Storygeist – a bird’s eye view

As the Sciences plunge into the impossibilities of Quantum physics, decipher the world of vibrations and frequencies, technology closes in on the ancient truths which the mystical traditions have spoken to us from the dawn of time. And as our world is hurled into a wrenching acceleration of change, we believe that stories are essential to our inner development. A ritual which passes timeless values from one generation to the next. And encapsulate not only intellectual meaning, but also a beating heart which can feed our souls. Join us and read this to get a bird’s eye view of our stories.

read more
Agatha unravelled – part 2 of 2

Agatha unravelled – part 2 of 2

What if the current multi-million venture to break out of the Matrix succeeded? What if we got our answers during a world upending event named The Fissure? But they turned out to be not the ones we wished for.
“Agatha Unravelled” is a short story which revolves around one man’s need to come to terms with his grief, while he attempts to unravel the secret behind his wife’s death and how it connects with the Fissure.

read more
Agatha unravelled – part 1 of 2

Agatha unravelled – part 1 of 2

What if the current multi-million venture to break out of the Matrix succeeded? What if we got our answers during a world upending event named The Fissure? But they turned out to be not the ones we wished for.
“Agatha Unravelled” is a short story which revolves around one man’s need to come to terms with his grief, while he attempts to unravel the secret behind his wife’s death and how it connects with the Fissure.

read more
Venture me out of the Matrix

Venture me out of the Matrix

Two of the Silicon Valley’s moguls latest project is to break us out of the Matrix, which they strongly believe exists and has the humanity enslaved. This is a perfect opportunity to look at the intersection of Technology and Spirituality and identify why these tech-billionaires have come to such a conclusion and what lies behind all of this, according to several ancient spiritual traditions.

read more
Virtual Reality and the reimagining of Story – part 5

Virtual Reality and the reimagining of Story – part 5

So you grab his hand, and scramble for the sliding doors. You shoulder your way across the jeering crowd. You are almost there, the way out to freedom, but as you reach the doors, they are gone. You whip your head around and realize you’ve been pushing the wrong way. But you are 100% certain the doors were on this side. No matter. So you make a valiant effort, and crash your way onto the other side of the subway. All this time Markus begs you to hurry. He is about to capsize, and every second counts. It’s your son goddamnit, and those bastards are everywhere, standing between you and your son’s life.

read more

Films & Books