Skip to main content

To drive its giant virtual world, Ready Player One needed a custom A.I. engine

Ahead of the 91st Academy Awards on Sunday, our Oscar Effects series puts the spotlight on each of the five movies nominated for “Visual Effects,” looking at the amazing tricks filmmakers and their effects teams used to make each of these films stand out as visual spectacles.

Ernest Cline’s 2011 novel Ready Player One was once thought to be un-adaptable with its legions of licensed characters from television, movies, video games, and comic books assembling for a sprawling adventure within a virtual universe known as OASIS. And then along came Steven Spielberg to prove the skeptics wrong.

Spielberg’s adaptation of Ready Player One not only managed to translate the grand scope of its source material, but it also managed to deliver a film jam-packed with the iconic characters and pop-culture references that made the book so popular among a certain generation of readers. It did so with the help of a talented visual effects team led by four-time Academy Award nominee Roger Guyett, who was tasked with not only building a virtual universe populated by a host of familiar and not-so-familiar characters, but also making sure that the digital avatars of the film’s lead characters were capable of conveying just as much emotion as their human counterparts.

Digital Trends spoke to Guyett about the experience of bringing Ready Player One to the screen, building virtual universes, and finding genuine emotional depth among more than half a million CG creations.

 
This large battle scene in Ready Player One on Planet Doom utilized a brand new visual effects engine that used artificial intelligence to generate large crowd systems. Industrial Light and Sound

Digital Trends: With Ready Player One, you were essentially tasked with creating an entire virtual universe without any real limits. What was your initial reaction to the scope of the project?

Roger Guyett: It was breathtaking, really. To be honest, we underestimated just how much work was involved. There was the design challenge obviously, but we’ve done huge shows before. This was definitely a couple of notches harder and intensive, just on the sheer scale of it, but we did have a great team and great collaboration with production designer Adam Stockhausen.

… We wanted to get a good spread of all types of characters, whether they were movie characters or cartoon characters or superheroes or whatever.

Steven [Spielberg] was incredibly collaborative and wanted to make sure that there was a consistency in the ideas all the way from the writing through the work that we did. Ernest Cline and Zak Penn, the writers, were also involved — so that helped enormously. But without a doubt, we underestimated the complexity of it. It was designing on a literally world-building scale.

The sheer number of characters represented in Ready Player One is massive. How did you approach the process of deciding which characters to include and when?

You just have to start by laying out some of the scenes and start getting a feel for the spread of the characters and the kinds of characters that you’re using. What we did at one point was to have a card for every single character that we considered to be a “hero” character within the movie, and we put them up on a board and Steven and everyone else spent hours assigning them to scenes. We’d say, “This is where we want whoever it would be … Batman, Chun-Li, or whoever.” And then we went through the whole movie doing that. As the scenes developed, we got an understanding of how many characters we needed.

As far as the characters themselves, we always needed more — but we wanted to get a good spread of all types of characters, whether they were movie characters or cartoon characters or superheroes or whatever. It was a very complicated process and we wrote a number of different tools to try and help us keep track of it all. Those are the kinds of processes you can often really underestimate until you get into it.

What was involved in assembling that massive roster of characters from so many different properties and other sources?

Obviously, we had characters that we completely designed and built ourselves. Then you have characters that, to some extent, were known and we could appeal to some of the companies that were involved in licensing those characters. We’d say, “Hey, do you have a three-dimensional version of this character?” and quite often they did, or they gave us a starting point for them. The other aspect of this that’s really complicated is the licensing, which is really tricky. You have to be very sensitive about how you’re playing some of those characters.

There are around half a million characters or more in some of those shots at the end of the movie. It’s crazy.

So we had built characters that we did, we had characters that we tried to source versions of, and then there was a competition where people submitted character designs — and I think there were a dozen or so of those. That was another sort of fun thing. We also developed this thing we called “clans,” with characters of a certain type — maybe a [Ray] Harryhausen skeletal army character or something like that — and variations on that theme. If it was a U.S. Army soldier or something like that, for example, the clan would have one guy with a jacket, one guy with a shirt, one guy with a bazooka, another guy with a rifle, one guy who’s short, and one guy who’s taller, and so on. You can build up a large group of characters with that kind of approach.

Once you knew the characters that were going in particular scenes, how did you find the balance between managing these crowds of characters and still retaining their individual, recognizable elements?

That was a big question we had to answer: How do you generate massive numbers of characters and have them all behaving sensibly and abiding by certain rules and doing something vaguely intelligent? The way we achieved that was by writing our own crowd system. That was key to the success of the project. The guys did an absolutely incredible job of creating a completely new and bespoke crowd system.

A clip from Ready Player One demonstrating how the different layers of CGI were used to create the OASIS. Industrial Light and Sound

We had a pretty good crowd system at the beginning of the project, but not a system that would allow us to do what we ended up doing. That was really the “jumping off a cliff and hoping that the parachute was going to open” moment for us. Everyone was very confident we could pull it off, but it was time-sensitive. There are around half a million characters or more in some of those shots at the end of the movie. It’s crazy.

… [The crowd system] had this incredible level of artificial intelligence, [and] you could kind of direct it, too. You could give groups of characters certain goals, and alter their behavior along the way. That was the thing that really made this so impressive.

One thing that really struck me about Ready Player One is how much genuine emotion the avatars have in the OASIS. How did you maintain that level of emotion when transitioning from the human characters to their avatars?

I am a very strong believer that you can have all of this technology and everything, but if you’re not following that emotional thread of the character, it’s all for naught. … Dave Shirk, the animation supervisor, and everyone else spent an enormous amount of time worrying about making sure each character mirrored the performance of the actors.

Ready Player One Behind the Scenes Visual Effects VFX
Image used with permission by copyright holder

For example, if [Art3mis actress Olivia Cooke] looked flirtatious, or she looked sad, or she had a certain type of smile, you had to put that on the character and it needs to translate and get the same kind of reaction from the character. You try to automate it as best you can, but what you really need to make sure of is that when that translation happens, it’s 1:1 mapping … .

You have to adjust your mapping so that you feel the same way about whatever the character’s face is doing that you would feel about the actor … . This is really where the art meets the technology. The technology allows you to track the facial structure, and the fidelity of the motion-capture system that we were using for Ready Player One was considerably more impressive than anything else that we’ve used before, but it’s not just about that.

That’s the great thing about that kind of virtual world: You can make those adjustments.

You need to make sure that Steven can do a side-by-side comparison of the two performances, playing back the performance of the actor and the performance of the character, and say, “Yeah, you’ve captured that performance.” … if you’re not getting that performance out of that character then you need to go back and try and understand why. That process can be very painstaking, and very specific to each actor.

Some early reports indicated that VR came into play in designing the movie’s version of OASIS and that Spielberg actually used VR goggles to explore some of the worlds you created. What did that involve?

One of the challenges with a motion-capture project is that the actors and the director don’t really understand the world they’re in, or they don’t get enough visual feedback from it. If you’re directing a scene in the live-action world, you simply walk into a location and all of your senses react to that space. We wanted to give Steven the same feeling, so we built more or less sophisticated versions of each of the locations we were trying to use for the movie in virtual environments. If it was Planet Doom and you’re doing a scene on the battlements, we would bring that into the system and both the actors and Steven could put on virtual reality goggles and move around that space and be inspired by it.

Ready Player One Behind the Scenes Visual Effects VFX
Steven Spielberg on the set of Ready Player One. Warner Bros. Studios

That feedback really helps you. You can understand what it feels like to stand on the battlements 100 or 200 feet high, and we could make adjustments, too. Steven would say, “It would be great if I could see a view of … whatever,” or he would ask, “Can we move that tower and get a better view of the field?” That’s the great thing about that kind of virtual world: You can make those adjustments. … Steven totally understands the technology and he really uses all the advantages of it, but the main thing for us was making the actors feel familiar with the space and feel inspired by it.

Ready Player One strikes me as a film that someone who works with visual effects can really identify with, as OASIS is a fantastic environment that works best when you don’t realize how much work it takes to create and maintain. Visual effects are all about creating things that don’t feel manufactured or artificial. Did that resonate with you?

I always felt that there was this kind of weird thing where we were constructing the OASIS. It was weird to be mirroring the story and many of the things that they were doing in the movie. If you were going to do something like traveling into The Shining, for example, then you probably would have done it very much like we did it. It was fascinating.

Was there a particular character or scene from Ready Player One that really encapsulates the experience of working on this film for you?

It’s hard to separate out just one or two things because I think one of the most important aspects in a project like this is to try to be consistent and try to fall in love with every moment, so that you bring each of those moments to the best it can be.

More Oscar Effects Interviews

But I just loved working on the New York race for all sorts of different reasons, because it was so much fun. But I also loved working on The Shining, because I loved hearing Steven’s stories about [Stanley] Kubrick and making The Shining movie and building that world. I am such a huge fan of the movie, and I have such a passion about it. So being able to just rebuild it like that was incredible.

Ready Player One premiered March 29, 2018. The 91st Academy Awards ceremony kicks off February 24 at 8:00 PM ET on ABC.

Rick Marshall
A veteran journalist with more than two decades of experience covering local and national news, arts and entertainment, and…
Don’t let these 3 hidden March 2025 streaming TV shows fly under your radar
A group of well-dressed people crowd by a doorway, looking shocked in The Residence.

Every month, there's always one, maybe two, new shows that get all the attention. Sometimes, it's a popular show returning with a new season. This March, many less high-profile shows are flying under the radar. You might have heard of these shows but weren't quite sure what they were about or even if they're worth watching.
We suspect that you'll be pleasantly surprised if you give any of these shows your time. Check out an episode or two, and it will likely lead to binging the whole thing. Two of the three series release all season one episodes at once, while the third will tease you with the first two episodes this month. What are these three hidden March 2025 streaming TV shows you shouldn't let fly under your radar? Have a look.
Need more recommendations? Then check out the best new shows to stream this week, as well as the best shows on Netflix, the best shows on Hulu, the best shows on Amazon Prime Video, the best shows on Max, and best shows on Disney+. 
Deli Boys (March 6)
Deli Boys | Official Trailer | Hulu
Already receiving rave reviews, Deli Boys is a hilarious comedy about two Pakistani American brothers, Mir (Asif Ali) and Raj (Saagar Shaikh), who discover that their father was much more than a convenience store owner. When he suddenly passes, the brothers discover that dear Dad was actually embroiled in a life of crime.
If they don’t want to lose everything their family has worked for, they need to take over as the new crime bosses. But this is not a life they know anything about. As one of the most anticipated Hulu shows of 2025, Deli Boys’ first season delights thanks to its clever one-liners, talented cast, and bizarre storylines.
Stream Deli Boys on Hulu.
The Residence (March 20)
The Residence | Official Trailer | Netflix
The best way to describe The Residence is that it's like Knives Out in the White House with a gender-swapped Benoit Blanc-like character. The lead is Cordelia Cupp (Uzo Aduba), an equally eccentric yet brilliant detective who consults with the local police. When the White House chief usher, A.B. Wynter (Giancarlo Esposito in a role that was originally supposed to be played by the late Andre Braugher), winds up dead, she’s called in to investigate. A state dinner is going on downstairs with officials from Australia, and Cupp orders that no one leave until she questions all 140+ people present.
The Residence is plenty of fun, mixing the usual whodunit formula with Shonda Rhimes' unique creative flair that will keep you guessing from one episode, even a moment, to the next. Aduba is perfect as Cupp, who combines an oddball personality — including repeatedly birdwatching in the middle of a murder case — with a subtle sarcasm. Through it all, however, she throws down astute observations that teach everyone she knows exactly what she’s doing, even if it doesn’t look like it. If you love the whodunit genre, The Residence won’t disappoint.

Stream The Residence on Netflix. 
The Studio (March 26)
The Studio — Official Trailer | Apple TV+
One of Apple TV+’s quieter new show releases is The Studio, which has gotten overwhelmingly positive reception in early reviews. Seth Rogen created and stars in this comedy as Matt Remick, a man who longs to run a Hollywood studio. When he finally realizes this dream, however, the reality of the complicated balancing act of managing budgets, changing economic and societal times, corporate demands, and eccentric actors sinks in.
The Studio has an incredible cast that includes Catherine O’Hara, Ike Barinholtz, Chase Sui Wonders, and Kathryn Hahn. There's also a rotating selection of guest stars playing exaggerated versions of themselves to add to the Hollywood feel, from Zac Efron to Martin Scorsese. Early reviews already give The Studio a perfect 100% Rotten Tomatoes score, with Slant Magazine’s Ross McIndoe singling out the dark and “more than a little pointed” comedy as the highlight.

Read more
3 PBS shows you should watch in March 2025
three pbs shows you should watch in march 2025 call the midwife season 14 tv hero 2

PBS may not be able to boast a lineup of original shows like Netflix and the other streamers, but it's been America's gateway for British dramas for decades. Granted, some of these shows will show up on the streamers as well. The key difference is that PBS won't charge you to watch them, and you can even stream them online if you don't want to support your local station.

This month's picks include two returning British dramas, one of which had almost a full decade between seasons. Our other pick is a returning murder mystery show from Sweden, which proves just how universally popular that genre has turned out to be.

Read more
If you have to watch one Peacock movie this March 2025, stream this one
Saoirse Ronana in Brooklyn

If you're looking for stuff to watch on Peacock, you're probably going to have to sort through a lot of stuff. That's not to say that there aren't things worth watching on Peacock, just that finding them can feel more difficult than it should.
We've done the hard work for you and found a perfect movie for your March watchlist. Brooklyn tells the story of a young woman who immigrates from Ireland to America in the 1950s and finds herself torn between her old life and the new one she's built. Here are three reasons you should check it out:
Need more recommendations? Then check out the best new movies to stream this week, as well as the best shows on Netflix, best shows on Hulu, best shows on Amazon Prime Video, and best shows on Disney+.

It features a star-making performance from Saoirse Ronan
Brooklyn Official International Trailer #1 (2015) - Saoirse Ronan, Domhnall Gleeson Movie HD

Read more