Working with the artists over at Paperhand Puppet Intervention to create The Longest Night was a real treat. Once we were able to explain the possibilities of using their artwork in a digital realm they started to think and adjust their process for creating easily adaptable painted textures.
One asset in particular was a cabin in the woods that the “old woman” character lived in.
They approached the creation of the textures by building a small paper mock up and then unfolding it before painting the individual pieces.
This template was used to create the textures, and even worked as a great reference point for building the final 3D model.
After incorporating it in the scene, and lighting it we were able to create a great mood and feel using these excellent painted textures and a little Photoshop manipulation.
We finished our latest show “The Longest Night: A Winter’s Tale” in November and it’s now been playing at Morehead for about 2 months. It’s getting a great response from the community. There’s so much demand, in fact, that we’ve had to create extra weekend and weekly showings so we won’t have to turn people away. We’re very happy about this response, of course.
Here’s the description of “The Longest Night” straight from the Morehead website:
“The Longest Night: A Winter’s Tale” is a one-of-a-kind fulldome planetarium show that captures its audience with a timeless fable of courage, generosity and renewal. Its story explores the concept that winter is a time for Earth to rest, waiting for new growth in the spring.
Its star, a young girl born into a family of nomadic storytellers, embarks on a simple quest that leads her to a dragon’s nest. What will she discover there, and how will it help her save her village?
Morehead collaborated with Paperhand Puppet Intervention to develop the story and visuals of “The Longest Night.” The Morehead production team seamlessly wove together live-action video of Paperhand’s world-class puppeteers with beautiful and intricate fulldome animation to create this innovative and imaginative show. Its cast and crew comprised dozens of puppeteers and production professionals, and The Paperhand Band created original music for the show.
For more info, here’s a short promotional video we created for the show:
We’ve got one more behind the scenes video to share created by our production intern, Paul Davis. In it, Jay Heinz (that’s me) talks about all things related to audio and sound design used in Solar System Odyssey. I promise none of it is in the 3rd person, either.
It’s been a while since we’ve updated this blog because we’ve been pretty busy finishing up our latest show, The Longest Night: A Winter’s Tale. More about that in some later posts, but we’ve opened it at Morehead and it’s getting a great response.
In the meantime, I just wanted to share a behind the scenes video one of our incredible student interns, Paul Davis, produced. Paul had his hand in many aspects of The Longest Night, from RED camera operator, to rotoscoping to some After Effects animation. In his spare time, he made this video where Peter Althoff, our technical director, talks about some of the tricks involved with dome production that were specifically used in Solar System Odyssey.
When our current team solidified at the very beginning of Morehead Production, we came from very different backgrounds. Jay, a designer and journalist; Pete, a motion graphics and compositor; and myself an animator. The one thing we did all had in common however was we had never done dome work. We have since learned from our mistakes starting out, and taken new steps to refining our processes to making dome shows. Among those changes has been our storyboarding.
Earth, Moon, and Sun
This was our first show that we made, so our storyboards are closer to those for flat screens than domes. We saw there was a challenge of how to draw a storyboard accurately for the dome and tried to illustrate it, however once production and animation started it was clear the boards were very limited and ultimately not very useful.
Magic Tree House
Our second show, Magic Tree House, is an adaptation of the original analog show we had here at Morehead Planetarium. With the Zeiss’ retirement drawing closer, we were tasked to make a digital version of this show. Although nearly every scene was simply updated with better visuals, there was a sequence which we were able to re-imagine. This is where we thought to introduce the idea of drawing the storyboards in the dome itself. We found it was very successful, and there were no surprises when it came time for actual production because the composition of what you saw in the storyboards could translate directly to what we’d do in production. It took a little getting used to drawing with the distortion, but it was ultimately worth it.
Solar System Odyssey
After the success of storyboarding in the dome for Magic Tree House, it made the most sense to continue that practice with Solar System Odyssey. A challenge presented itself however, which was the element of a character driven show. In all our previous productions, there were either a small appearance of one character, or no characters at all. Solar System Odyssey had a staggering three characters on screen at nearly all times. It was because of this that we had to think and draw not only where the characters are on the screen, but also where the camera is going to give the best staging direction for our characters. This was where we introduced the idea of our ‘dance chart’, which we would make for each scene with characters. I also called it the Law and Order effect (in respect to one of my favorite shows on television).
The Longest Night
Advances and evolutions we’ve been making in storyboard development took a strange turn for this show, The Longest Night. Not only was it to be our first show with significant amounts of live action in it, but it would be a collaboration between us and Paperhand Puppet Intervention. There were plenty of challenges already with storyboarding a hybrid of live action and digital environments, but added to that is taking the script and boards they drew and adapting it for the dome.
This is an example of one of the boards that Paperhand created before it was taken to the dome. We could get an idea of what was wanting to be seen, but we needed to be able to see it on the dome to get a better sense of scale and placement of the characters and environments. Using what we learned from shows in the past and adapting the dance chart to include ‘real world’ camera and ‘digital’ camera placement, we came up with an example seen here.
As I said in the title, this is our evolution of storyboarding. There will never be an end to the changes we make in our process as we learn and grow in the dome field. We will just keep applying and adapting what we have learned in the past to our work in the future.
In the first four fulldome shows that Morehead produced, we didn’t have to do much collaboration with outside groups. We’d sometimes contract out a writer or the composer, but for the most part, our productions were created almost completely in-house. That all changed when we met with Donovan Zimmerman from Paperhand Puppet Intervention and decided to collaborate on our newest show in production, The Longest Night. Paperhand had been putting on stage performances in North Carolina for over 10 years and we loved their style, aesthetic and message. But collaborating with a completely non-digital group presented some challenges.
The basic plan was for Paperhand to write the script, we’d take it and produce storyboards and pre-viz. After that we’d shoot live action of Paperhand’s giant puppets on green screen, do the digital production and finally, Paperhand would score the show. Every step of the way we’d make sure to COLLABORATE, meaning that we weren’t just dividing up the tasks, but we were bouncing ideas off each other and making sure we were both happy every step of the way. Easier said than done.
The first challenge was that Paperhand had never been involved with a dome production. In fact, they’d never been involved with a film production of any of their shows. So we were starting from scratch. The first thing I like to do is to explain the basic steps in making a show:
1. Concept & Script
2. Storyboards & Concept Art
3. Animatics/Pre-Viz & Scratch Audio
4. Production (film and 3D) & Sound FX/V.O.
5. Music, Narration and Post
But another thing I like to show to newbies is this great video from Cirkus Productions out of New Zealand about the ABCs of the animation process.
Once we were fairly certain they wrapped their head around the basic process, we had to make sure that they understood the differences between STAGE, SCREEN and DOME productions. Luckily, in some ways, a dome production with live actors is actually more similar to a stage production than a film. It’s just that the stage surrounds the audience and we can move from scene to scene much more quickly.
As you know, you don’t cut on the dome like you do in a film. Instead, you need to draw the viewer’s eye to what is important using other techniques. Paperhand had plenty of experience working in that manner. So once we had convinced them that it wouldn’t work to cut to a close up of an object or character and got them back using their old school techniques, things worked much more smoothly. Oddly enough, this was one situation where the less “film” knowledge worked out to our advantage.
What they weren’t prepared for is the limitations of the color green when shooting on a green screen. It’s tough when you’ve been making puppets for 15 years with green in them for someone to tell you that you can’t use that color. If all else fails and they ended up having green on their puppets, we could have painted the room blue.
The next thing we had to explain to our new non-digital friends was the beauty of digital magic. At first, they assumed that when creating concept art or pieces for the production, they’d have to make them life sized. They also thought that if we needed 200 trees, they’d have to paint 200 trees. They were happy to hear about the copy and paste functions in After Effects. They were also happy to realize that we could tweak colors very easily in the system without them having to paint new versions. The great thing is that we ended up with a lot of fantastic concept art. Here are some examples:
Early on in the planning stages of “The Longest Night,” we realized there were going to be some big changes to how we approached production. Typically we work with animated CG characters and environments. We can dictate actions and are in charge of a camera that is essentially unlimited in its range of motion.
With this production we knew we were going to need to actually capture some performances and integrate that footage into some sort of environment. An example of what we thought would stylistically work with the look and feel of a typical Paperhand Puppet Intervention show is the Modest Mouse video “Float On”.
The flat nature and stylistic treatment of the video seemed to be flexible in the sense that it didn’t have to make physical sense and could be executed with static camera green screen shots. The footage could be mapped to flat cards and be moved around. We shot some test footage and made a quick proof of concept.
We found this technique to be functional but limiting.
We eventually realized that we could put movement into the green screen footage and match-move it. Match-moving is a technique in post-production where points are calculated out of the footage and software can use the points to map out digitally what the camera is doing in real life. Then we can use that data to animate a fisheye camera in 3D space where we could do more dynamic and realistic uses of footage in relation to the camera. This was a theory that we decided to test out.
You can see the final result of our test below.
Below is an earlier version where you can see the original footage before it was keyed out.
We matched the real world footage to a digital background. This rough test was the foundation for the work we would then build upon for designing the rest of the show.
We’re right in the middle of production on our newest show, tentatively called The Longest Night: A Winter’s Tale. The show is being created in collaboration with Paperhand Puppet Intervention, a talented crew of people who normally produce live theater with giant puppets, masks, stilt dancing, rod puppets, shadows or silhouettes, and anything else they think will work. They’re wildly popular in our part of North Carolina and we like their stage shows so much that we thought it would be great to put them up on the dome and send them around the world.
For the past six months we’ve been developing ideas, writing scripts, creating storyboards and pre-visualizing a show unlike anything that’s been seen up on the dome. It’s an experiment, that’s for sure. But as it develops, we’re getting more and more excited about it. In the weeks to come, we’re going to be posting updates on When In Dome about the ideas, the process and the people involved. Stay tuned…
When we started producing dome content 4 years ago, we were working on two different 3d platforms, 3ds max and Maya, and still doing a 5 camera stitch with a hemi-cube. We used the 5 camera stich to create our first two productions, “Earth Moon and Sun” and “Magic Tree House.” On our most recent production, “Solar System Odyssey,” we knew we wanted to try something different. Since we were doing a character driven piece, I took it upon myself to learn Maya. One of the greatest achievements in our recent production was the proper implementation of the DomeAFL shader for mental ray, created by Daniel Ott.
This opened up new doors for rendering and camera techniques. The reduced time of manually stitching together comps freed us up to try and tackle more challenging aspects of production. One of the new features we’d be able to render was an Ambient Occlusion pass that gave our elements new depth.
We no longer were fighting to fit disjointed pieces together before running out of time, but instead were able to refine our work from a rough state to a more polished product.