Cool Matrix Filming Techniques 155
webword writes "Here's how those cool scenes from the Matrix were filmed (go here). Not that I want actually buy one of these cool cameras, but I hunted around to find out how to get one and how much they cost. You can get one here. This brings up a quick question: How are people keeping up with the latest and greatest filming techniques?" What? An advance in cinematography that doesn't involve a farm of Linux machines?
Q3A (Score:1)
Patent? (Score:1)
One click shopping comes nowhere near this.
Keeping up with filming techniques (Score:1)
Keeping with the trend (Score:2)
------------
This was covered before. (Score:2)
Re:Just sit there and look good. (Score:1)
Farms of Linux Machines? (Score:2)
http://www.freebsd.org/news/press-rel-1.html
Ben.
Unix Involvement (Score:3)
Matrix and rendering farms (Score:1)
For those who still don't know, read this [air0day.com] link.
Fad or fascination? (Score:2)
I think we'll be moving more in this direction, in terms of filmmaking production, as well as satellite distribution to theaters. Viewers always wish to be awed, so I don't think this style will be a fad.
Other camera's (Score:1)
By the way. If you like those green-falling-letters-screen, try the Matrix screensaver included in the xscreensaver [jwz.org]. Also fun to run in your root-window :P
he was (Score:1)
Other camera's? (Score:1)
By the way. If you like those green-falling-letters-screen, try the Matrix screensaver included in the xscreensaver [jwz.org]. Also fun to run in your root-window :P
Re:matrix DVD (Score:2)
There's a red pill in the background. Click it, and they go into "The Making Of...". Clever.
Re:Other camera's? (Score:1)
Cheaper things with time and cameras... (Score:3)
Like I said pretty off-topic, but quite an amusing thing to do in these long winter evenings. Thanks to Zoe Millington for coming up with the idea.
Re:matrix DVD (Score:2)
Making of... (Score:1)
Re:Patent? (Score:1)
Re:Am I the only one who hates Keanu Reeves? (Score:1)
I've seen this BS too many times to count. It's like asking why the media likes to attach itself to tragedies like the "school-shooting craze."
Computer geeks are viewed as being uncolorful, and while this may be true for some, I know personally I come across as un-mono-tone as possible.
I realize this discussion isn't on Keanu Reeves as a bad actor, but I had to set it straight!
Nothing Spectacular (Score:3)
Whoever thought up this technique was brilliant. The design is simple, but obviously *very* effective. Basically, the design is simply a row of cameras (usually circular with varying height) that film on a central position. The cameras are all exactly synched with eachother, and film simultaneously. During the editing process, the film from each angle is played at the same time, and frames from each camera are used as input to the final master. So say Camera 1 is at position A, Camera 2 is at position B, and Camera 3 is at position C. All three cameras are filming one central point. During editing, Frame 1 is taken from Camera 1, and the next two frames in succession are taken from the next two cameras, all from the SAME TIME POINT. (Since all cameras are exactly synched, you get 3 different angles of the same shot.)
When the editing is finished, the shot appears to rotate around the central film point.
-- Give him Head? Be a Beacon?
WAY Better Articles on Virtual Cinematography Here (Score:3)
Re:Blair Witch (Score:1)
http://www.blairwitch.com/ [blairwitch.com]
Re:Cheaper things with time and cameras... (Score:1)
Reminds me of some fun you can have with a microphone and a simple wav recorder/editor. You sample yourself saying something ("pistachio" is a good one), then reverse it. Then sample yourself trying to say it like you hear it reversed. Fun ensues.
many other links of these cameras in the news. (Score:1)
Re:Come on... (Score:1)
Or maybe a live view of the queue in which selected moderators rate the suggested articles higher or lower with, say, ten minutes to vote on each article after its initial submission. Then, when time is up, the article is posted automatically or thrown into the rejection pile.
What do you think?
--
You don't even need a camera... (Score:2)
The patent is linked from their web site. (Score:4)
The various descriptions on the web site gave me the impression that a series of independent film or video cameras would have even more potential: Varying spacing to accellerate/decellerate the pan, varying positioning to pan in 3-D, switching to full motion at varying speeds at selected intervals, etc. And the authors appeared to understand this potential. So I wondered at the omission in the patent.
Then I checked some of the references, and discovered that such (at least with film) had already been patented before - far enough back that the patents are expired.
So it looks like doing this with an array of independent film cameras is prior art. Video cameras in any configuration except evenly-spaced along a straight or curved line (which is covered by claim 4) also appears to be open, and you might break claim 4 by treating it as a special case of the previous expired patent with the obvious substitution of video cameras for film cameras.
Essentially all the patent covers is a camera with many lenses and synchronized or sequenced shutters, projecting onto a common film strip, along with a multiple-video-camera model of it.
Use cinefex to keep up with advances... (Score:1)
Matrix-HOWTO on DVD vs. VHS (Score:1)
Good... bad... I'm the one with the gun.
true 3D visualization... (Score:2)
http://php.indiana.edu/~dgsharp/stereograms/
Re:Come on... (Score:1)
Re: Sig11, the karma whore/no-lifer (Score:1)
--
Re:Am I the only one who hates Keanu Reeves? (Score:1)
Isn't that how hackers are supposed to look like in real life?!
Also, let us not forget the fact that he is a bit stunned by this my-life-isn't-real idea... :)
--
Here's some more info... (Score:1)
http://www.virtualcamera.com/invention 2.html [virtualcamera.com]
--
The cameras used in the Matrix are Canon EOS A2's (Score:1)
So now I feel kinda special since I have one of Matrix cameras. Yaaaay!
(side note, the difference between the EOS A2 and the A2E is that the E version has eye-controled focus, otherwise they are identical)
Cameras are only a tiny part of the story (Score:5)
I know one of the people who did the R&D on bullet-time sequences in "The Matrix"; he recently gave a seminar at U.C. Berkeley along with Jon Gaeta where they discussed how the bullet-time sequences were done.
First, the difference between bullet-time sequences and the GAP commercial sequences is a big one:
Freeze-time shots (e.g., the GAP commercial) are easy to do. All shots are taken simultaneously of the scene, and you don't need to worry about the motion of the subjects in the scene.
Bullet-time shots actually have to move in very slow motion. At the seminar, they said that although they had many cameras firing sequentially over the camera path, they were unable to place cameras close enough together to capture sufficient frames during really slow segments of movement (if you watch The Matrix bullet-time sequences, you'll see that initially the motion starts out very slow, and gradually speeds up)
The way that Manex solved this was to use computer vision techniques to interpolate the necessary "in between" frames. This is especially difficult since the motion in some shots (i.e. Keanu Reeves' arm waving in a circle in the air) have motion that isn't linear (meaning that the compute can't simply compute the pixels along a straight line from one frame to another). Manex used a lot of combined interpolation techniques to achieve the results in the movie.
In addition, obtaining consistent camera lighting, film grain, and film speed parameters proved difficult. They used cameras that were all uniform in make and model, but had to image process the frames to achieve consistency.
Second, you may notice that all bullet-time sequences were captured on a green screen! One of the reasons they did this was because the angle of rotation is actually more than 180 degrees. (This is also a difference from the GAP commercial) So how did they insert the background?
Well the answer is, they re-created the backgrounds. Manex used image-based modelling and rendering techniques that were based on work done by Dr. Paul Debevec [berkeley.edu] at U.C. Berkeley. You can read more about the FACADE photogrammetric modelling system and The Campanile Movie [berkeley.edu] (which I helped work on) by following the link.
Manex's techniques greatly improved upon the work at U.C. Berkeley; they showed an OpenGL real-time demo of the sub-way and government building lobby shots from the movie at the seminar; very cool stuff.
Hope that sheds some light on how effects in The Matrix are really done.
-- Charles
Re:Matrix and rendering farms (Score:2)
The comment "What? An advance in cinematography that doesn't involve a farm of Linux machines?" was a jab at FreeBSD. Note the only OpenSource-Matrix reference commonly published is the BSD farm used for graphic rendering.
Given this quote from TimeTrack s own web page:
"We even have an optional mechanical shutter system which requires no electrical power."
It would seem the use of GNU/Linux technology for this camera system is a situation where the extra technology is not needed.
Trying to put your choice of technology where it is unneeded is the hallmark not of advice, but the same kind of tactic Microsoft uses....that of "All problems look like a nail(microsoft part number x-095687-002) and you hit it with a hammer(microsoft part number 94374)"
For him, the OpenSource movement is Linux, and not the OpenSource movement has Linux as a part of the movement.
(For everything bad said about Mr. Stallman, at least he has respect for others. When Mr. Stallman was looking for his access badge, Mr. Plant told him that he should tell the guard "he was Richard fucking Stallman, and didn t need a badge." Mr. Stallman pointed out that why should he make the guard s life difficult. The guard is only doing his job.)
Re:Am I the only one who hates Keanu Reeves? (Score:1)
I was pleasantly surprised. I think his "mono-emotional" and general appearance as Dude-With-Severe-Lack-Of-Clue worked very well for him in his role as Neo... a character who spent most of the movie without a Clue, and trying desperately to cope with the changing world around him. Not much of a stretch. The problem came when Neo finally got a grip on the Matrix at the end of the movie. That's when I was unable to think of Keanu's flat affect as being appropriate to the character.
This could be a major problem when the sequels are filmed... unless someone shells out for lessons for our man Reeves. Donations, anyone?
No, it was Meat Beat Manifesto (Score:1)
Re:Keeping with the trend (Score:1)
it's the new "morph", one of those rare advances that is actually new, and not just a rehash of something old, which will start popping up everywhere until we are all sick of it.
Still, the matrix work was very cool, and added something to the art:
Only the actors were shot with the timeslice technique, in front of blue screen. the backgrounds were digitally created later, and rendered with camera moves that matched the blended camera 'move' around the actors.
it was 360 degrees, which is impossible without the bluescreen (well, not impossible, but requires a lot of paintbox work and/or difficult and limiting camera positions to reduce visibility) Some was still required on the matrix, but not much.
Very cool, be interesting to see how they can top it in the two sequels.
Re:Other camera's (Score:1)
Re:Keeping with the trend (Score:1)
Hey, those are neat! (Score:1)
Re:Matrix and rendering farms (Score:1)
Not linux farms, FreeBSD (Score:1)
am i the only one who finds the consistant pro-linux ignorance really annoying?
no, i dont think that making everything run on linux is a good idea. infact i think its a stupid idea that would surely leave us wrose off.
Re:Matrix and rendering farms (Score:2)
Come on. Let's keep the Linux-BSD competition a friendly sportive one, it should not been carried out at the personal level.
Anyways thanks for that RMS [lemis.com] story. By the way, he does not crumble to dust if brought in contact with BSD, as this link [lemis.com] from an Australian Unix user group meeting proofs. :-)
Here is the caption:
Peter Wemm trying to convince Stallman to adopt the Berkeley Licensing conditions. You'll notice (but not recognize) that Stallman is holding a FreeBSD CD-ROM set in his right hand. It obviously doesn't taste as good as the Australian wine in his left hand.
digital fascination (Score:1)
Just sync each of the digicams to pull frames from a designated section for the angle you want filmed. I envision a joystick type controller that would rotate your viewing angle thru the array of cams, pulsing the lead camera to shoot continuous and the camera on each side to catch every other frame for effect.
All of this would be combined downstream and easily manipulated in digital form. Then add in what ever else you need in the scene and you have a lower quality but still impressive piece of photography.
How do they ensure consistent exposure? (Score:2)
Also, I never could figure out how they did they scene with the woman in red where they froze everyone in time until reading this. Can anyone elaborate more and how they varied the length of the exposure to produce that effect?
--
What if the Matrix ran on Linux? (Score:1)
With every advance in technology we seem to hear the same thing "Can I do it with Linux?". Often it that is the case. So wouldn't it be logical to assume that the first true AI could be running on Debian or PPC?
Just imagine, the tool of liberation becomes our new slavery.
Re:How do they ensure consistent exposure? (Score:1)
To your first question, Manex developed custom software to perform color correction, film grain, and other lighting corrections on the recovered frames.
To your second question, I believe it was just a single still taking from one camera viewpoint. They may have "idled" the frame (where you capture 4-7 frames very close together and loop them to fix film grain problems and to give a bit of "movement" to the eye.
Still not the "real thing" ... (Score:1)
Once you have the 3D-scene in the computer you are absolutely free to create any time/camera path/zoom/whatever variations one could imagine (and probably a lot more than anybody would imagine before he had used it for some time).
But I guess for things like this we still have to wait some time for enough processing power and good 3D-reconstruction programs (I have seen some, which are not really easy to work with (still lots of user interaction needed to get nice models even from simple scenes) and still don't bring really good results). But who knows, maybe we'll see things like that soon (or are there already spots using a similar technique?).
Christoph
Kittens! (Score:1)
Other Sources (Score:1)
Two other great sources of VFX news:
www.vfxpro.com
www.mediatechnology.com
and
Cinefex Magazine, available at Borders or Barnes and Nobles. Get 'em quick, though, they sell fast.
Sell Linux as a movie studio and die (Score:2)
Old News (Score:1)
------
WWhhaatt ddooeess dduupplleexx mmeeaann??
Re: Sig11, the karma whore/no-lifer (Score:1)
Been there, done that... (Score:1)
If I'm not mistaken, this was featured a little less than a year ago.
Watch the Matrix DVD "behind-the-scenes" section (Score:1)
Saw this on Splat! (Score:2)
Basically, the guy who invented it is an engineering school dropout. They had an interview with him which was very interesting.
CineFX magazine (Score:1)
Re:CineFX magazine (Score:2)
Those are sweet!!! (Score:1)
What are you smoking? (Score:1)
Re:Am I the only one who hates Keanu Reeves? (Score:1)
shaft
Eye Candy != Storytelling (Score:1)
Blair Witch is just telling a story with a simple but effective method..
Naturally, the typical 13 yr old is gonna think the Matrix is RaD..
Re:Unix Involvement (Score:1)
I use both systems (and more) and swear by them. Windoze just crashes and so does Mac. Not really the things movies are made of, is it?
In addition to 'getting the job done', you have to allways show the people something different. Can anything but the "big X" occupy this position?
Technical aspects of this technique (Score:4)
That camera used a bunch (360!) of independent 35mm cameras, which could be arranged in a full 360 degree circle. This yields 12 seconds of film (at TV frame rates - 15 seconds at movie rates).
The cameras were controlled by a computer, which can assign a time delay to each camera independently. So, the system can be used to freeze a scene, do a "virtual dolly", do both, ramp the frame rate from any speed to any other speed, etc.
The reason for using this many cameras is that the quality of the final motion sequence is much better if you get the whole thing on film than it is if you have to do computer interpolation. Additionally, the cost of computer generating frames is VERY high.
So, the technical troubles with a multi-camera system are (in no particular order):
Synchronization: Even if you trigger a bunch of cameras at the same time, the shutters won't open at the same time. We call the delay "Lag Time", and it is dfferent for every camera we've tested. It doesn't matter if you have a consumer camera (Nikon N50, Canon EOS Rebel) or an expensive professional camera (Nikon F5, Canon EOS 3) - each individual camera, even the same model number - will have different timing.
Exposure: A previous poster mentioned the problems with subtle variations in exposure creating problems. Bingo! The trouble is that still cameras are meant to be consistent from frame to frame, not from camera to camera. Even a $2500 professional camera body will have variations of about +- 1/3 stop from camera to camera. When you sequencs these frames, the film looks like it was taken with a 1940's 8MM camera - bright/dark/flickery - terrible.
Lenses: Like the shutter, lenses can have a profound effect on the "look" of the frame. The exposure, color, and focus will be different from lens to lens. The denter of the frame will be fine, but the edges can be a problem (because of edge, the perspective warping of different lenses can be a bit, well, different)
Rotation / Focus / Setup: Remember, somebody has to point all the cameras at the right spot (or spots), focus them, possibly adjust zoom, etc. There's a whole lotta room for error here. Luckily, there's a machine, known as a rank, which is used to correct minor translations and rotations.
Spacing: Someone had mentioned that the cameras were too close together, thus requiring computer interpolation. Yup, that's a problem.
There are a few advantages to the multi-camera technique, as well:
Directional Flexibility: Each camera can be pointed at whatever you want. You can do pans, tilts, different zoom levels, freezes, virtual camera motion, etc. In fact, with 360 cameras, you could do them all in the same scene!
Timing Flexibility: This one says it all. Simple example: Go 30 frames/sec. on even numbered cameras, then freeze odds. The final film looks like a regular dolly around the subject for 6 seconds (subject is in motion), then we go around the subject for 6 seconds again while the action is frozen. Start doing speed variations and smooth timing curves, and you can get some interesting effects (want to see things happen in reverse time? go ahead. ...)
Well, I've wasted enough of your time and bandwidth. Just thought I'd tell people about the system that has done most of the freeze effects that have been done (about 75 shoots, versus 35 for all others combined).
Cheers.
Why isn't this offtopic/flamebait? Score 3???? (Score:1)
Re:You don't even need a camera... (Score:1)
Nice MPEG movie. However, my mpeg_play and xanim seem to get something related to "interlacing" wrong. What do you guys use for playing mpeg movies?
Roger.
Re:Unix Involvement (Score:1)
--Emmett
MPEG Players (Score:1)
it seems to be the only *nix MPEG player that works
reasonably well...
You can get a copy at www.mpegtv.com.
--Kevin
=-=-=-=-=-=
"HELLO SMALL CHILD! WHO IS BACK! I HAVE THE RENEGADE MASTER WITH ME!"
Re:Hey, those are neat! (Score:2)
http://www.virtualcamera.com/samplework.html
which has some good fly-arounds of stuff from commercials they've made. I'd love to have 2 FireWire video cameras and strap them together, and film a short movie or something... =) Get some good polarized filters and two nice digital video projectors, and some polarized glasses..... NICE. =)
You can "exctract" the third dimension from just about anything if you're careful. Someone turns their head, a car drives by... Problem is getting a good clean couple of frames to choose from where no other objects move and stuff. And if you're filming them yourself, you've gotta be careful if you "circle" your target, because it can screw things up, making it hard to see (as I found out the hard way
One movie I'd love to try this with is Enemy of the State, as they panned like crazy in that movie (not to mention a couple of the "fly-arounds"). I'd love to see anything you come up with tho.
Re:What are you smoking? (Score:1)
Umm....IRIX isn't Linux (yet?
It's a UNIX flavor, but defintely not Linux.
--Kevin
=-=-=-=-=-=
"HELLO SMALL CHILD! WHO IS BACK! I HAVE THE RENEGADE MASTER WITH ME!"
Much More Than Cameras (Score:1)
Yes they did use a series of still cameras, yes they did then use a computer to interpolate some of the shots.
What also happened is that they used the computer to create a 3D model, based on the data from the different view points. Then they took the images in the shots, used them as textures on the 3D models and voila! they had a 3D model (well, lots actually, one for each cinema film frame). From this they could move the camera *anywhere* and were not constrained to the path of the original cameras. This enabled them to follow all sorts of new camera paths (except where texture data was missing).
This is a major step forward! As someone else mentioned, they also computer rendered the background. On the DVD you can see the wireframe models and incomplete renderings of the subway station.
A little more info... (Score:2)
Just for those who don't want to go reading everywhere else...
The really impressive thing about those Bullet Time sequences is not really the camera setup (and yup, they were Canon EOS) - which is one of those ideas that several people seem to have come up with at once - but rather the frame interpolation work Manex did, as explicated in the article above. That was truly flawless stuff, as the individual character elements (live action plates) of Keanu, et. al had frames rendered by a puter to complete the range of motion in an automated fashion.
But even more impressive is that the background plates for those shots were also developed from photographic stills - taken from several different angles on the set or location, and a computer then developed 3 dimensional geometry so that there was a model of said set and textured properly without having to do it by hand. The potential application of this for filmmaking is enormous, and a massive step towards the truly virtual set.
I'm really, really hoping Manex clinch the Oscar this year, for their work truly was groundbreaking as opposed to the Phantom Menace team who refined existing techniques to, admittedly, unbelievable highs. However, none of their work really goes out there in terms of future potential apps. It's a given, though, that ILM will be getting the lil statue this year. Tis a pity.
And for anyone who wants to read about FX advancements, the Bibles are Cinefex [cinfex.com], VFXpro [vfxpro.com], and ALWAYS, American Cinematographer [cinematographer.com]. Read em and weep.
Re:Am I the only one who hates Keanu Reeves? (Score:1)
Was used in Sting's video "Let your soul..." (Score:1)
The newly re-released CD "Mercury Falling" contains this video (Extended(?)-CD). Cool stuff
Seems strange that Peter Gabriel didn't do it before!
:o)
-- yippee, my first post! --
PC Only? (Score:1)
Re:Blair Witch (Score:1)
Re:You don't even need a camera... (Score:1)
Odd, since I used mpeg_play to verify that the stupid thing got encoded right. I have a very recent version taken from freshmeat, and also called the thing with -dither color and -quality on. *shrug*
The next poster was right about mtv. though it's nagware and closed, I might have to shell out its fee to watch video clips...
Re:The patent is linked from their web site. (Score:1)
More GAP Ads and some Chemicals (Score:1)
Do it with A standard computer and video camera. (Score:1)
Re:Keeping with the trend (Score:1)
Matrix DVD (Score:1)
Re:Not linux farms, FreeBSD (Score:1)
No, Linux isn't suited to every application. However, as a somewhat non-mainstream OS, it does need pushing for what it CAN do. I would be interested in hearing your reasoning, though. Please enlighten us as to what you think is wrong with it. The ability to correct weaknesses is one of the strongest points of Open-source OSes.
Also, while I don't mean to criticize, you will probably find that more people take your opinions seriously if you make an effort to make your sentences gramatically correct and properly capitalized. After all, on the Internet, the only things people can judge you on are your opinions and your typing.
Re:Cheaper things with time and cameras... (Score:1)
The actors would speak in reverse order syllables and the audio would be reversed in the editing room. The result was a very weird, dreamlike sound.
You can probably find a video of Firewalk With Me at your local video store, if you're interested in this.
Re:Unix Involvement (Score:1)
Re:Cheaper things with time and cameras... (Score:1)
Anyway, I don't know of any examples on line at present, but I'll try and get in touch with Zoe who did the original thing and get a scan and mail it to you. All very trippy and most amusing.
Re:Cheaper things with time and cameras... (Score:1)
I wonder if John Wood is available to record my answering machine message?
Re:Sell Linux as a movie studio and die (Score:1)
But where do you come by it?
And where has your website gone?
Cheers,
-- jra
-----
Keeping up with FX (Score:1)
I'm just a movie/FX geek and not actually in the industry, but I'm particularly fond of Cinefex magazine [cinefex.com] (20th anniversary issue on sale now!) and the VFX Pro [vfxpro.com] news site. And, yes, Cinefex is expensive for a magazine, but sooo worth it.
-j
Re:Am I the only one who hates Keanu Reeves? (Score:1)
now... who else could we fit in that room??
Re:Yes he's a bad actor but it does help (Score:1)
Re:Cameras are only a tiny part of the story (Score:1)
This might be a QuickTime artifact, or it might be real. Either way, this sort of thing is probably the simplest of all the problems they had to compensate for.
Be sure to play with the settings (Score:1)
We used custom colour correction software... (Score:1)
Re: Sig11, the karma whore/no-lifer (Score:1)
Typo (Score:1)
A little correction: You left out an 'e' in the Cinefex link, it must (obviously) be http://www.cinefex.com.