The Matrix Meets The NFL 155
wirehead_rick writes "Imagine 'The Matrix' style special effects for the replay of sports action. Being able to see a 360-degree stop action view of that receiver's foot on the line in the end zone." USA Today covers some whiz-bang video technology being debuted in the Super Bowl.
A league of their own (Score:1)
Before anyone posts anything funny... (Score:3)
Before anyone posts anything attempting to be funny by having football players quoting dialogue from the Matrix, remember that every possible parody of the Matrix has already been done, and is no longer funny.
Thank you
Whoa (Score:3)
I can see it now, the cameras pan in, millions of pixels are processed, and the result shows the crowd reality, or does it?
As the crowd sees the instant replay of the player scoring the touchdown you can hear whispers in the crowd saying he is the chosen one.
Re:Before anyone posts anything funny... (Score:1)
ARGH! All style and no content? (Score:1)
So now our sports will look great, but probably suck. I wrote all about how much The Matrix annoyed me at geek-ware.co.uk [geek-ware.co.uk]
I wonder if the football players will be wearing expensive sunglasses.
==============================
Interactive Football (Score:1)
bleh, all style, and no content now? (Score:1)
I fscked up the url with fancy target attributes, sorry.
So now our sports will look great, but probably suck. I wrote all about how much The Matrix annoyed me at geek-ware.co.uk [geek-ware.co.uk]
I wonder if the football players will be wearing expensive sunglasses.
==============================
Re:Before anyone posts anything funny... (Score:2)
Actually your post was funny. I was thinking of trying to write something along the same line, but knew people would make fun of me, so I just decided to be a spoilsport :)
Mmmmm Tennis (Score:1)
Taking it one more step... (Score:2)
information wants to be expensive...nothing is so valuable as the right information at the right time.
Internet as producer of equipment? (Score:1)
Keeping a secret
EyeVision was developed under utmost secrecy after CBS Sports President Sean McManus gave the go-ahead for $2.5 million in research. In the end
CBS Sports got input from rocket scientists at Carnegie Mellon Robotics Institute and equipment and cameras from Japan and the Internet.
That just blew my mind! Where is this place on the Internet that produces equipment and cameras? How do I convert it from bits to physical hardware?
This has got to be.. (Score:2)
Later,
360 degree video coverage, eh? (Score:1)
Silly Rabbits, they Don't Need This! (Score:4)
you know, where they take the single POV security camera from the lingerie shop and make a 3D model out of it
oh wait, it was also impossible (did it irk anyone else when they saw it?)
rLowe
Soccer World Cup (Score:4)
Virtual Advertising... (Score:1)
Oh, wait, I hope I didn't just give them an idea. Oh boy.
--Bernie
White rabbits? (Score:1)
Moz.
Security System (Score:2)
been around for months (Score:1)
Re:360 degree video coverage, eh? (Score:1)
in many sports already (cricket for example) a third umpire has been in place to make that final decision if the two on the field cannot make up their mind or there is some point of uncertaincy in the decision.
now, this advancement is cool.. could be a bit of a problem if there are other people in the way of the 33 camera's :)) they never demo'd this thing with a field FULL of players :P i guess the ladies will be very happy.. some close ups of some NFL butts in those rotational shots :)
i dont think there will be replacement umpires :) however, it may help clarify those "oh bullsh*t" type discussions we have on the couch when there is a penalty that we think is unlawfully cranted :)
Cool, but... (Score:4)
Okay, so for a smooth rotation, the object is at the center of the cameras, all having the same lense settings.
If not at the center, then you have to compensate for the error with matched zooms so that you don't have, as the viewer, the weird impression of a comet like elliptical motion (not even as they only cover 270 degrees).
Even if you compensate for the distance with a zoom, what about the fields of view? how do you morph your different frozen camera views into one smooth video sequence, when all your field of views are different?
My (wild) guess is that you'll see quite a lot of these instant replays at the center of the field...
Ubercool nontheless... I wonder how much processing power you need to render your animation... and how automated the whole thing really is. 33 cameras, say 3 second animation @ 60 frames/s, 800x600 that's 247Mb uncompressed @ 24bit/pixel and 32 different morphs to compute with say 5 images each... I wonder how many anchor points you use in such a morph. Anyway, sounds highly //isable to me, so 32 processors on a nifty board or a beowulf?
---
Re:Silly Rabbits, they Don't Need This! (Score:1)
Don't forget that the director was Tony Scott, Ridley's brother...
C'mon, Enemy of the State wasn't a bad caper movie, as they go...
Re:Sky Sports (Score:1)
Having said that, they've stopped using it as much as they used to when they first introduced it. Andy Gray has a nice(ish) replay/analysis tool - a LARGE touchscreem "TV", showing the play, with some clever(ish) s/w allowing him to eg highlight an individual player, track him, draw arrows, etc.
Every time I see him use it though, I want to shout to the manufacturers (FASTER PROCESSOR, or maybe MORE MEMORY), as there's a horrible 1 or 2 second delay between him doing something and the results showing up.
Surely this is trivial... (Score:1)
Do any of you... (Score:1)
Future plans (Score:2)
Ok, that's creepy.
Re:Silly Rabbits, they Don't Need This! (Score:1)
Re:bleh, all style, and no content now? (Score:1)
URL?
-- Eat your greens or I'll hit you!
Re:360 degree video coverage, eh? (Score:1)
The Matrix, or The Gap? (Score:1)
With that in mind, I believe this technique should no longer be called "bullet time". Instead, it should be called "khaki time".
"Whizz pang video fechnology" has limifafions (Score:1)
Since Fuesday, everyfime I press f, I gef an f.
And everyfime I press p, i gef a p!!!
Fyping has pecome an apsolufe nighfmare.
Oh well,
I feel a pif peffer for geffing if off my chesf.
Fhanks for lisfening.
Interpolation? (Score:2)
Re:"Whizz pang video fechnology" has limifafions (Score:1)
My god! (Score:1)
Wow, I must've been under a rock. Why didn't someone post on slashdot when they declared the Internet it's own nation?
Re:Infringment. Libel. (Score:1)
Well, Dr. Yacoub, why don't you just go and do some more of your genetic tampering so that the polar caps will freeze more and the penguins will have a better habitat?
Hrmmm... (Score:1)
Black Vinyl Hotpants? *shudder* (Score:1)
one word... (Score:4)
Re:Cool, but... (Score:1)
I'm guessing that they're not going to be using computers to do this. They'll just have a video signal from all 33 cameras available, and instead of switching between them with buttons like in normal linear editing, they use a dial.
Two reasons (Score:1)
This won't be used in the game (Score:3)
Soccer Set, Kenny's Kourt... (Score:2)
Soccer Set from Orad brought this to European and other countries several years ago.
Kenny's Kourt, on TBS and TNT has been doing this since SPRING 1999 with basketball, right here on American television.
----------
Re:Taking it one more step... (Score:1)
I think this is a very cool use of a new technology and I'd love to see it provided just they way you suggest. I'm just too much of a realist(cynic?) to expect it.
Naeser's Law:
Re:360 degree video coverage, eh? (Score:1)
It would be cool, though, to see a diving Mark Waugh catch in bullet time, although the focal point in cricket moves around faster than in NFL so the robotics would need to be quicker.
And while we're getting completely tangential, I've sometimes though about the possibilities of having an spatial array of microphones recording, so that a DSP directional mike effect could be extracted later... might have solved the "can't bowl, can't throw" problem sooner.
Good to see cricket discussion on ./, my two biggest time wasters, together at last :)
--zaugg
Re:360 degree video coverage, eh? (Score:1)
The diving Mark Waugh catch would be cool, though. And it is nice to combine /. and cricket for once :)
Illusion == Reality? (Score:1)
Re:Cool, but... (Score:2)
The best lense setting on each camera may be obtained by minimising the differences between frames from close cameras.
For a real 360 loop, that'll probably give you a global error minimum too, with camera 1 getting minimised with camera N.
I'm not too sure about the morphing, but it seems feasable with RBFs or something similar when you already have close images.
The point is, they already have at least 50% of the installation, I wonder how much it would cost to have proper morphing instead of crappy frame switching...
Do you think I could ask for a million or 2 to implement it? You just gotta love these Ph.D. in blablabla thingies attached to your business card ;-)
---
Re:Cool, but... (Score:1)
This goes by the name of "image-based modeling and rendering," and one of the the pioneers [debevec.org] of the field developed the technique that was used for the notorious bullet-time shot. Another group demonstrated their realtime IBMR-from-video [mit.edu] process at Siggraph 2000.
Superbowl FX and the Ridiculopathy.com commercial (Score:1)
We had to sign on for the air-time last year at this time, and since everyone else was doing it, we didn't want to be left behind. I've had "rais a million dollars" on my Palm's To-Do list for most of a year- and you know how that goes.
Due to cash constraints, it will be only six seconds long.
It took us months to concept and complete the spot. The cost to produce it was nearly as expensive as the price of the air-time.
The Making of The Ridiculopathy.com Superbowl Spot [ridiculopathy.com]
download the spot (file will be taken down on Sunday) [ridiculopathy.com]
Re:Security System (Score:1)
-Jason
Re:Future plans (Score:1)
Re:Cool, but... (Score:1)
Pretty cool stuff! I always wanted to play with something along these lines, but never got round to actually try it (blame slashdot for it ;)
---
Begining of the end? (Score:1)
-Jason
Re:The Matrix, or The Gap? (Score:1)
Still cameras? Bzzt. (Score:2)
I find it interesting that the engineers who designed the system referred to the Matrix technology as using still cameras. The technical (as opposed to artistic) breakthrough of those effects in The Matrix was that they used actual movie cameras, so action could continue during the rotation. The Gap ads (and others) preceding the Matrix used still cameras for that effect; that wasn't new.
An error I could overlook, but the fact that the creators of CBS's version themselves didn't know this basic fact tends to suggest they didn't bother to do their homework...
-spc
http://www.parabon.com [parabon.com]Quote about this (Score:3)
Evidently Keanu Reeves heard about this and said, "Yet another shameless use of our ground-breaking technology. I'm sick of all these parodies."
Told that Trent "Lame Duck" Dilfer and Kerry "Lame Drunk" Collins would be the starting quarterbacks in Super Bowl XXXV, Reeves said, "Whooooa."
--
What else can they borrow from The Matrix? (Score:4)
Re:Mmmmm Tennis (Score:1)
Question - what is the difference between 'lights' and 'hard'?
Answer: You can go to bed with the lights on.
This is not quite the Matrix (Score:1)
I find it very interesting (Score:1)
Re:Future plans (Score:1)
Re:Soccer World Cup (Score:1)
Maybe, but who cares? That was for soccer, the most boring sport in the world.
--
Re:Cool, but... (Score:2)
It's gotta be invisible (Score:2)
Re:Cool, but... (Score:1)
Re:Silly Rabbits, they Don't Need This! (Score:2)
Okay, that part was improbable, but the part where you saw a satellite with a massive radio reflector dish point towards the earth and get VISUAL images was just too much for me. I mean, sure, technically light is just EM radiation, but I'm pretty sure that a mesh RF dish won't work for collecting a visual image.
Re:A league of their own (Score:1)
As for the erasing part, that is pretty cool, technically; they'd have to pretty much incorporate all the visual inputs into one 3d interpretation of the scene, and then recreate the scene from the desired viewpoint. I had no idea that 3d visual research was that far advanced. Or can anyone suggest a Q-n-D approach?
Johan
Re:The Matrix, or The Gap? (Score:1)
I am not sure if the people behind the Matrix used equipment from the "Virtual Camera" people, or if they just rolled their own. Probably the latter, since the virtual camera website [virtualcamera.com] makes no metion of "The Matrix".
Re:Cool, but... (Score:2)
Good...but try this one:
"A geek knows he's a geek and revels in it. A nerd is a geek who thinks he's normal."
Re:Silly Rabbits, they Don't Need This! (Score:2)
What, you wanted to see a giant Nikon floating out in space? :v)
Re:What else can they borrow from The Matrix? (Score:2)
This new camera thing sounds pretty cool, even though every single car company has been using this technique in their commercials for the past two years.
I'm sorry, are you seriously comparing camera technology developed for a live event with camera technology for commercials? Commercials are staged in advance, painstakingly prepared, and touched up again and again. What they use for filming commercials isn't even close to what they're doing here.
It's so far removed, even if you just consider the fact that this new technology is realtime. And yes, it is realtime. They have to track/zoom the cameras in realtime to be able to play back an instant replay, and the camera tracking and zoom is the really hard part of this, not the stitching together of video streams to make a 270 degree rotation.
-Todd
---
Re:A league of their own (Score:3)
Re:This won't be used in the game (Score:1)
I'd still rather have a Raiders-Vikings match-up that the Stupor Bowl that we'll probably have to endure...
Re:The NFL meets.... (Score:1)
http://www.xfl.com
Re:American Primitive Sheep Consumer Pricks!! (Score:1)
Fourth Quarter... (Score:2)
Re:This won't be used in the game (Score:2)
--
Re:It's gotta be invisible (Score:2)
--
What really sucks... (Score:5)
"Touchdowns. Lots of touchdowns."
What really sucks about this is that now I'm tempted to actually watch the game. And it's not like it's some cool half-time stunt - this could happen at any time during the game. There goes my afternoon.
Poorly engineered? (Score:2)
See, this right here makes me more than a little skeptical about how well this thing was engineered. If it was 2 years in the making anyway, it seems like the least they could do would be to hook it up a few days in advance and take some rotating retakes of, oh, the groundskeeper replacing sod or something.
Or at least take accurate measurements of the dimensions of the stadium and set up a demo in an airplane hangar someplace. While it would make for some of the coolest replays ever, I think their efforts towards secrecy and "adventure" are going to make for a barely-functional system that won't live up to its hype.
also, there was a line in there about how this would "prove conclusively" if certain passes were received and whatnot, but don't you really only need 1 really good angle for that?
Big fscking surprise. (Score:2)
It makes me sad to be an American when something like this develops. Joe Sixpack doesn't care about this technology when it could be used to cover newsworthy events. Hey, let's take another look at that assassination attempt to see WHO was actually firing. NO WAY, Let's make sure that the reciever made his two steps in bounds before he went out!
It is depressing when I watch someone's eyes glaze over when a football game is on. People spend entire holidays sitting on their fat asses feeding their faces and watching the same moronic game over and over again all day.
Why wasn't this developed for use by a news agency? Was it a question of funding? If so, why then does the sports dept. get that amount of funding?
American football is a children's game being played all to often by overgrown babies.
-/rant
LK
Re:Big fscking surprise. (Score:2)
Hey, let's take another look at that assassination attempt to see WHO was actually firing. NO WAY, Let's make sure that the reciever made his two steps in bounds before he went out!
The thing with sport is that you can tell with some certainty that something worth filming is going to happen within a certain range of space and time.
If you could do the same with asassinations, then, sure, you could point a few dozen cameras at it and generate bullet-time recreations. Or, you could intervene and prevent it from happening. Let me know when you have this technology.
Now there are probably newsworthy events that could possibly benefit from this stuff -- but I can't for the life of me think of anything that would give you long enough to set up the equipment *and* is action-oriented enough to warrant the effort.
--
Re:What really sucks... (Score:2)
--
other tech mentioned in article (Score:2)
The goal line plane will actually be kinda cool, sort like the 1st down line they have now, but a big wall. They'll probably soon add sound effects of crashing glass sounds when they break through...
And removing other players sounds neat, but I would think that everyone out there is effecting some part of the play. Although, it could be super-sweet for training videos.
Jason
Here is some more info (Score:2)
http://www.cs.cmu.edu/~virtualized-reality/ [cmu.edu]
Re:Cool, but... (Score:2)
I don't think so...
If the cameras weren't at the same distance, but had the same field of view, the viewer would have the POV of someone quickly running around the sidelines, focussed on a single spot. It might look a little wired, but having a constant field, and getting closer and further would be more like what the eye has to interpret in real life. It would probably be much easier to follow than zooming in and out as you run around the field.
All you'd need is a bunch of cameras with linked and equal amounts of zoom, pointing at the same spot.
Greg
Roll-your-own Matrix (Score:2)
If I understand this correctly... (Score:2)
Essentially, in the Matrix still cameras were used, all fired in sequence, aranged "around" the point of action. This "in action" panning strip was then enhanced/scrubbed with a computer to make it cleaner, and more presentable.
What is being done in the Superbowl is similar - but replace each still camera with a video camera, and feed the frames in a computer. Now, as the action is going on at the "action point", you have 33 streams, all from different angles, running and capturing frames. Now, think of these strips of frames - if you played all 33 in sync (so that frame 1 of strip A is played at the same time as frame 1 of strip B), and switched "along" the sequence of the 33 cameras, you could get full video along those points, at any angle. Or, you could show various angles (as seen from camera 27). Pan from 1 to 33, while moving the video forward, or reverse, and you have full motion panning, through time, along an arc.
Then, the CBS engineers go one step further - they have mounted all of these video cameras on robotic pan/tilt/zoom platforms - very precise platforms - all working in concert to all point at the same 3D coordinate in the stadium. I would imagine the software to be quite complex to manage all of that, to manage the calculations, the control, the capture, playback, review, etc. The system to store the video frame streams would have to be pretty huge as well, to do it all in real time, at TV quality, for over 30 streams. I mean, for one stream at 16 bit quality - 30 fps - say 640x480 video - for one second of video that would be 17 MB! Over 30 streams would be half a gig - every second! I would imagine a parallel video RAID-like system for this, to get a few seconds of video. Entirely doable, very custom, I would imagine.
I am sure these cameras can also be used in "teams" as well, or individually. I think (I could be wrong here) that the motion of the streams would cancel out the need to do real-time interpolation of the images as was done for the Matrix (which was done because the raw strip of images was very jumpy). I might be wrong about that, though (depending on how far apart the cameras are spaced would determine the jumpiness as well)...
All I can say, if what I am thinking is correct - is wow!
Worldcom [worldcom.com] - Generation Duh!
I dont care, unless... (Score:2)
I dont care, unless said reciever is Carrie-Anne Moss [carrieannemoss.co.uk]
--
Re:Silly Rabbits, they Don't Need This! (Score:2)
Kevin Fox
World Cup 98 (Score:2)
Fans of EA Sports titles have enjoyed this replay facility for over 4 years now.
Re:Big fscking surprise. - BIG FSCKING MORON (Score:2)
Get out of your dream world, moron and realize that there are somethings that are better to get excited about than whacking off at your computer while viewing newsgroup porn, because I know you don't get no chicks with an attitude like that.
So, you get excited by watching all of those big burly men in tight shiny pants huh? I do alright in the "chicks" department. I'm no Cassanova, but I get my fair share of action.
At least football promotes all of the basic fundamentals of humanity. Violence, intelligence, strategy, teamwork, and winner takes all.
Intelligence? Dream on! Just listen to the average football player give an interview. Because they were good at running while holding a ball, or at stopping people who run while holding a ball, they got an easy time in school. They never had to learn anything because the were good at playing a game. For grown men to do irreparable damage to their bodies for a GAME is not intelligent.
I bet you got your ass beat every day you went to school because you were a whiny bitchy little wimp that couldn't hack it.
I gave more ass kickings that I got. Sometimes to dimwitted jocks.
Are you one of those Al Bundy types, who sits on the sofa all day, with one hand down his pants and the other rubbing on his fat belly, while you watch the game, talking about how you "used to play a little high school ball."?
People like you make me embarrassed to be an American.
LK
Re:Big fscking surprise. (Score:2)
It wouldn't be terribly difficult to set up as preparation for a press conference.
While we're at is, why not boxing? Why not hockey? Why not soccer? Why not tennis? Why not gymnastics? Each of those sports could use this technology just as much as, if not more than the NFL. But the mindless drones who are ass locked to the couch on sunday will make it financially possible to pull off.
LK
Re: (Score:2)
Re:Big fscking surprise. - BIG FSCKING MORON (Score:2)
Martial arts is not a "sport" in the traditional sense of the term.
I never got beaten up by a football player. So you can hang your pseudo psychoanalysis up, you'll never make a living at it.
The strategy of the game? Offense. Move the ball that way. Defense. Keep them from moving the ball this way. It's simple. That's why so many simpletons are enthralled by it.
Then again, you are just a troll. That's why you're anonymous.
LK
Re:Big fscking surprise. (Score:2)
Yes, and the fact that it took a football game to roll it out is sad.
2) You shouldn't make a big deal out of how idiotic you think football is. as your links tell me, you happen to be obsessed by playing computer games over a LAN.
Enjoy? Yes. Obsessed with? No. On every sunday afternoon I don't have my hindquarters glued to a chair while I game. Many (not all, but many) football heads don't move except to get another beer, and to um, recycle their previous beer.
I didn't like bozo jocks in high school either, but I like football. sorry you think I'm a moron.
Whether or not you're one of the morons that I was ranting about depends on whether football is a passtime or an obsession.
LK
Re:Big fscking surprise. (Score:2)
If (and that's IF) you are one of those Al Bundy types whose eyes glaze over when that first football game starts on any given sunday and you don't move until the last one is over, yes.
News agencies are too busy trying to figure out how to cram more useless gerbage into their already fatuous programs of rapidly declining relevance.
Like the scrolling displays of football scores at the bottom on the screen?
It should be fairly obvious why sport organizations have large amount of money: many people watch sports, and the sports organizations sell their eyeballs for large sums of cash.
Because these Al Bundy's won't get their fat asses off of the sofa, or change the channel.
It makes no sense to me that a love for play and for learning should be supressed when a person gets old.
I have a couple of little cousins that would love to play candyland with you.
LK
Re:This won't be used in the game (Score:2)
Yeah, they said the same thing about the Vikings/Giants game a couple weeks ago, except they were talking about the wrong team.
Ouch!
Re:Big fscking surprise. (Score:2)
On sunday when you're inthralled in football, I'll be reading. To do any one thing to the exclusion of all others is idiocy. Why don't football zombies see this?
LK
Re:Cool, but... (Score:2)
When you have a 100 cameras, things probably get much better... it wouldn't be used otherwise ;-)
---