Technology for Capturing 360 Degree Video 151
Inzite writes "EnterNetica R&D is working on a new spherical video technology for capturing and presenting full 360 degree scenes using a 180 degree lens, by adaptively predicting the camera's surroundings. Video extrapolation techniques have been proposed in the past, but this is the first time I've heard of an entire hemisphere of the video image being "guessed". The article also talks about feature film presentation using fully-immersive video in the future."
Woa! (Score:1, Funny)
Re:Woa! (Score:5, Funny)
No frickin way!
Assuming that the slashdotted article also describes a 360 degree viewing screen, you'd be looking at the porn in front of you, getting all aroused, and then you'd look behind you and see the filming crew with the dodgy looking pron director and his clapper.
This would totally ruin the experience, IMO.
Re:Woa! (Score:3, Funny)
Why not two cameras? (Score:4, Insightful)
Re:Why not two cameras? (Score:4, Informative)
(Emphasis mine.)
Re:Why not two cameras? (Score:5, Funny)
Re:Why not two cameras? (Score:4, Funny)
Re:Why not two cameras? (Score:2)
If you're repentent the first time you'll probably get a warning. After that, well, you'll hear something like, "Welcome to Smotesville, population you!"
Re:Why not two cameras? (Score:4, Informative)
Re:Why not two cameras? (Score:4, Informative)
The recorded image can then be viewed (my guess is by a kind of VR goggles) allowing the viewer full viewing freedom.
Next time you say somebody is full of shit, make sure you're not mistaken yourself.
Re:Why not two cameras? (Score:4, Insightful)
The only requirement for "360 degrees" is that it see from a certain point in all directions on a single plane. Adding up and down means means adding another dimention to the process. Something that can cature a full spherical view would have to be called 360x180 degrees, where you capture 180 degrees of vertical for every one of the 360 degrees of horizontal.
Or something.
Steradian (Score:2)
BTW, I'd like to see the opposite of this concept. Imagine sevral fixed cameras pointing at an interesting scene, say a boxing game. You build a real-time 3D model of the scene and then create a virtual image filmed from any vantage point. It would allow you to have views filmed from the inside of sporting events. Imagine seeing from the eyes of the guy being hammered by Tyson... Then again it might not be such a g
Re:Why not two cameras? (Score:3, Insightful)
Let's see, TFA mentions that they did not in fact record a full 360 image, instead they record a 180 degree fisheye image and then "fill in the rest" based on smart guessing (no details provided). They happily adimit that the algorithm isn't perfect and that some environments work better then others. Without providing samples for us to see they allready admit that they had to go out of their way to come up with some samples that looked decent. I like the skydiving example they talk about, the algori
Re:Why not two cameras? (Score:2)
Same goes for anything else behind you. The stuff dosn't go away just because they don't have a shot of it. They just take what was there, then adjust the perspectiv
Re:Why not two cameras? (Score:2)
Re:Why not two cameras? (Score:3, Informative)
I've seen sperical quicktime files, a LONG time ago. They were neat.
Re:Why not two cameras? (Score:1)
Re:Why not two cameras? (Score:2)
Re:Why not two cameras? (Score:1)
Re:Why not two cameras? (Score:1)
Re:Why not two cameras? (Score:2)
Re:Why not two cameras? (Score:2)
Re:Why not two cameras? (Score:3, Funny)
Re:Why not two cameras? (Score:1)
The "nifty" part of the software is that it works with typical video equipment and interpolates the surroundings from older video frames and some guesswork at the edges of the field of view.
All they say about it is that "it's against the laws of physics to take a 360 degree photo. That just seems odd.
It is not, they'
Re:Why not two cameras? (Score:1)
All they say about it is that "it's against the laws of physics to take a 360 degree photo. That just seems odd.
You're right, they should have said 4 pi steradians instead of 360 degrees. They didn't explain their point very well. I assume they meant that the body of the camera, or the support, or the photographer/cameraman always block some part of the total sphere of vision.
Re:Why not two cameras? (Score:2)
I already thought about that. If you place the rig *on* the cameraman, you'll get 180 degrees with only a minor latitudal split. They can then apply their software two the results of the two cameras to seamlessly stitch the images together (correcting the perspective to allow for the 1-1.5 feet the cameraman takes up) making it seem as if the cameraman never exi
Re:Why not two cameras? (Score:3, Informative)
The other awesome thing about this software is that you can apply it to prexisting footage. It separates the background, and stitches
Re:Why not two cameras? (Score:2, Interesting)
Correct me if I'm wrong here, but to project this, you have to make room for the viewer. Seems like the difference in perspective would be desireable. I'd think that you'd really want the camera's to be physically placed around the camera in as close to a spherical configuration as possible. This should leave room for the
Circle Vision (Score:1)
Great, now all we need is... (Score:5, Funny)
Re:Great, now all we need is... (Score:2, Funny)
Re:Great, now all we need is... (Score:1)
Re:Great, now all we need is... (Score:3)
Re:Great, now all we need is... (Score:2)
Re:Great, now all we need is... (Score:2)
As well as al angles of Natalie Portman, thus providing a true metaphor for the Light and Dark sides of the Force. It's Genius!
Re:Great, now all we need is... (Score:1)
And 360 Degree pupils!!!
But at least we can begin to construct that Total Perspective Vortex [wikipedia.org] machine
Re:Great, now all we need is... (Score:5, Funny)
Well duh! You need to get into the plumbing business...
Hidden messages (Score:2, Funny)
FIRST POST
but nobody would notice.
Boo (Score:2, Insightful)
Re:Boo (Score:3, Insightful)
To put this in perspective, if you're panning through an aquarium, you'll see the fish swimming on as if nothing was wrong. However, while the camera isn't looking, a fish may get scared and dart off. Since
first application... (Score:3, Funny)
Google Cache Link (Score:2, Informative)
http://66.102.7.104/search?q=cache:zYFN61BG0lEJ:w
Link / Movies? (Score:5, Informative)
I can't wait to see what movie theatres do with this technology. Maybe not our typical theatres, but yenno... like the one's at theme parks or something. I'm sure can make a pretty cool short movie with this.
Re:Link / Movies? (Score:2)
Yeah, I thought they were cool over 20 years ago when I first saw them at EPCOT at Disney World. Some info about the technology can be found here [wikipedia.org].
Re:Link / Movies? (Score:2)
In the ever-increasing effort to screw the customer for more money, it was taken out and replaced by an arcade, which of course was NOT included in the price... you'd pay $30 admission for the privilege of pumping quarters into a crappy arcade.
Why guess? (Score:4, Insightful)
No. (Score:2)
Google search results (Score:3, Informative)
Google links on EnterNetica
(a) OPTICS ADVANCES BRING VOLUMETRIC VIDEO TO LIFE [prleap.com]
(b) Pressbox link [pressbox.co.uk]
(c) Cleaner, Crisper Volumetric Images [pressbox.co.uk]
Company webpage [enternetica.com]
coral cache link (Score:1, Redundant)
Cinemoments (Score:5, Interesting)
In Jack McDevitt's Hutch series of books, the passengers on intersolar flights passed thetime by "starring" in movies digitally redone with the passengers as the characters.
I was thinking about how hilarious this would be in real life, and how it could reinvigorate certain movies in theaters with minimal seating if they had decent hardware to sample random audience members (one person per group). I realized a fisheye lens can capture deptch with the right software.
Imagine how "cool" it would be to revisit Indy Jones or Star Wars or Usual Suspects where someone in your group was one of the actors? Even a bit part would lead to great inside jokes, and meeting up with new groups would be easy, too.
I'd spend $20/ticket for the social experience.
Re:Cinemoments (Score:2)
Re:Cinemoments (Score:2)
RHPS was fun, though.
Re:Cinemoments (Score:2)
Personally, I find McDevitt to be kind of boring after awhile. His books tend to roam around a lot, dryly describing tons of events. It's amusing in small doses, but can get trying. FWIW, I think his best work was Infinity Beach [amazon.com]. It's unrelated to the Hutch series (where alien contact is still something of a mystery), and still contains his drawn out writing style. How
Re:Cinemoments (Score:2)
I agree about Mcdevitt, although I've re-read the series once or twice. Infinity Beach is by far my favorite mystery of his.
His release timing of his Hutch books is perfect, though. Just long enough to reinvigorate interest and introduce more readers. Plus for an OLD author, he's very well connected to fans online.
Re:Cinemoments (Score:3, Funny)
Re:Cinemoments (Score:2)
Re:Cinemoments (Score:2)
Considering the horrendously poor quality of digitization done on the Indiana Jones series (as evidenced by the DVD boxed set), I doubt that's ever going to happen.
Re:Cinemoments (Score:2)
Re:Cinemoments (Score:2)
check out this ghetto 360 camera "hack" (Score:5, Interesting)
pretty cool, simplistic yet inventive hack.
e.
Re:check out this ghetto 360 camera "hack" (Score:2)
Re:check out this ghetto 360 camera "hack" (Score:2)
I believe the company was based in Halifax, Nova Scotia; not sure if they're around any more; if anyone as a reference, I'd be curious in knowing if they've managed to commerialize it.
Re:check out this ghetto 360 camera "hack" (Score:2)
I have this technology already (Score:2, Funny)
I suppose there is the drawback of dizziness and eventually falling down.
Re:I have this technology already (Score:3, Insightful)
So what you are saying, while modded funny, is not too outlandish. You could have a camera spinning around on a motor, and if the frame rate of the video was faster than the motion blur, and it could spin around fast enough to c
VirtuSphere (Score:2, Interesting)
Not sure how you'd do it.. (Score:5, Insightful)
I mean, part of the idea of a "film" is controlling the perspectives and what you present to your viewer. Somehow I have a hard time imagining this going past the art-house type movie, because the amount of work that the director has to do increases dramatically. Since you can't be sure what direction your audience is looking it, it would make it difficult to have a feature film in the sense that we're used to it...for example:
Jim: Wow, that guy just robbed a bank!
Sue: What guy? I was looking at those flowers over there.
[Camera whirls around, both get dizzy and throw up since they can't tell where to focus]
I'm being silly, but it just seems pretty difficult. That said, it's a cool technology, and if someone could tell me how they plan to deal with that whole focus issue in the context of a feature film, I'd be interested to hear it.
Re:Not sure how you'd do it.. (Score:2, Interesting)
Re:Not sure how you'd do it.. (Score:1)
Deep breaths, Sparky. Somebody will figure out how to do it.
Re:Not sure how you'd do it.. (Score:3, Interesting)
This isn't new... (Score:4, Informative)
Panoramic Stitching? (Score:2, Informative)
http://www.pixtra.com/ [pixtra.com]
http://www.ptgui.com/ [ptgui.com]
http://hugin.sourceforge.net/ [sourceforge.net]
http://www.360dof.com/ [360dof.com]
http://www.arcsoft.com/products/panoramastitching/ [arcsoft.com]
You can buy two existing similar systems (Score:4, Informative)
1) Point Gray's Ladybug2 [ptgrey.com] has five cameras mounted in a box about the size of, say, a stack of three decks of cards.
2) Immersive Media's [immersivemedia.com] system has 11 (!) cameras in a sphere about 2 inches on a side.
Both systems do real-time stitching of the multiple images into a panorama.
We're looking into them for the obvious motion-picture visual effects applications. The resolution (both spatial and dynamic) is not ideal for motion-picture work, but the ability to have an extremely small, lightweight, panoramic capture is a tradeoff that is worthy of pursuit. In the past (say, on The Fast and The Furious) we used six ARRI 435 cameras mounted to the side of a motorcycle, to the tune of several thousand dollars a day rental, hundreds of pounds of weight, and fairly compromised images in other ways (bad lens flare, extremely bouncy images.)
Thad Beier
Hammerhead Productions
Re:You can buy two existing similar systems (Score:2)
Lack of range, though... (Score:2)
That's a fair bit in lack of range / fidelity (depending on what exposure you're looking at).
On the up side, both are entirely computer controllable, so it would be feasible to quickly switch exposure levels. This does mean a reduction of temporal frequency depending on the number of exposures you'd be l
Crop it in post-production (Score:3, Insightful)
I've not seen the DVDs in question, but it seems to me that producing adequate footage of a football game from a single vantage point, zooming and panning on the live action, must be quite a challenge.
It occurred to me that with a very high enough resolution CCD, and a very wide angle lens, one could capture the whole game using static cameras, and pan and zoom in post-production. With a few of these (which could run unattended) you could get very good coverage of a live event, deferring all decisions about zoom levels, pans etc. until afterwards.
What's that you say? Off topic? Er, OK. While a 360 degree capture might not be appropriate for a sporting event (unless you were also interested in capturing the crowd -- since the camera couldn't be in the middle of the pitch), you could use the same technique in other circumstances to capture an event then edit it down afterwards.
Re:Crop it in post-production (Score:2)
What about a spherical lens with camera below? (Score:3, Interesting)
Why can you do the same thing with video? Is it because processing a "fisheye" image is just too processing intensive for 30 frame a second HD video? Is the technique patented and so off limits for other companies? Is it that a video image is too low-res to do translations from a distorted fisheye without blurring? Why do it the elaborate way described in the article when the fisheye technique seems a whole lot simpler?
I saw the prototype in person, so unless the company was commiting outright fraud, I am pretty sure the fisheye thing works.
hurrah Its 1998 again (Score:1, Interesting)
this has been done a long time ago by BeHere [behere.com], who have done 360 video for years, works with quicktime and realvideo
they even had a couple of short Films on iFilm where you where part of the action (a plane crash video and you as a patient in an old peoples home) and could move the camera around to see people talking to you (sound was stereo too) pretty mind blowing in 98
but whats old is the new new right ?
How would Red Green solve this? (Score:4, Funny)
Re:How would Red Green solve this? (Score:2)
this is old news people (Score:1)
Build a lens-sphere (Score:1)
Build a sphere made of small digital cameras/lenses, integrate the picture and then create a 360 perspective.
I am not sure what they meant by technical obstacles unless they were trying to build a spherical lens?
Now we will NEVER be able to walk behind the camera and flip it off unnoticed!
Look up instead... (Score:3, Interesting)
If you point the lens directly UP (or down even), then it will cover 360 degrees around you. You could extract a 360 panorama from that fish-eye image and remove the distortion fairly easily (although it would be processing intensive).
MadCow
Re:Look up instead... (Score:1)
Real Micoy (Score:1)
Columbia University has a patent on this (Score:3, Informative)
4 \pi Steradians (Score:5, Insightful)
For it to be truly immersive, shouldn't they be bragging about 4 \pi steradians instead of 360 degrees? One's a measure of a spherical surface area and the other only describes a circle!
Also, why doesn't π or π give me \pi? It seems to work in general HTML... Interestingly enough, & still works (and a handful of others).
Re:4 \pi Steradians (Score:2)
Yeah, that always bugs me when people talk of immersive panoramas and light probes. Even worse is calling them a 360x360 degree view. Now, if we're talking long/lat, then wouldn't 360x180 be more accurate?
Oh, and Slashdot filters out HTML entities for some reason. Probably to stop trolls from using them to hide goatse.cx links and the like from the other anti-troll filters in slashcode. It kinda sucks sometimes. I have seen people do accents and umlauts and things on letters, so it seems that something
Re:4 \pi Steradians (Score:2)
The same thing struck me when I read that. Our language is being coruppted by people who don't understand what they are talking about. 360 degrees is a 2 dimensional measurement and yet the topic of discussion is in regards to a 3D environment. Perhaps I am too old or have worked to long in government strict technical areas, but there is a dire need for people to use better language when describing
My Approach (Score:1)
... didn't Disney ... (Score:2)
I seem to recall going to a big theater at Disneyworld (pre-epcot) that had screens all around the room, except at the very back.
There were no seats in there, so that you could turn around and look at any screen you wanted.
The movie wasn't very long, but it was pretty neat.
I'm pretty sure I didn't hallucinate this, so if anyone can help complete my recollection, that'd be great.
Re:... didn't Disney ... (Score:2)
That wasn't it.
There was no mork, then. Not at Disney, anyhow.
The next step... (Score:2)
What's the big deal??` (Score:3, Informative)
Re:What's the big deal??` (Score:2)
1) Take something trivial as panorama stiching and call it somethign cool like "volumetric video".
2) ???
3) Profit.
Oh my god. I just made a "???, Profit" joke. I feel dirty!
Let me predict... (Score:3, Interesting)
That will suck. First off, I can't really take in more than what's in front of me anyways. Am I going to have to twist around to see the characters and/or action? I remember a 360 movie in Disney world and it was more annoying than neat. Then there's the fact that part of the art of cinema is putting things in a frame -- if there is no longer a choice of what goes in and what doesn't, it's less and less of an art. Then there is the fact that by increasing the cost of filming, set design, distribution and projection, that these films will be even worse than what we are accustomed to.
I think there's a great untapped use for immersive technology, but feature films are not it.
Cheers.
Great for Security Cameras! (Score:2)
"Yes, well, that is my client on the security camera breaking in, but that camera system uses volumetric estimation, so that image could be an extrapolation and thus is inadmissable"
Pfft.. (Score:2)
That's nothing new.. women have had this technology for centuries. My girlfriend is so good at it, she doesn't even feel the need to look in the rear view
Re:Already Slashdotted. (Score:1, Funny)