View Full Version : First commercially available light field camera


Evan Donn
October 19th, 2011, 08:53 PM
The price/performance isn't great at this point, but it's definitely a glimpse of the future of photography:

https://www.lytro.com/camera

David Heath
October 20th, 2011, 03:10 AM
This was discussed on a thread a while ago. The fundamental problem is resolution - and it's notable that several people have posed exactly that question ("what's the output resolution?") on the Lytro blog, so far without an answer. The results may be fine for posting on a facebook page for people to play with, but useless for serious photography.

And the reasons behind it mean that it will be a very, very difficult problem to overcome, if at all possible, Not without a very, very large camera. (The problems are less to do with technology, more to do with underlying physics.)

Zach Love
October 20th, 2011, 01:16 PM
While I really want my own X-Wing with a hyper drive engine in it, I'd still be super excited if I ever got a chance to take a 2 hour trip into orbit above earth.

I'm excited by this camera, not that it is the end game of this technology, but that it is actually possible & something I can hold in my hand.

While the laws of physics can't be broken, it is possible to overcome them with a little human creativity & determination. Parabolic mics are great on the sidelines of a football game to pick up some of the on field sound, but not good for dialogue recording because of the physics. Parabolic microphone - Wikipedia, the free encyclopedia (http://en.wikipedia.org/wiki/Parabolic_microphone)

But if you leave it at that, no one would ever come up with a mic that can focus in one a single person talking in a loud sports arena. Squarehead Technology (http://www.squarehead.no/index.html)

Dave Blackhurst
October 20th, 2011, 02:12 PM
In reviewing their site yesterday, I saw a representation of "11 million rays" stated as the resolution. WHAT exactly that relates to is a bit tough to say, but if that means what I take it to mean, equivalent to roughly a 10-12 mega PIXEL camera, it's not too bad, and it'll come down to the processing software (Mac only to start... whoops, Windows coming... date unknown).

Don't know if one can really say that somewhat "idiot proof" shooting at this point is unreasonable - no need for camera skills other than "point" and press - focus and exposure are apparently handled "automagically", or in post. Reports are near instant on and shutter response - that's pretty impressive. Low light is supposedly very good, so much so they didn't bother with a flash...

The sample pix seem to be pretty good, and mostly oriented towards online display, but until more detailed reviews or hands on reports start to trickle out, hard to know what the little beast can do!

My first impression is the screen is terribly small in a 4" touchscreen world, not to mention "square" in a 16x9 world... and the design is "unique" - somehow looks to "fit" the "Mac user profile", but if it means better pictures for the "novice", can't be all bad?!

Certainly interesting tech, also "3D", so I guess now it's a "when does it do 60p/1080?" <G> question... there is apparenlty quite a lot of computing horsepower in that tiny box, so may be much magic to come! For a "first effort" that really has only been buzzing about for a short period of time (surfaced on the web earlier this year), they seem to be prepared to DELIVER on their promises in the timeframe they stated... not bad, some other companies could take notes...

David Heath
October 20th, 2011, 03:40 PM
In reviewing their site yesterday, I saw a representation of "11 million rays" stated as the resolution. WHAT exactly that relates to is a bit tough to say, but if that means what I take it to mean, equivalent to roughly a 10-12 mega PIXEL camera, it's not too bad, ......
I really do hate to be a party pooper.... but... sorry, most of what is being said about this technology is pure optimism.

One way of visualising the technology may be to think that you are capturing at the same time a series of photographs, all focussed at different points in space. In simplest terms, the post refocussing means taking one of the planes in preference to another. Practically, it's possible to be far cleverer than that - selectively combining a number of planes, and weighting areas to certain planes means you can't just refocus, you can later choose depth of field etc.

That's the good side. Problems come in that you may need a hundred of more planes to be recorded. And final resolution is tied to the resolution of each plane. Hence, for a pretty modest 4 megapixel final output even, you would be talking aabout needing to generate and store around 100x that - 400 million pixels and that is what approximates to "million rays" - output resolution times number of planes.

It may even be optimistic to think the plane resolution wll be 640x480 (307,200 pixels). If we assume the 11 million ray figure, that's likely to mean only about 36 planes, which is probably a bit coarse for refocussing. The company haven't given out any figures for output resolution that I'm aware of, in spite of repeated requests by many people on their online blog. That lends weight to the likelihood that it's poor - more like 0.25 megapixel than 10 megapixel.

Zach, yes, you're right - the laws of physics can't be broken, but technology can overcome them. But let me pick up on the Squarehead Tehnology example you quote - "With sophisticated signal processing algorithms and several hundred microphones the AudioScope can isolate sounds and make them crystal clear, even in a noisy environment."

Yes, several hundred microphones. To say nothing of the processing needed. Isn't that roughly comparable to what I said? "........a very, very difficult problem to overcome, if at all possible, Not without a very, very large camera" A very, very large camera equating to "several hundred" microphones?

Charles W. Hull
October 20th, 2011, 09:38 PM
I'm excited by this camera, not that it is the end game of this technology, but that it is actually possible & something I can hold in my hand.

This somehow reminds me of Edwin Land. The good. The more good. And the bad. For sure I'll get one, just to see what it will do.

Steve Nunez
October 21st, 2011, 05:22 PM
I appreciate the forward thinking........keeping the innovations coming is what the progress of digital imaging is about- thumbs up!

Peter Moretti
October 24th, 2011, 07:02 AM
About five years ago I knew nothing about video and motion film cameras.

Since then I've read a lot by people who know much more than me. I also had the chance to listen to ASC's wax eloquently on what is or isn't possible/desireable.

Looking back on this education, many of the POV's expressed were spot on. But I have to say that in regards to the big picture of emerging technology, the experts were more often than I would have expected well off the mark.

This is not a slam by any means. Anyone who's been generous enough to share their wisdom with me is greatly appreciated :) :)! But a few grains of salt ready to stick between the teeth and gum is not a bad thing to have ;).

Nevin Styre
October 24th, 2011, 01:31 PM
It says it produces HD quality pictures, so around 1-2MP I guess.

It would be cool if after effects would support this natively, I could see a lot of potential in using something like this for speciality things like title scenes or other info-graphics.

Jay West
October 24th, 2011, 05:34 PM
Interesting you should say that because Adobe seems to be working on a somewhat parallel technology for Premiere Pro which they call "Mesh" or "Meshes." Here is a link to the "sneak" that Adobe recently put up.

MAX 2011 Sneak Peeks - MAX 2011 Sneak Peek - Video Meshes | Adobe TV (http://tv.adobe.com/watch/max-2011-sneak-peeks/max-2011-sneak-peek-video-meshes-/)

To me, this seems more like an AE than a PPro thing.

Monty Wentzel
October 24th, 2011, 06:31 PM
Camera technology will never stop, duh...but of late we have a number of cameras that when mastered correctly can now be shown on the big screen, this is amazing.

Question is I want to buy one more new camera and I want it to be my last camera, for ten years or so. Assuming no leap in technology makes needing a new camera a must have, I really am hoping the next camera will be my last. The viewing public is not nearly as savvy as the camera people and editors are on this forum. What they are unforgiving about is the story.

It always has been and likely will continue to be all about the story. I don't need anymore camera quality, its already there!

I think the quality available in cameras in the $7000.00 range pretty much cover it, but one question I have not been able to answer is the difference between the $7k and $15k camera? The side-by-side camera shoot-outs don't show me $8k of a difference.

So if I had $15k to spend on a camera is there something gained by this price camera vs the $7k models?

Monty

David Heath
October 28th, 2011, 02:29 AM
It says it produces HD quality pictures, so around 1-2MP I guess.
Do you have a reference for that?

Looking at the website again I'm struck by the lack of information about resolution......

Jay West
October 28th, 2011, 12:50 PM
No kidding about the lack of detail.

About all they say for "picture ouitput" in the specs is "Produces HD-quality interactive, living pictures." For "light field resolution" they say: "11 Megarays: the number of light rays captured by the light field sensor." These statements are found under "Details" at https://www.lytro.comcamera.

Who knows what those statements are supposed to mean for a still camera?

Peter Moretti
October 28th, 2011, 01:22 PM
The ? isn't if this is the Timex Sinclair ZX81 of light field cameras, it's how long till we see the HP Z800 version?

David Heath
October 29th, 2011, 06:17 AM
Who knows what those statements are supposed to mean for a still camera?
By "megarays", in this context I understand the number of pixels in the fundamental image, multiplied by the number of focus planes. Hence, for a "11 megaray" camera you COULD have two simultaneous 5.5 megapixel images, with, say, one with plane of focus at infinity, the other at (say) 1 metre.

To acheive what they promise, the number of planes is certain to be a lot more than 2. I'd also expect far more than 11 - and that number would give the minimum base resolution to be really called "HD-quality". (1280x720 is roughly 1 megapixel.)

I suspect the "HD-quality" owes more to marketing than science - but lets see if the company ever release any more detailed specifications.

As far as the Sinclair quotes go, then don't underestimate the physics behind scaling the technology up. The problems Sinclair faced were technological, here they are down to laws of physics.

Dave Blackhurst
October 29th, 2011, 11:42 AM
OK, but they've already compressed a huge "concept" camera array into a small, relatively affordable, handheld, consumer ready device with acceptable output... at least for web and PC (er... Mac) display/use. I'd say they're doing rather well with whatever "physics" and "science" are involved...

One always has to remember that bees "shouldn't" fly and men aren't supposed to, but bees don't know any better, and man refuses to accept such facts.

For what they have, it's still pretty impressive, IMO, and a sign of interesting possibilities to come. Play with their samples and tell me they are not usable or effective in "scene capture"...

David Heath
October 29th, 2011, 03:01 PM
OK, but they've already compressed a huge "concept" camera array into a small, relatively affordable, handheld, consumer ready device with acceptable output... at least for web and PC (er... Mac) display/use. I'd say they're doing rather well with whatever "physics" and "science" are involved... ..
Oh yes, I take my hat off to them for what it is. And yes, great novelty to play with refocussing already shot images. But as you say - with "acceptable output... at least for web".

The applications are actually more than that, and it's easily forgotten that cameras in general are heavily used for industrial/scientific applications - not just "art" photography and filmmaking. Take a look, for example, of another plenoptic camera and it's application - Facial recognition - Raytrix GmbH (http://www.raytrix.de/index.php/Facial_recognition.html) . The idea is that for face recognition it's good to trade off two-dimensional resolution for depth. Same with many industrial uses. Don't think I'm dismissing the technology out of hand - far from it.

But where I disagree with previous comments in this thread is to then take a leap and see it as the future of general photography. Here, the resolution of these cameras falls way short, and even allowing for that, there would be huge problems capturing "11 megaray" images at video frame rates with current technology.

Yes, technology moves on, but you really have to have a decent grasp of how the system basically works to see just how big the problems are, and why they are unlikely to become mainstream any time soon - if ever. The Stanford team used a 16 megapixel camera, with a 90,000-microlens array in front of the sensor (each microlens covering about 175 pixels), to give a final resolution of 90 kilopixels. (About 320x240) To improve that substantially, you have to either:

Have far greater than 16 megapixel as base
Use a smaller no of pixels under the microlens - with consequent lessening of control

Certain other tricks are possible - but they have their own costs. And don't forget the data storage etc - in the original example you have to store data equivalent to a 16 megapixel image to get the 320x240 image. Imagine the file size corresponding to even such as a 6 megapixel final image!

Dave Blackhurst
October 29th, 2011, 05:36 PM
A: Moore's law
B: My USB jump drive and all my memory cards have significantly more capacity than my first Hard Drive (30 whopping Megabytes!), and I have a couple TERAbytes of "local" storage.

Not sure I see the problem... although I'll admit with every new technology "toy", my computer always seems to need upgrading to deal with MORE 1's and 0's, faster... but all the technology just opens up cool new possibilities!

David Heath
October 30th, 2011, 05:20 AM
A: Moore's law

Not sure I see the problem...
That's what is meant by the differences between a technology limitation and a "laws of physics" limitation. Computer memory has been definately in the first category, but, as example, look at cars as an example of the latter. Their physical size is limited by the dimensions of the human body, and that leads to engineering constraints, let alone practicalties - they may (with increasing difficulty) be engineered to go faster, but the constraints come down to safety, ability to corner etc. Nobody expects them to get twice as fast year on year, nor give twice the mpg figure year on year. Not even close.

And one simple of law of physics which CANNOT be changed is the wavelength of light. That fixes an upper limit on pixel density, amongst other things. Just think of the maths. To go from about 320x240 to 1920x1080 is very roughly a 100,000 fold increase - and that's "only" to video HD resolution, not what is generally expected of a still camera. So, keeping other factors the same, that would mean a base chip resolution of about 1,600,000 megapixels!!!!

I'll let you do the maths (assuming the same chip size) as to what the inter-pixel spacing then becomes, and how it relates to the wavelength of light......... :-)

See the problem now........?