Clearvid is pretty darn sweet!
 

I have been putting a lot of thought into the SONY clearvid method and this thing seems pretty darn good and I can see why it works so well.

My first impression of Clearvid is that it looks a lot like the green pattern on a bayer filter.

With a bayer filter the green is in a pattern of: R=red, G=green, B=blue:

R G R
G B G
R G R

On clearvid the real angled pixels are kind of in that same pattern: I=interpolated, R=real:

I R I
R I R
I R I

So based on this I think we can expect video from the V1 to have a green resolution equal if not better than what a single 1920x1080 bayer CCD could do.

Whats great about the V1 is that the red and blue channels also have just as much deatil where on the bayer pattern the red and blue have less pixels and is harder to interpolate. This means much more accurate color than a bayer pattern single chip CCD camera.

"green resolution equal if not better than what a single 1920x1080 bayer"

The sensor has the same number of green pixels as a 1920x1080 bayer sensor and they are centered in the same positions as a bayer sensor, so I would agree with equal, but I cannot follow how you might expect either to be better than the other.

Overall resolution may be poorer than a 1920x1080 bayer, unless there is pixel shifting and post processing to take advantage of this.

Not that this is really an issue as the clearvid cameras currently sold only output 1440x1080 and noone is making a true 1920x1080 bayer camcorder within any similar price range.

I do not know but maybe overlapping pixels from Clearvid can get a better interpolation then just math done on a bayer pattern. I do not know what method is used to figure out the in between pixels.

How do you figure a clearvid will be lower than a 1920x1080 bayer pattern? Based on the pattern of pixels a bayer pattern on a 1920x1080 array actually has 960x540 green pixels. I would think clearvid at 960x1080 would be at least equal to that if not slight sharper.

The only thing I am a little confused on right now is how the chips deal with the 2:1 aspect ratio. 960x1080 is not 16x9 but 8x9. The horizontal has to be doubled but not the vertical. For the way clearvid has been shown to us by SONY I would think the square shape of the pixels in the diagram would work best if the clearvid chips were 960x540. It was pointed out in another thread that perhaps the pixels on the cmos chips are either anamorphic or spaced apart horizontally.

With the way SONY has showed clearvid I would think the chips would give off more of a 1920x2160 pixel array. That sure would mean a lot of detail for the vertical resolution when it gets down sampled to 1920x1080. Down sampling 1920x2160 down to 1920x1080 would also fix the aspect ratio and make it 16x9.

The information contributed by one pixel is a single value with an effective location of the middle of the pixel. Size reduces the effect of aliasing and affects light sensitivity but contrubutes no more actual information.

For a 2Mpixel bayer sensor you have physically 2 Mpixels of potential resolution, though lume and chroma are intermingled. If you make assumptions about chroma you can boost the luma resolution. The performance of a 2Mpixel sensor is generally somewhere between 1 and 2Mpixels real resolution.

The performance of a 1Mpixel 4:4:4 array will only ever be 1Mpixel real resolution.

Clearly this does not tell you which looks better, but there is much less of a technical difference than would be normal between a bayer and 3 chip camera.

If Sony pixel shifts, then the merits change. So far there has been no mention of it, and this is strange for a camera that only needs 4:2:0.

Edit to reply to above post.

"The only thing I am a little confused on right now is how the chips deal with the 2:1 aspect ratio. 960x1080 is not 16x9 but 8x9."

The 960x1080 number is a product of how Sony count pixels, it does not say anything about the nature of the array. Boyd has posted pictures of this. The pixels are square, the array is 16:9.

I recall reading somewhere recently (a quick search has failed to nail it down) that Sony said that there is no pixel-shifting going on with the V1 sensor.

Just telling it as i remember it.

Sigh...Sony does not pixel shift. Consider this a statement, not an opinion. The Sony V1 web page very clearly spells this out, displays how it works, and explains it clean and plain.

DSE is correct. What you may have read was somebody badly using the term pixel shift when it isn't really pixel shift. Pixel shift is a very specific form of interpolation and the V1 does not do this at all. The V1 uses the most clever form of raising the pixel value out of any camera I have ever seen. I really do give SONY props for this one.

I would still like to know how a square relationship of pixels can get to a 16x9 ratio of pixels but so far I like what I see.

Thomas. This is a very simple explanation BUT. The CMOS imager is characterised by individual address for each pixel. This is different from a CCD that passes the charge from each pixel down to a shift register for reading. In the SONy Clearvid 45 deg arrangement the horizontal total pixel count is comprised of whole pixels and the addition of the half pixels between the whole ones from the line above and the line below( if you understand what I am saying). When you do this the pixel count is doubled from the whole pixel arrangement, 960 becomes 1920, yielding the 16x9 arrangement. I expect the output from the whole pixels is used and the pixels from above and below are added then divided by two. All this is possible because the pixels are addressed individually and the DSP has the opportunity to process this information. Since this uses bigger pixels for lower light performance and better horizontal resolution too. For square pixels, of the same size, in the traditional arrangement with 1920 by 1080 would require a much bigger sensor, likely greater than 1/3 inch. Infering larger lens etc... greater cost. It would be interesting to know the size of the pixels in the Canon HV10?

Ron Evans

I'm still puzzled as to why sony didn't just go with a 1440x1080 sensor instead of the 960x1080 that they're using - having the real pixels there instead of making up the missing ones (I mean interpolating the missing ones) seems more logical. is it a cost or processing power issue? or, are they still trying to differentiate between their higher-end pro cams? one explanation could be the larger pixels yield better light gathering characteristics, but this goes to sensor size too...)

I think it's pretty obvious that all things being equal, the fx7/v1 will outperform the fx1 and z1 (low light tbd), but is it as good as it could've been?

But isn't the same true for the vertical as well as the horizontal? If you look at some of the pictures of the clearvid chips you can see that the in between pixels are in the horizontal as well as vertical position. This would then mean the chips are sampling 1920x2160 points. The diamond shaped pixels are shown as square and we know there are 960x1080 of them. Squares rotated 45 degrees in a 960x1080 grid is a close to 1:1 ratio. In order to get 16x9 you would either need to skip every other vertical line or down sample the 2160 in the DSP or use some other mehtod I do not know about.

Thomas. The number of horizontal lines in the array, based on the centers of the pixels, is 1080. Put a square inside each of the diamonds and draw horizontal lines accross at top and bottom. You have 1080 horizontal lines one square pixel high. Sony clearly states that the DSP uses information from the four surrounding photo diodes to create this inbetween pixel.IF you look at the following site you will see that ALL the pixels are reprocessed to a 1920x1080 square array.http://bssc.sel.sony.com/Broadcastan...V1U/index.html


Ron Evans

You mean vertical resolution not horizontal resolution. 1080 goes up and down.

That is the exact image I am looking at. Notice that new pixels are created in all four corners. That means not only the 960 gets doubled but so does the 1080. If you create new pixels in the four corners that is doubling the horizontal and vertical pixels not just the pixels in one direction. In the image you start with a 3x3 grid at a 45% angle. Vertical and horizontal both have 3 diamond shaped pixels running through the middle. After the clearvid interpolation notice that there are now 5 pixels running through the center not only in the horizontal but the vertical as well. The images on SONY's site clearly show the pixels as square and clearvid doubling the horizontal and vertical. If we take these images as true and we know that there are 960x1080 pixels that means the chips output 1920x2160 unique points. That is the only way I can see it done with the images we have so far.

The 1920x1080 4:2:2 could just be listed as what the DSP works in once the array is down sampled.

The way SONY has it shown in every image on clearvid the chips would have to be 960x540 to keep a 16x9 ratio when clearvid doubles the number of pixels. If the pixels are anamorhpic then why are the images SONY is giving us showing square pixels? If the space between the pixels in the horizontal direction is wider then why are we shown images of the pixels with the same distance in both directions?

I think sampling at 1920x2160 would be a great thing because down sampling back to 1920x1080 would help reduce aliasing. It would also have a lot more detail then if 960x540 chips would have been used.

I could be wrong but if I am then the images from SONY are not very accurate.

Yes I think this is highly likely to be a significant factor, if not THE significant factor. Pehaps along with a "limit of pixel-count that can be processed via EIP engine in time available".

And the 2nd principal factor in my opinion, is as you said, probably due to product-positioning issues with a future multi-CMOS model.

Just my opinion as ever.

It's an illustration. Not a scientific explanation. The graph may not be accurate to the finest point, does it need to be? You aren't seeing images of pixels, you're seeing images that have representations of pixels. I don't think anyone at Sony in their wildest dreams, would have imagined that their illustration would keep people up at night, deeply troubled, or seriously concerned about the finer points.
Relax. Worry about something more important in life, like choosing what to eat for breakfast.