Technique for Pixel Shifting single chip sensors/cameras + recording primary images at

Go Back   DV Info Net > Special Interest Areas > Alternative Imaging Methods

Alternative Imaging Methods
DV Info Net is the birthplace of all 35mm adapters.

Thread Tools Search this Thread
Old July 29th, 2005, 01:53 AM   #1
Inner Circle
Join Date: May 2003
Location: Australia
Posts: 2,761
Technique for Pixel Shifting single chip sensors/cameras + recording primary colours

I have been giving it some further thought and I think it might actually be possible to pixel shift RAW (uncompressed native mask output) single chip bayer footage (or others). Normally pixel shifting bayer, for example, would be difficult, because each pixel has only one real primary, the others are calculated, so there is no overlapping colours to shift. But if the frame is made up from subsamples of a higher resolution frame then there canbe real colour data for all the primaries on each pixel to shift around (note: I am note saying this is as good as three chip pixel shift).

Resulting pixels are made up of:

RGRGRG   R.R..   .....               .....
GBGBGB = ..... & .B.B. But green is: .....
RGRGRG   R.R..   .....               ...G.
GBGBGB   .....   .B.B.               ..G.G
RGRGRG   .....   .....               ...G.
This means that sensors that only output low resolution combined from an high resolution sensor, at normal frame rates, might be suitable to be pixel shifted to higher resolution. But the downside is that it is preferred if the output is 4:4:4, and uncompressed, and you have to figure out how to get the sensor to send out the combined pixels shifted.

So how do the the figures stack up. To get the resolution you are after you have to start with a sensor of at least that resolution. Output will have to be 1/3rd resolution in each direction plus a bit of overlap. 1/9th resolution, unless you want to do half pixel shift.

The interesting thing is how does 4:2:0 progressive work? If it canbe made to diagonally stagger it's reds and blues, like pixel shifting, you should be able to reconstruct 4:4:4 SD colour space a bit by using pixel shifting methods. I.E:

I am not saying that pixel shift is perfect but good compromise.

I recently made an assertion about filming pure primaries/complementaries breaking down Bayer and pixel shift schemes (due to a lack of data alternative colour primary pixels, and planes on the forum, but I am wrong and have figured something else out. For each primary colour filter, if you let some of the non target colors bleed through each filter, all pixels have a chance to register all colors. All you have to do is either work out the level of each colour that should be there from normal debayer methods to subtract wrong colours, and/or keep the bleed through so low that it only occupies the least significant bits of a pixel, and canbe filtered out in debayering by clipping the lower bits. For instance we have 12 bit pixels, but the filter lets through non target colours on the least 1 or two bits. This leaves a good 10 bit pixel data left for colour correction, but each pixel record the existence of primary or complementary colours. You could keep the alternative colour bleed through so low that the last two bits register no light, 25%, 50%, 75%, and max saturation. So when somebody comes along with monochrome lighting, bright red, or purple sweater, the camera can record accurate detail about where the detail in the sweater is, and where it's edges end.

Last edited by Wayne Morellini; July 29th, 2005 at 03:04 AM. Reason: Accidentally Posted
Wayne Morellini is offline   Reply With Quote
Old July 30th, 2005, 11:06 AM   #2
Major Player
Join Date: Dec 2004
Posts: 749
I am interested in this. So do you think getting more colour usage out of a single ccd camera is possible?
Leo Mandy is offline   Reply With Quote
Old July 31st, 2005, 01:24 AM   #3
Inner Circle
Join Date: May 2003
Location: Australia
Posts: 2,761
Yes, but it is a trick, and probably not as good as 3chip pixel shift. I know some of the basic concept, but this adaption would have to be tested in practice. The readout might not be able to isolate the different colours and read them out seperately. But for a manufacturer they could design it into the sensor engine.

What it is usefull for, is not a replacement for direct HD capture, but an alternative on chips that only let you motion capture in low resolution, and also to reduce storage requirements, over normal Bayer capture. Data is funny, unless it has redunancy any compaction will have some compromise. So some still cameras and DV cameras might be adaptable to extract pure motion capture, but only at low res, so this would be usefull concept for such projects. I was personally thinking of applying it to an X3 based camera, but the only one I can afford only does mpeg output, even then it would have to be reprogrammed to output the colour planes shifted, if the system allowed it to be done at all.

Good luck.
Wayne Morellini is offline   Reply

DV Info Net refers all where-to-buy and where-to-rent questions exclusively to these trusted full line dealers and rental houses...

Professional Video
(800) 833-4801
Portland, OR

Omega Broadcast
(512) 251-7778
Austin, TX

(973) 335-4460
Mountain Lakes, NJ

Abel Cine Tech
(888) 700-4416
N.Y. NY & L.A. CA

(800) 238-8480
Glendale, CA

Precision Camera
(800) 677-1023
Austin, TX

DV Info Net also encourages you to support local businesses and buy from an authorized dealer in your neighborhood.
  You are here: DV Info Net > Special Interest Areas > Alternative Imaging Methods

Thread Tools Search this Thread
Search this Thread:

Advanced Search



All times are GMT -6. The time now is 03:24 PM.

DV Info Net -- Real Names, Real People, Real Info!
1998-2015 The Digital Video Information Network