DV Info Net

DV Info Net (https://www.dvinfo.net/forum/)
-   Sony XDCAM EX Pro Handhelds (https://www.dvinfo.net/forum/sony-xdcam-ex-pro-handhelds/)
-   -   "Rolling Shutter" Skew Tests and Grabs (https://www.dvinfo.net/forum/sony-xdcam-ex-pro-handhelds/112362-rolling-shutter-skew-tests-grabs.html)

Ali Husain January 25th, 2008 12:07 AM

one thing i noticed(*) is that the motion blur on the ex1 has a strange triplicate-image look... as if someone took three exposures in quick succession then merged them together. pretty gross looking to me. nothing like the hvx or even the dvx which were all smooth and creamy. i think i'm probably the only one who's more annoyed by the ex1's motion blur than its rolling shutter distortion. :)

edit:
---
(*) in my limited use and non-scientific testing! i could have noticed a standard exposure issue with flickering lights or have misadjusted something.

Eric Pascarelli January 25th, 2008 01:23 AM

Ali,

Do you have a still or clip you can upload?

I really don't think the EX1 does motion blur any differently from any other camera - it's all about the accumulation of photons through an open shutter under motion, so it would be hard to create a visibly different look (for the blur itself, assuming the exposure and other aspects of the image are similar) without really trying. I think side by side tests would prove this out.

Perhaps you saw some motion blur mixed with some ambient flickering light source (such as a distant fluorescent) that created the look of multiple exposures? Or perhaps it's an unusual codec related issue in the footage you are referring to?

Having scrutinized single frames of motion picture film under a magnifying glass as part of my profession for many years, I find the motion blur on the EX1 to be quite satisfactory (because it's similar to film).

I'm not so thrilled with the scanning shutter issues, however.

Ali Husain January 25th, 2008 07:12 AM

i've had far more limited use of the ex1 than i've had with the dvx100 or hvx200. and i haven't yet compared them under the same conditions. there's certainly a chance that there were issues in the lighting, or that settings i used made a difference. i've had a few years experience examining stills from video, but my experience with film stills is only second hand. i'm thinking it would be wise to defer to your experience. strange though that the hvx/dvx cadence, in my memory, looks more, to use the precise scientific term :), organic. perhaps there is some duty cycle differences with the exposure?

Steven Thomas January 25th, 2008 09:24 AM

I've stepped frame by frame with the EX1, it looks like typical motion blur.

If you are seeing something, please post an example original.

Eric Pascarelli January 25th, 2008 10:17 AM

Quote:

Originally Posted by Ali Husain (Post 814064)
perhaps there is some duty cycle differences with the exposure?

The amount of blur per frame depends on frame rate vs. shutter angle, both of which are very adjustable on the HVX and the EX1. So, yes, if they were set differently their motion blur would be different.

Also, speculars and other clipping whites will have a harder edge to their blurs than things that are well within the exposure range. That's because, even under motion, they are bright enough to saturate the sensor from the moment it's exposed.

Ali Husain January 25th, 2008 12:58 PM

all right. i edited my original comment to be more fair. and i gave myself a todo to look through all the ex1 footage i have and study the motion blur, plucking out offending examples. good comments! thanks!

Noah Yuan-Vogel January 25th, 2008 02:09 PM

I saw a presentation about the EX1 given by Juan Martinez from SONY at VCA in new york, and he did mention something about the exmor sensor reducing noise by scanning more than once per frame... although i cant seem remember specifically at the moment. i know he also said it reduces noise by taking a black voltage level for each pixel per exposure and subtracting it from the voltage output from the exposure on that pixel. i imagine one the former reduces analog noise and the later reduces fixed pattern noise? but i wonder if any of that is related to the frame accumulation motion blur effect you were seeing?

Steve Mullen January 25th, 2008 02:39 PM

Quote:

Originally Posted by Ali Husain (Post 813937)
one thing i noticed(*) is that the motion blur on the ex1 has a strange triplicate-image look... as if someone took three exposures in quick succession then merged them together.

Perhaps you were in the mode that accumulates images to increase sensitivity. Any system that accumulates images can create either blur or image "copies" depending on the type of lighting. For example, flourescent lights might yield images.

PS 1: I'm increasing less sure about my claim that there is a difference between the way EXMOR and 3ClearVid work OTHER than the EXMOR has all digital output which reduces noise and, I suspect, decreases read-out time. If the read-out time is less, then indeed EXMOR may help reduce rolling shutter. But, I honestly do NOT remember Sony claiming rolling shutter is reduced.

PS 2: I'd love to the test done on a V1 to see if there is any difference.

Christopher Barry January 25th, 2008 05:22 PM

On another forum, NYC night footage was posted. I d/l the clip, however, I can not find my way back to the post, so I just frame grabbed where I think the raised issue has occurred.

I will take this frame down once I locate the original post with a link to d/l. Anyway, I am not sure if I would be within DVinfo forum rules to link to another forum?

http://www.siliconcine.net/temp/Motion_Blur_EX1.jpg
Size: 200%

The rest of the footage in the clip is fine, actually amazing IMO, just this fast moving, close to the camera, taxi passing did register the stepping motion blur the first time I saw the footage. I note the specular highlights and edge detail appear to be making the stepping apparent in this instance. Other smoother tones on the taxi do not display any issue in earlier frames.

All said and done, I can not wait for the EX1's to arrive next week.

Eric Pascarelli January 25th, 2008 06:14 PM

That's what i was talking about - a flickering light source. NYC (and most every city) is lit with fabulous sodium vapors which flicker 120 times per second.

I would guess that that clip was shot at 24p with shutter off - hence five cycles of the light per frame. Notice that the cab's taillight, at 12VDC does not exhibit the same stepping (because it does not flicker).

This would happen on any video camera.

Christopher Barry January 25th, 2008 07:59 PM

Found the link: http://www.8112studios.com/nyc.mov

The thread: http://www.dvxuser.com/V6/showthread.php?t=121427

Look forward to further comments, now that the full clip is available to assess. I will remove my frame grab, in due course.

Eric Pascarelli January 25th, 2008 08:22 PM

I won't change my comment except to say that looking at that shot, it might be an even harsher flickering source that is creating the multiple exposure - perhaps old fluorescents from a store.

Also, it is clear from the footage that the shutter is indeed turned off in the camera, because the blur from one frame connects with the blur on the next.

And so the 120Hz/5 images per frame flicker explanation makes sense.

Christopher Barry January 25th, 2008 10:11 PM

Eric, this is very interesting information and discussion. Thank you.

Christopher Barry January 27th, 2008 03:19 AM

Quote:

Originally Posted by Eric Pascarelli (Post 814438)
That's what i was talking about - a flickering light source. NYC (and most every city) is lit with fabulous sodium vapors which flicker 120 times per second.

I would guess that that clip was shot at 24p with shutter off - hence five cycles of the light per frame. Notice that the cab's taillight, at 12VDC does not exhibit the same stepping (because it does not flicker).

This would happen on any video camera.

Eric, the following Cloverfield article affirms your position that sodium-vapour lighting is the cause, and I refer you to the penultimate paragraph of the article:
http://www.videography.com/articles/article_15469.shtml

"When you do a fast pan with the Viper or the F23 under sodium-vapor lighting, you get a triple image," the cinematographer notes. "You get the image itself and then two trails."

Indeed, Viper and F23 suffer similarly. With the hand held approach in that movie, I can see a lot frames suffering with this issue. Cloverfield 'team roto' post nightmare for VFX crew.

Eric Pascarelli January 27th, 2008 09:16 AM

Well there you go.

The reason they get three images (really 2.5) instead of 5 is that they were using 1/48 second shutters, as any feature filmmaker would.

Bill Ravens January 27th, 2008 09:28 AM

So, armed with this knowledge, one could use 1/125 shutter speed and eliminate any multiple images.

Eric Pascarelli January 27th, 2008 09:47 AM

Hmm. 1/125 sounds dicey. It's worth a test, and would depend on the duration of the light's "on" cycle vs. "off" cycle

If there are any incancesdents at all in the shot, I would stick to 1/48 to get the natural blur from those and let the flickering lights to their steppy thing.

Sean Donnelly January 27th, 2008 07:34 PM

Eric I think you are right, it is pretty much impossible to predict the exact flicker rate of a light source (especially in a place with so many different types) so there is no arbitrary safe speed, but if you're in a room with a single source you may be able to phase it out using the ECS function. Also, I would go beyond saying that it would happen with any video camera, it will happen with film, both motion picture and still.

-Sean

Bill Ravens January 27th, 2008 08:07 PM

Are any of you guys musicians? If you are, then you must understand harmonics. Harmonic principles in physics are what causes resonance and can generate amplification.

The same happens with any frequencies when they beat against each other. Two matching frequencies provide the most noticeable results(harmony)...as in the frequency of the fluorescent matching the frequency of the scanner. If you can get sufficiently above the nyquist frequency, which is 2x the base frequency,the beating goes away....go figure. In this case, the base frequency is 120Hz. Nyquist is then 240 Hz. I think 1/250 will do quite nicely. Of course, then you start experiencing other effects like wheels appearing to rotate backwards.

Eric Pascarelli January 27th, 2008 08:35 PM

Bill,

I think you are confusing shutter speed with frame rate. Since frame rate is constant, frequency (of the camera) is constant.

If a wave metaphor applies at all to a camera, changing the shutter speed changes the shape of the wave, not its frequency. Like changing the duty cycle of a square wave perhaps?

1/250 would certainly eliminate the multiple images, but it would also render the exposure unpredictable because it could be photographing the lights on or the lights off, depending on how the camera is phased to the light source. But as Sean said, you could dial it in, just like when you shoot a CRT television.

Edit: But all of this goes to hell with the rolling shutter as Bob mentions below.

Sean,

Of course you are correct. This would happen on any camera, conditions being equal.

Bob Diaz January 27th, 2008 09:11 PM

I'm with Eric on this issue, 1/250 of a second with any shutter (rolling or global) would cause problems. With a rolling shutter, as it "moves down" the lights blink ON-OFF-ON-OFF, thus we'd have 2 bright bars and 2 dark bars.

With a global shutter, the overall brightness of the image would rise and fall as the camera's shutter opens and closes in and out of sync with the times the lights are bright.

A time of 1/120 of a second would be best. That way, any part of the image would be exposed for exactly 1 cycle.

IF I want to sample audio, 2x minimum would be the rule, but anything higher would always be better. However, in this case, we are not generating a waveform from our samples, so Nyquist does not apply here.

So, it's best to match the exposure time to the time of one cycle, 120 Hz or 1/120 of a second.


Sincerely,

Bob Diaz

Raymond Schlogel February 2nd, 2008 01:13 PM

Well the rolling shutter finally reared its ugly head. Had a shoot last night of a live band, big crowd and with it lot's of camera's. I hate to say it but there are quite a few shot's that would have otherwise looked pretty decent that are instead "wtf" moments if anyone else were to look at em. Like the police car, the whole line across the frame with have of it being bright is a lot more painfully obvious than I had hoped it would be just reading about it and not experiencing it myself. From what I'm reading there really aint a whole lot I can do about this is there? I shoot bands quite often so a wee bit concerned.

- Ray

Leonard Levy February 2nd, 2008 02:02 PM

This certainly sounds like the camera's weak point.
I'm interested to hear more details about your footage.

Did it screw up your whole shoot?
Was it just still photographers or di the bands lighting also set off problems.

Please let us know if you find any "quasi fix" in post, maybe just whiting out the whole image? Do the frames with opposite half exposures match up so you could blend them? (I imagine they wouldn't be perfect though.)

Charles Dasher February 2nd, 2008 02:05 PM

CNN clip with rolling shutter effect
 
I was watching the news the other night and they were showing some paparazzi footage in the upper corner. i can not say for sure if it was from an EX1 but they kept looping a clip of some poor celebrity and the whole thing was showing over exposed bands as the flashes went off around the scene.

Makes me glad I will be shooting most of my work outside in broad daylight.

Raymond Schlogel February 2nd, 2008 02:40 PM

Nah, didn't screw up the whole shoot (if it did I need to find a new job!). The stage lights had no issue what-so-ever but what it did mess up a fair amount of lot of shots from the stage that were pointed toward the crowd and several that didn't have the camera/crowd at all but someone took a pic. Gotta love camera phones. Only fix I'm aware of is go to another shot. As one can expect from this cam so much of the footage is simply stunning but it's disheartening to have this one painful caveat.

Will post some screen grabs as soon as I'm able.

- Ray

Jamie Baughman February 2nd, 2008 02:43 PM

Raymond,

I'm heading out to Austin to shoot some SXSW parties and shows in March, so I'd love to hear your experience with shooting live bands in the coming weeks.

I'm also trying to figure out what to do with the bands/labels/production companies who don't need an edit, but just want raw footage when I'm done...but I guess that's for a different thread!

Steven Thomas February 2nd, 2008 04:19 PM

I know it's a pain, but have you tried fixing this in post?
Obviously, this would be crazy if there were non stop flashes.

I guess you'll have to minimize your shots directly into the audience.

Graeme Fullick February 3rd, 2008 02:02 AM

I use a 80-90% transparency white frame over the top to fix the flash problem. Works perfectly every time in Avid Liquid - should work just as well with other editors. I know that it would be a lot of work with constant flashes - but this is pretty rare - even at weddings.

Eric Pascarelli February 3rd, 2008 02:29 AM

Graeme,

Is that 80-90% transparency or 80-90% opacity?

Is is mostly white or mostly transparent? I would think you would want something mostly white to mask the partial exposure nastiness.

Leonard Levy February 3rd, 2008 03:37 AM

Graeme, Could you post before and afters and explain for the dummies about post (me) exactly what your talking about.

Graeme Fullick February 3rd, 2008 04:24 AM

Sorry Eric,

Yes that should read opacity - writing in too much of a hurry.

Leonard,

I just paste a 80-90% opacity white frame over the offending frames, and it looks on playback like a normal flash from a still camera. I have found that a photographers flash is almost always 2 frames long, so I have set up a short cut in liquid which is a 2 frame 80% opacity white frame, which I simply pull straight over the top of the offending footage. You can even set it up so that it matches the half a frame (in CMOS cameras such as my Sony A1 and the EX1) if you wish by setting it up cropped to match the offending frame (i.e. the white opaque bit only crops over the part of the frame that is not flashed - but this sometimes requires a bit more fiddling to get the intensities of the 2 halves well matched). In Liquid this takes all of 10 seconds to accomplish. I have been using it for 2 years to cover the frame crash associated with HDV when it encounters a photographers flash (an ugly square pixellation effect) - and have yet to have a single negative comment about how it looks on any of my finished work. Liquid is a native MPEG2 editor, and actually fixes these HDV artifacts if you make it re-render them with a partially transparent clip over the top. I often use a 100% transparent white frame to repair HDV codec crashed associated with extreme motion. It does cost a tiny bit of resolution, but fixes the HDV codec crash artifacts extremely well.

If you just look at the still frames, you can often see that all of the frame is not a uniform shade of white from the flash, but at normal playback speed it is entirely imperceptible (and that is what matters), as clients almost never watch a video frame by frame!

Hope this helps.

Brian Drysdale February 25th, 2008 04:44 AM

I've just been reading a CML thread about the RED's rolling shutter. It was pointed out that some CMOS cameras like the Dalsa, Phantom V and Arri D20 don't have this effect. It describes how the Dalsa has two layers, the first of which collects the light, then the light information is dumped down to the second layer (blind to light), where it's removed in packets in a rolling shutter style. The net result is that the Dalsa CMOS sensor acts like a global shutter.

It would seem that these global shutter CMOS sensors are more complex to produce, so the rolling shutter found on most CMOS cameras is a cost trade off.

Illya Friedman March 31st, 2008 02:10 PM

Quote:

Originally Posted by Brian Drysdale (Post 832446)
I've just been reading a CML thread about the RED's rolling shutter. It was pointed out that some CMOS cameras like the Dalsa, Phantom V and Arri D20 don't have this effect.

The DALSA cameras actually don't use a CMOS censor. It's a CCD with a spinning mirror shutter to complement the optical viewfinder.

I.

Illya Friedman
DALSA
Digital Cinema Division
www.dalsa.com/dc

Noah Yuan-Vogel July 24th, 2008 12:45 AM

sorry to resurrect this old thread, but i was playing around with a EX1 at Abel today and am buying one very soon, but while i was there i tried zooming in and whipping the camera back and forth while zoomed in. i thought we had concluded earlier in this thread that the cmos pixel readout rate is constant no matter the format (1080/24p 720/60p etc), but in my quick test i noticed that there was a lot of skew present when shooting at 1080/24p HQ, but skew effects were almost unnoticeable when shooting at 720/24p overcranked to 60p. i was viewing this on a panasonic (17" i believe) HD monitor through SDI, and at 720/24p overcranked, it appeared to be outputting 720/60p over HDSDI. at 1080/24p skew was very noticeable, more so than i remember it being when testing the ex1 previously, a huge contrast to 720/60 where the image had very smooth 60fps motion and what appeared to be much much less significant skewing. were the tests wrong? any other ideas would be very much appreciated. could it have been old firmware?

i didnt get to test it that extensively, but if someone who has a camera readily available could do further testing, it would be very interesting to see. if not, i may go back and do some more careful testing and make sure i check the firmware version as well as all the other settings.

Perrone Ford July 24th, 2008 01:34 AM

From the user tests I've read, setting the camera to any of it's normal rates 1080/720 24/25/05/60 all write the normal 35mbps to card. However real overcranking actually writes closer to 70mbps to the card and may burst higher.

Obviously, this affects record times, so that must be taken into account, but it was a very nice bit of information to get.

Noah Yuan-Vogel July 24th, 2008 07:38 AM

im not sure how that relates. were you responding to me? im not talking about the cards or compression at all, this was realtime live HDSDI feed to an HD monitor. if anyone can do further testing or verify that they noticed more skew at 24p than 60p i would be very interested in it.


All times are GMT -6. The time now is 04:08 AM.

DV Info Net -- Real Names, Real People, Real Info!
1998-2025 The Digital Video Information Network