View Full Version : My HDV Nightmare


Ben Winter
August 17th, 2006, 12:12 AM
A few weeks ago, I decided to build a dual AMD Opteron system in anticipation for a short film I'm filming right now and intend to edit in HDV. Unfortunately, even after upgrading to this great new machine, one thing after another has prevented me from finding a successful HDV workflow. Not one, not two, but three different HDV solutions have failed me and I am completely unsure as to what to do.

Editing HDV Natively in Premiere Pro 2.0 fails. I can preview the video fine but as soon as I render the preview after adding any effects, small blocks and lines appear in the image. Exporting to any format retains these lines and striations.

AspectHD in Premiere Pro fails. These same blocks and striations, plus odd patterns appear in different frames of the image. This is outside of Premiere as well. Any conversion or playing of the Cineform .avi continues to contain these artifacts. Oddly enough the artifacts are in different parts of the image each time, meaning they obviously aren't part of the file but rather mistakes int he way they are being decoded. I've sent an extensive explanation of the problem to Cineform support but it's obvious they have no clue what's going on.

DVFilm Maker with Raylight fails. Maker refuses to convert any .mpeg files without crashing by the end of it. Converting Cineform avi's is flawless however the artifacts described above remain in the image.

I have no options left for HDV editing and I am at my wit's end. Any last resorts?

Chris Barcellos
August 17th, 2006, 01:02 AM
Ben:

I am using a very similar set up and have no problem. I edit in HDV native. You didn't say what camera you have, but I have an FX1.

I ran into quality problems because the presets weren't set for highest quality.

First thing to try is rendering back out to an HDV file. Put a clip on the time line, then select Export, Adobe Media Encoder, then Select MPEG2, under that Select HDV 1080i 30. Make sure export audio is selected below that, then go down the screen a bit and select the video tab. Slide the quality slider all the way to 5.

Select okay, name your file, and then see what the end result looks like by playing on Windows Media player.


I have also gotten real decent results in Windows Media wmv files.

As far as the specs in your posted video, I am not sure what is going on there....What camera is that from ?

Chris Barcellos
August 17th, 2006, 01:05 AM
Follow up. I am still having issue with trying to get a decent quicktime file out of Premiere Pro 2.0.

Bob Hart
August 17th, 2006, 05:43 AM
Ben.

Your frame grab looks like it could be relay footage from a Letus35, Agus35 or suchlike. Is this so?

If it is and this is purely supposition on my part, the images in HDV may already have some compression artifacts from the high rate of variation between frames in the form of groundglass texture (grain), which can be a characteristic of 35mm relay footage.

A high shutter speed, a coarse groundglass and a high contrast image might aggravate a "grain" tendency.

The Cineform codec in trying to recreate a frame-by-frame .avi file from a highly artifacted source, might be having difficulties which might account for the variation.

There was another recent post about artifacts relating to ConnectHD and Premiere Pro. In response to that post, there was reference to an earlier less effective version of the Cineform software having been incorporated by Adobe into Premiere Pro.

There was apparently a workaround for the problem.

Please do not take my comments as having any qualification, but only as a hint of possible new direction for solving the problem. I might well be sending you on a goose chase when a solution may be closer to hand.

In meantime, if your troublesome footage is 35mm relay footage, it might pay to shoot some test footage direct-to-camera with varying degrees of lighting and contrast and including low-light footage with lots of video noise from video gain being set high.

If noisy footage also provokes the fault, then the relay footage might be the culprit.

Heavy post-processing such as colour saturation and higher contrast is likely to aggravate any deficiencies. I understand that 8 bit?? processing available to the home enthusiast market has limits to how much can be done to the image before defects occur.

To eliminate your hardware as a contributor to the problem it might be worthwhile doing a capture on another machine to see if the artifact re-appears there.

There will be better contributors to this discussion than myself.

Bob Hart
August 17th, 2006, 05:58 AM
Ben.

Furthur to above. I must have broken dvinfo as things got confused when I tried to add this, so here it is here.

The discussion I base my comments on is found under the Cineform Showcase area here and under the following heading :-

"Severe artifacting in HDLink M2T-AVI conversions"

K. Forman
August 17th, 2006, 06:10 AM
My PC is literally half the machine you have, and it injests HDV in PP2 just fine. I have a single AMD64 3200, and only 1 gig of ram. It's a tad slow squeezing it out, but I can't complain.

Peter Jefferson
August 17th, 2006, 08:53 AM
this might be going out on a limb, but have u tried another HDD??

I had isues like this which were caused by bad drives and and windows XP which wasnt pacthed with 132gb fix... sounds a lil out there, but try another HDD

Ben Winter
August 17th, 2006, 09:22 AM
I am using an FX1.

Bob, I have four tapes of wedding footage shot completely without an adapter and these problems happen regardless. Besides, the artifacting is too intense to be compression side effects. Also, I used to have that problem as described in that topic but as supposed I was using ConnectHD (still trying to get a refund for that too).

Trying another HDD sounds like a good idea. Right now it's four SATA 250GB raided together in a RAID 5. Maybe this is a problem?

EDIT: Nope. Tried capturing and playing back from my humble IDE C: drive with the same results.

Ash Greyson
August 17th, 2006, 09:58 AM
Clueless here... I never edit in HDV, the codec sucks for editing and it horrific for adding CC and effects. Any HDV I have ever done has been captured into another codec so I cant comment on your issues.

Is that the Ponce De Leon chapel in Atlanta? I had some friends get married there in June and they were SUPER strict on camera locations, etc.



ash =o)

Kevin Shaw
August 17th, 2006, 11:08 AM
Ben: as an experiment, you could try downloading the demo version of Edius and see if that works for you. If nothing else, it might help give you more insight into where the problem is arising - and if it works then to heck with Adobe Premiere!

http://www.canopus.com/products/EDIUSPro/index.php

Curtis Rhoads
August 17th, 2006, 12:26 PM
Just an odd thought... Have you tried a different firewire cable? If the problems are happening when you capture, and even when you convert, it might be that there's some line noise being introduced to the data when being captured intially by a faulty cable.

Might be worth a check...

Ben Winter
August 17th, 2006, 12:39 PM
Ash, it's a small chapel in Ellicott City, Maryland. Curtis, the footage is flawless when viewed in Premiere native .mpeg but the artifacts occur when rendering effects, meaning whatever format (read: codec) Premiere is rendering the previews in is obviously causing the issue. This smells very badly like a codec issue. But I'v reinstalled Windows and gotten the same problem, so it's obviously hardware-related...

Ben Winter
August 17th, 2006, 12:50 PM
Ok, did some more testing...

Rendering an mpeg with a 180 degree motion effect and a small scale increase reveals no artifacts. However layering this clip with another clip, setting opacity to 50% and adding a fast blur to the bottom layer and rendering gives artifacts.

Exporting this to mpeg as suggested reveals no artifacts...

So maybe I can edit in mpeg native, and just make do with the artifacts when previewing knowing that they won't turn out in the final product? But what's causing it?

Plus I'd really like to get Aspect to work. Not to mention that I need a 24p workflow for my 60i footage, and Raylight is the only way to go right now. But DVFilm Maker crashing is a whole other topic.

Chris Barcellos
August 17th, 2006, 01:05 PM
1. Are both cores of your system actually being utilized by system ?? (Google AMD Power Monitor and download it.) It will monitor the cores to see if both are operating. Since this is self built, did you use set up disks to be sure proper drivers on board, and dual core operation is active. On my motherboard, I had to update the BIOS to get proper operation.

2. What are you using for a Video Card. I don't know for a fact, but I believe PPro utilizes Video card resources. I assume you have a decent card, but if you have a system that shares video memory, that could be a problem. (Just guessing at this.)

Ben Winter
August 17th, 2006, 01:18 PM
Figured out DVFilm Maker!

It is crashing because it is running up against it's 4GB/18-minute barrier. I am trying to convert files that are 20 minutes long at the least. Converting shorter files ran OK.

To answer your questions:
1. Yes, all four cores seem to be utilized. In fact, reducing Premiere's usage to 1 or 2 cores using Set Affinity seems to reduce the amount of artifacts appearing in the image. Hmm...

2. I am using the Matrox Parhelia APVe as recommended by Cineform.

Chris Barcellos
August 17th, 2006, 08:55 PM
Okay. So are you telling us your hard drive are not formatted NTFS, and are in FAT32-- hence the 4 gig max? Are you doing that on purpose for a technical reason ?

See this: http://www.ntfs.com/ntfs_vs_fat.htm

I had a crazy problem wiht called Cinemantique, which I bought about 4 months ago. Even though all my drives are NTFS, I kept getting a file size crash at about 2 gigs.

Ben Winter
August 17th, 2006, 11:08 PM
No, my disks are formatted NTFS, the 4 gig max is a limit of DVFilm Maker. And never mind about fixing it, it's still crashing even when processing 10 minute sections.

Ben Winter
August 31st, 2006, 08:48 AM
I'm still having these problems. Can anyone assist?

Ben Winter
September 19th, 2006, 08:09 AM
I fixed it!

I wanted to post my solution here so any poor soul who has this problem knows what to do.

RAID 5 didn't like my computer. I reformatted it to RAID stripe and now not only do I have more disk space, everything's running free and clear.

Dan Keaton
September 23rd, 2006, 03:30 PM
With Raid 5, there is a "Write Penalty". This means that the Raid 5 setup has to perform more steps, which takes more time, each time the Raid 5 setup has to write a block of data to the disks. Thus writing to a Raid 5 Setup takes more time than reading from a Raid 5 setup.

Personally, for this reason, I would recommend against using Raid 5.

However, you stated that the problem occurs after a render process.

During a render, your software (NLE) should only attempt to write to the disks as fast as the Raid 5 setup can accept the data. So, in theory, the Raid 5 setup should not cause problems. However, you were having problems so there may be a sofware problem, or a problem with your Raid 5 setup.

Now, I assume that your source files were on the Raid 5 setup also. So you were reading from all of your disks, and then writing to all of your disk (which also involves reading data from your disks (this is the "Write Penalty" part). While this sounds like a lot of work, and it is, a good Raid 5 system, along with properly written software should handle it properly. By this I mean that the software should wait until the previous block of data has been successfully written to disk before attempting to write the next block of data.

While rendering should work fine, in theory, using a Raid 5 setup, capturing may be a serious problem. With rendering, the software has the luxury of taking as long as necessary to complete the writes to disk. When capturing, the software must keep up with the incoming data from your deck or camera. If it does not, then you have dropped frames. So I would not recommend Raid 5 for capturing.

I applaud your decision to remove Raid 5. It must have been quite a job to backup all of your data, then change to a different setup, then reload all of your data.

Ben Winter
September 24th, 2006, 02:01 AM
Your insight sounds accurate. Regrettably, I would've had a Raid stripe setup to begin with but my computer wouldn't set up the disks for Raid Mirror so while flipping through the other options in the menu I figured "ehh, what the heck? Raid 5 sounds good..." Not knowing what it was in the first place anyway.

In any case I'm just glad changing disk setups solved my problem. I went to experts exchange to see if anyone could help me, and they just bobbled around capturing incorrectly, using the right codecs, etc. It was obvious they didn't know what they were talking about and had never been exposed to the video editing world. It's been such a bother to me, I've literally lost sleep over it. Now that everything is running smoothly I couldn't be happier.

Mark Goldberg
October 11th, 2006, 06:36 PM
I cannot directly address the problems you are having with PP2 because a few months ago, I decided to migrate away from Premiere in favor of Vegas.

Vegas has been HD friendly for years, and I have no regrets about the move. I was having numerous problems, bugs, and lockups even with Prem 6.5 and decided not to upgrade it to an HDV version.

Vegas 7 will handle the HDV m2t stream directly. Version 6 coughs with m2t and needs a proxy application or intermediate codec.

What is truly amazing is that I have made HD output in WMV format using Vegas 6, and have released it to my customers with great results.

You can download a trial of Vegas from Sony Media.