DV Info Net

DV Info Net (https://www.dvinfo.net/forum/)
-   Digital Video Industry News (https://www.dvinfo.net/forum/digital-video-industry-news/)
-   -   Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview (https://www.dvinfo.net/forum/digital-video-industry-news/516139-magic-lantern-unlocks-canon-5d-shoot-14-bit-raw-via-liveview.html)

Ted Ramasola June 3rd, 2013 05:54 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
As of yesterday, they have now made windows and osx converters with GUI to turn ML raw to Cinema DNGs compatible with resolve and speedgrade.

I have tested mkII footage and I was able to open it in resolve. They are ironing out technical quirks like, black levels, larger than 2gig files, etc. Amazing times. :)

Jad Meouchy June 4th, 2013 06:44 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
On the topic of Canon suing ML, I have some thoughts. Canon, from my conversations with various people in the company, is extremely supportive of their community. They added 24p because people asked for it. They added better codecs, dual slots, and reduced video moire in the mk3 because people asked for it. They added slowmotion because... you get the idea. I feel like they've done everything within their power to give us what we desire, short of releasing source code. The C100/300/500 exists because it is exactly what we wanted!

Sony is doing great things in the mid-range with their F3/5, and Blackmagic is making a strong play, but I have to give credit to Canon for paving the way and continuing to innovate. And of course for listening to all our seemingly bizarre feature requests like crop mode on the t3i ;)

Mark Williams June 4th, 2013 09:12 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Just came across this...


Noa Put June 5th, 2013 12:13 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Quote:

Originally Posted by Jad Meouchy (Post 1798659)
On the topic of Canon suing ML, I have some thoughts. Canon, from my conversations with various people in the company, is extremely supportive of their community.

Canon does what any other major camera manufacturer does, they don't give us what we want, they cripple each model depending on it's price, the more ridiculous expensive it gets, the more you get what you asked for. Each (cheaper) model does have the features we all wanted but never got from Canon and which thx to the ML team have been provided to us, not by Canon.

Evan Donn June 5th, 2013 04:45 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Quote:

Originally Posted by Jad Meouchy (Post 1798659)
The C100/300/500 exists because it is exactly what we wanted

Except that the C100 has 4:2:0 24Mbit AVCHD while the C300 has 4:2:2 50Mbit MPEG2 - it wouldn't have cost them more to put the higher quality codec into the cheaper camera, even though everyone wanted it. It's done purely to create a greater marketing differentiation between the two. So while they may have designed these cameras to address what the market was asking for, they've also been careful to do so in a way that protects their higher margins. What ML is doing goes against that philosophy by enabling the lower-margin equipment to outperform Canon's more profitable stuff.

Now I don't think this necessarily means Canon will fight them, because I expect most of their higher-end market would be pretty reluctant to use an unauthorized hack on any professional job. But I also wouldn't expect them to promote or encourage what ML is doing for the same reason.

Ted Ramasola June 12th, 2013 11:57 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
As an update, I guess by now it is safe to clarify my original post which states "raw in liveview" since by now its clear that we have "raw video" coming out of, not only of the 5D, but also from a lot of the canon DSLRs including one that is not supposed to shoot any video, the 50D.

The 5D mkIII now has full HD resolution for Raw @ 1920 x 1080 24P, 25P and also 60P at 1280 x 720 or 1920 x 672, but since I don't have that camera I will let those who have it and tested the ML Raw to chime in and state the details.

For the 5DmkII, it is out of pre-alpha and now has ALPHA 1.
For those who are following the nightly builds, the June 12 compile by developer a.d. is the module version of ALPHA 1.
Link to jun 12 NB:
https://bitbucket.org/a_d_/magic-lan...ed3721fc44.zip

Alpha 1 is for those who are starting from scratch.
Link to ALPHA 1:
https://bitbucket.org/a_d_/magic-lan..._Alpha_One.zip

Alpha 1 PDF instructions:
https://bitbucket.org/a_d_/magic-lan..._Alpha_One.pdf

There is now jun 13 NB (able to save your settings implemented )
https://bitbucket.org/a_d_/magic-lan...3385aa13bd.zip

here are SOME of the 5D raw resolutions, aspect ratio and its status. (using a 1000x Lexar CF card)

1880x1058 -- 16:9 -- 400 frames approx.

1880x940 -- 2:1 -- 1,900-2,400 frames approx.

1880x854 -- 2.20:1 -- stable/continuous til card full

1728x972 -- 16:9 -- stable/continuous til card full

1728x864 -- 2:1 -- stable/continuous til card full


In 3x (5X magnify) crop mode ( note for now NB jun 12, centering and cropping in this mode is off a bit to the left)
crop mode will give optimum results when used with FPS over ride (23.976)

2152x1078 -- 2:1 -- 184 frames approx.

2048x1078 -- 1.90:1 -- 242 frames approx.

1920x1078 -- 16:9 -- 335 frames

1880x1058 --16:9 -- 430 frames approx.

1880x854 -- 2.20:1 -- stable/continuous

1728x972 -- 16:9 -- stable/continuous

There are more resolution and aspect ratio combinations.

For now the raw video in the 5D2 records beyond the 4gig limit by spanning several files.

Programmers have written several programs to extract the dngs, combine the spanned files and convert them to files understood by most systems.

Post processing:

Aside from DNGs you also can convert them to Cinema DNGs to make them compatible with Resolve.

RAWanizer by developer Marten has a windows interface to batch process your raw files to DNGs, Tiffs or proxy files in Prores, MP4, DNxHD, Csupport for Cineform.
http://www.magiclantern.fm/forum/index.php?topic=5557.0

Raw to Cinema DNG converter by developer Chmee for windows. I've tested this and the footage will open in both AE CS5 and Resolve.
http://www.phreekz.de/wordpress/2013...ng-cinema-dng/

RAWMagic by developer Thomas Worth converts raw to Cinema DNG works for Mac.
http://www.magiclantern.fm/forum/index.php?topic=6218.0

So, is this ready for use in production? I'd say test it first and see if it works for you. If you already have a raw workflow and raw capable A camera, a BMC, red etc, I'd say you can use this as B cam for now.
Again, test it first if it works for you. If you're a DSLR shooter and want to use this in your project, test it and with a sound recorder, you might and could be succesfull in using this tool as it is now.

Ted Ramasola June 15th, 2013 12:26 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Since I can't update/edit my previous post, I'll just add my test results on the recent builds jun 13 and 14.

I'd also like to correct my results on 1728 x 972 since i ran a couple of tests today and try to make long recordings to try and fill up the cf card. 32gig 1000x Lexar.

1880x1058 -- 16:9 -- 400 frames approx.

1880x940 -- 2:1 -- 1,900-2,400 frames approx.

1880x854 -- 2.20:1 -- stable/continuous til card full

1728x972 -- 16:9 -- 10,000 frames approx. ( 7min ) This is already near 32gig card capacity.

1728x864 -- 2:1 -- stable/continuous til card full

I was able to push 1728x972 to go that far by having GD=off / FPS override=23.976 / preview=Hacked mode. Otherwise it will be 7,150 - 6,550 ish.

I confirmed that 1880 x 854 is stable till it fills up card. In my tests it goes up to a 29.7 Gig (31,930,872,768 bytes) file on a 32 Gig card.

It takes me 15 minutes approx to transfer that from CF to Hard drive via usb 2.

Using RAWanizer to merge and extract to DNG it takes 34 min approx.

This is on my Quad core i7 64 bit win 7 system.

Ted Ramasola June 16th, 2013 11:36 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Jun 16 Nightly build has much improved framing in the crop modes.

Gary Huff June 17th, 2013 12:48 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Quote:

Originally Posted by Evan Donn (Post 1798780)
What ML is doing goes against that philosophy by enabling the lower-margin equipment to outperform Canon's more profitable stuff.

The ML raw hack gives much better looking footage out of the 5D, but it's nowhere near as good as what I get out of my C100 (AVCHD and ProRes) on a daily basis.

John Benton June 17th, 2013 07:57 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Ted
Thanks for the regular updates , much appreciated!
J

Chris Barcellos June 17th, 2013 10:33 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
I've now used the Batchelor 2 Beta1 build for batch conversion of the Magic Lantern Raw Files to DNG files. No need for transferring files to your hard drive. It takes the file on the CF Card and spits out individual directories at a designated location. Very nice job.

Chris Barcellos June 17th, 2013 10:44 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Quote:

Originally Posted by Ted Ramasola (Post 1800620)
Jun 16 Nightly build has much improved framing in the crop modes.

Ted: Never used this mode. Is there documentation somewhere on use and methods ?


Okay, I found this, and now understand: Back end of this video explains it.

Ted Ramasola June 17th, 2013 11:06 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Chris,

Right now the only use i see out of crop mode is lock down shots. Either small macro subjects or faraway ones that doesn't require following a subject as currently, developers are trying to follow the raw buffer from the canon focus box, doing so gives you near accurate framing at the expense of resolution and color.

Simply put, using crop mode there are a couple of ways to achieve preview and framing,

ML grayscale = near accurate framing but low rez (pixelated) and grayscale
Canon= high rez but inaccurate framing that currently pinkish and magenta in color. (this is due to reports that having this in color results in artifacts in some cameras)

However, this is jun 16 build, I'm reading the change logs for jun 18 that this is being improved.
Jun 18 is not yet uploaded, just the change logs.

The good thing about this mode is its 1:1 pixel so its sharp. On the 5dmkII this mode gives optimum results without a VAF filter.

Ted Ramasola June 17th, 2013 11:26 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Here's a simple way to engage crop mode on the mkII.

ML menu raw video=ON
ML menu FPS over ride= ON 23.976 ( this gives more recorded frames than OFF)
Press magnify button once=5X
ML raw video menu choose resolution you want.
ML raw video menu Preview= Auto or ML Grayscale
Press SET to start recording

Resolutions I tested on the mkII and #frames; based on jun 16 build
2152 x 1078 = 165 frames
2048 x 1078 = 190 frames
1920 x 1078 = 285 frames
1920 x 960 = 720 frames
1880 x 854 = continuous
1728 x 972 = continuous

Jon Fairhurst June 18th, 2013 12:04 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Ted, I wonder if the rolling shutter is lower in crop mode than in full mode?

On one hand, the camera still needs to read about 1.5MP from sensor. On the other hand, it's reading a smaller area, which might speed things up.

There are two ways to test it: One is to pan the camera with vertical lines in the scene. The other is to use a manual flash unit. To use the flash approach, you need to find a frame that includes a full line from the flash and an additional pair of frames that captures the flash line at the end of one frame and the start of the next. Given those three frames captures and the frame rate, one can calculate the read-reset (rolling shutter) time.

I've ordered a Komputerbay 64GB 1000x card and plan to shoot tests starting next week.

Chris Barcellos June 18th, 2013 02:07 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Quote:

Originally Posted by Ted Ramasola (Post 1800795)

The good thing about this mode is its 1:1 pixel so its sharp. On the 5dmkII this mode gives optimum results without a VAF filter.

So do you recommend actually removing in the VAF filter in this case? I will give it a try once I get the hang of it.

Sounds like in crop mode that I am going to end up with about the same I have with my Black Magic Cinema Camera.....

Ted Ramasola June 18th, 2013 02:34 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
1 Attachment(s)
with the vaf filter with crop mode, the image will be usable(depending on the subject) but its not the best image you can get from the 5d2 raw video in crop.

I won't recommend you keep on removing it during your tests but when your using the 5d for something important and using crop mode, I recommend you remove it if the situation permits.

Attaching res chart of crop mode.

Jon Fairhurst June 18th, 2013 03:21 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
For best results, definitely remove the VAF for crop mode.

Chris Barcellos June 18th, 2013 04:06 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Thanks guys.

Ted Ramasola June 19th, 2013 01:32 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
There are some bugs in crop mode with the jun 18 NB for 5d2, so if you plan on doing some shooting in 5x crop mode use the jun 16 for the mean time.

Crop mode in jun 18 shows some pink cast in the image. The normal 1x modes seem ok.

Chris Barcellos June 19th, 2013 06:44 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
I am getting see loss of exposure control with the June 16 version. The live screen show a pink cast and it seems like exposure that was set before entering mode goes away. Not sure the dynamic range is still there. I do have camera set at Cinestyle mode, so that could be an issue.

Ted Ramasola June 20th, 2013 11:35 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
June 19 NB still got problematic crop modes. 1x are ok.

Jon Fairhurst June 22nd, 2013 06:10 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Received the Komputerbay 1000x 64GB card yesterday. Got a "functionally" stable 1880x864 today using the June 16th build on the 5D2. The key for us was to turn off sync beep.

At that resolution and 23.976 fps we recorded 16GB before we got bored and stopped. :) ML benchmarks the card as more than fast enough to handle 1080p. In our test, the buffer was growing at a very slow rate, so the firmware won't do that rate forever on our camera. Hopefully, the new buffering strategy will deliver that last bit of performance.

FWIW, the Komputerbay card is available for just over $100.A great price for such a large, fast card!

Next week, I'll receive a Hoodman USB 3.0 reader. I'm hoping to eventually be able to transcode directly from the card to a RAID 1 or RAID 5 hard drive setup near real time. That would make a two or three CF card setup "wrangleable" with little to no downtime.

FWIW, 1880x864 @ 23.796 fps at two bytes per pixel is 78 Mbps (68.2 Mbps if it does bit packing with its 14-bit words.) That's over 13 minutes of shooting per card. That's not unlike shooting 3-perf film with 1,000 ft magazines.

(Sure, you don't have to backup your magazines to hard drives and film has way more resolution than ML RAW, but you don't have to buy ever more film stock or process your bits with chemicals either...)

Alister Chapman June 22nd, 2013 08:56 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
You mean 78MB/s not Mb/s.

Trouble is though you still need to get up to around 2.3k/2.4k of bayer pixels to achieve HD resolution and that means around 70% more data than your recording at the moment. 1880x864 of raw bayer data falls well short of HD.

Jon Fairhurst June 22nd, 2013 10:44 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Yes. Big "B".

And you're absolutely right about the effective resolution of a Bayer signal being lower than the physical resolution. That said, I believe that the 5D2 delivers its h.264 signal from less than 1920x1080 photosites anyway. Shooting a similar number of pixels, preserving the full bit depth, avoiding the codec pre-filtering, and avoiding the DCT coding is all to the good. :)

Personally, I'm not a big resolution seeker. Don't get me wrong. I like the ability to shoot more clear detail, but I'm more into bit depth, dynamic range, nice grading, and good grain texture than the really fine stuff. There are a lot of great looking older films and photos our there that aren't particularly sharp. However, if I shot documentaries and nature footage, I'd be all over high resolution!

BTW, taking a close look at low ISO 5D2 RAW crop footage graded to ridiculous extremes, the grain looks amazingly good and filmic. As it falls apart at the limits, it does so gracefully. I think that's due to the high bit depth. Rather than the noise being on or off, blocky, and splotchy, it has a smoothness and grace about it that one doesn't usually associate with digital video. (This was with DNG processing in After Effects.)

Yes, I'd like more resolution, but getting this value out of my five year old camera is amazing. :)

Chris Barcellos June 23rd, 2013 02:39 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Quote:

Originally Posted by Alister Chapman (Post 1801608)
You mean 78MB/s not Mb/s.

Trouble is though you still need to get up to around 2.3k/2.4k of bayer pixels to achieve HD resolution and that means around 70% more data than your recording at the moment. 1880x864 of raw bayer data falls well short of HD.

Does'nt matter if your competing image is coming out of same box (5d2). if you can grade and uprez to a much more pleasing image, you are ahead of the game.

Ted Ramasola June 26th, 2013 01:58 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Ok, for those with a 5D2 using NB after jun 16th and are having problems in crop mode, specifically pinkish cast image with low black levels.

a.d. has made a new fix which you can download here: https://bitbucket.org/a_d_/laboratory/wiki/Home

I tested this repeatedly in several resolutions in crop mode and pink cast is gone.

Take note that this fix will cause some "bad pixel" problems in SOME cameras in raw video mode. Like this one;

RAW recording 5D2 recent NB produces 'bad pixels' (not with .H264 output)

This does not show up when using h264 video.

My camera however don't have bad pixel issues with raw video so I use the fix provided by a.d.

Ted Ramasola June 27th, 2013 10:09 PM

Significant improvement with Jun 27 build ML raw video
 
With build dated Jun 27, ML developers have made significant progress allocating memory and increasing significantly the recording duration for RAW video.

On the 5D mkII new higher resolutions are now capable of recording continuously with a 1000x cf card. Performance have also improved on slower cards such as 600X.

Below are test results based on a 1000x lexar. FPS=23.976

At 1X

Resolution-------Number of frames

1872 x 1054-------1058
1872 x 1012-------4686
1872 x 936--------continuous
1872 x 850--------continuous
1856 x 1044-------2378
1856 x 928--------continuous
1728 x 972--------continuous
1472 x 1104-------continuous

Crop Mode 3X (5x magnify)

2144 x 1076-------371
2144 x 1072-------370
2144 x 974--------947
1920 x 1076-------1326
1856 x 1044-------continuous
1728 x 972---------continuous

..

Murray Christian June 27th, 2013 11:32 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
I know they're probably wanting to get things to a certain point before they branch out to different models. But is there some insider talk on how this might work with some of the crop sensor range?
Just curious if they've tried it for even a moment.

Ted Ramasola June 27th, 2013 11:36 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Murray,

Most crop sensors that can run ML can do Raw video though limited. What particular models are you interested in, I'll try to retrieve some information from ML and transfer it here.

EDIT:

Among the crop sensor canons, the old 50D is performing well, I saw testers getting 1584x1058 and 1584x894 continuous and recording 2000х1080 in crop mode.

Murray Christian June 28th, 2013 11:02 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Cheers Ted

I've got a 60D myself. I can think of a few 7D owners who'd be curious too (it's also interesting to see if its weird architecture throws up any more problems for them in this area)

Ted Ramasola June 28th, 2013 12:39 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
There is some progress with the 60D.

The 7D is in more dire straits due to the dual digic. Its running in alpha ML but sadly no raw video.

I myself have a 7D and as days goes by I'm thinking of letting it go or giving it to my son. :)

Ted Ramasola June 28th, 2013 03:03 PM

for 30P recording with 5D2
 
For 5D2 users looking at how the 30P recording has improved with jun 27 "small hacks" build.

Resolutions --No of frames@30P
1872 x 1054 --237
1872 x 1012 --312
1872 x 936 ---460
1872 x 850 ---770
1856 x 1044 --287
1856 x 928 ---489
1728 x 972 ---650
1728 x 864 ---3338
1472 x 1104 --701
1472 x 828 ---continuous
1600 x 900 ---continuous

Crop mode 3x
2144 x 1076 --132
2144 x 1072 --158
2144 x 974 ---213
1920 x 1076 --235
1856 x 1044 --294
1728 x 972 ---476
1600 x 900 ---continuous
1472 x 828 ---continuous


The highest res for continuous recording has indeed increased. Previous NB it was only at 1472x828 for 30P Now its at 1600x900.

John Benton July 16th, 2013 08:26 PM

Magic Lantern Improves 5D Mark III Dynamic Range to 14 Stops
 
Magic Lantern Improves 5D Mark III Dynamic Range to 14 Stops

5DMk3 : Video
7D : Stills only

Dual ISO - massive dynamic range improvement for 5D3 and 7D

Ted Ramasola July 25th, 2013 12:29 PM

FOR MKII DO NOT USE a128gig 1000x or 1050x UDMA7 CF card for Magic Lantern
 
Just want to update 5D mkII users that for now DO NOT USE a128gig 1000x or 1050x UDMA7 CF card for Magic Lantern.

Tests I have been doing with techsupport from Komputerbay shows us that the 5DmkII

can accept the fast cards ONLY WHEN USING CANON FIRMWARE and for shooting stills and H264 .MOV files.

BUT the card CANNOT BE USE TO UPDATE FIRMWARE, even the firmware from Canon can't be "seen" by the 5D mkII

also MAGIC LANTERN FIRMWARE CANNOT BE "SEEN" BY THE 5dMKII, even if you use EOScard to make it bootable.

So far we are doing the tests using Komputerbay 128 gig 1000x and 1050x cf cards,

If you are using a 128 gig on the mkII + Magic Lantern please share if its 1000x or less, also if its UDMA7 or less.

Ted Ramasola August 10th, 2013 12:13 AM

Re: Magic Lantern Improves 5D Mark III Dynamic Range to 14 Stops
 
Quote:

Originally Posted by John Benton (Post 1804966)
Magic Lantern Improves 5D Mark III Dynamic Range to 14 Stops

5DMk3 : Video
7D : Stills only

Dual ISO - massive dynamic range improvement for 5D3 and 7D

New update:

Dual ISO module has been ported to the 5DmkII. Photo mode.

John Benton August 10th, 2013 09:20 AM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
Nice ! Thanks for the update
J

Ted Ramasola August 10th, 2013 02:24 PM

Re: Magic Lantern unlocks Canon 5D to shoot 14 bit raw via liveview
 
7D now recording RAW video continuously no longer in bursts. :)

Testing first versions of raw_rec module now.


All times are GMT -6. The time now is 01:50 AM.

DV Info Net -- Real Names, Real People, Real Info!
1998-2025 The Digital Video Information Network