Uploading Large Folders Of Footage at DVinfo.net

Go Back   DV Info Net > The Tools of DV and HD Production > Open DV Discussion

Open DV Discussion
For topics which don't fit into any of the other categories.


Reply
 
Thread Tools Search this Thread
Old July 22nd, 2014, 09:59 AM   #1
Regular Crew
 
Join Date: Oct 2013
Location: New Milford NJ
Posts: 56
Uploading Large Folders Of Footage

Hi
What is the best option for transferring footage to clients online other than FTP? I send at least once a week a folder of footage at least 40GB or more to a client (Sony EX1 footage,Tascam,GoPro).

My ISP (Cablevision) seems to traffic shape or throttle the FTP often during the upload. I have a 50/25 connection and the upload often drops to 2Mbit/s from 25Mbit/s for 20 mins or more.

I just gave the Bittorent Sync app a try and it works smoothly but the speed never gets past 10Mbit/s. I think it is because it does not do concurrent connections at this point so it does not make use of the full bandwidth available. A major update of the program is supposed to be released this Summer that may address the speed issues.

When I transfer using FTP I have it set for 5 concurrent connections which saturates myb bandwidth...

Dropbox is fast but I am sending too much data to use that and I would rather have a direct connection rather than a cloud option.

I also signed up for the Amazon Zocalo preview and the upload speed was VERY slow.
Rich Adrion is offline   Reply With Quote
Old July 22nd, 2014, 11:29 AM   #2
Inner Circle
 
Join Date: Feb 2009
Location: Brisbane, Australia
Posts: 2,257
Re: Uploading Large Folders Of Footage

You could always change to Verison FiOS who have just changed their connections to enable the upload speed to match the download speed. Uploads are now faster.

But, really, stick the files on physical media and just overnight it in the post/courier. You can transfer terabytes overnight if you really need to.

Andrew
Andrew Smith is offline   Reply With Quote
Old July 22nd, 2014, 11:40 AM   #3
Inner Circle
 
Join Date: Sep 2002
Location: Vancouver, British Columbia (formerly Winnipeg, Manitoba) Canada
Posts: 4,087
Re: Uploading Large Folders Of Footage

For what it's worth, I use DropBox having purchased 100GB with a 50GB bonus for SOMETHING I did at some point. I have the DropBox folder set as my export target for Compressor (I'm on Mac running Final Cut Studio 3) so when I start my exports, I get to walk away as they automatically upload as export finishes to my client folders.

Very slick for what I do.
__________________
Shaun C. Roemich Road Dog Media - Vancouver, BC - Videographer - Webcaster
www.roaddogmedia.ca Blog: http://roaddogmedia.wordpress.com/
Shaun Roemich is offline   Reply With Quote
Old July 22nd, 2014, 11:43 AM   #4
Regular Crew
 
Join Date: Oct 2013
Location: New Milford NJ
Posts: 56
Re: Uploading Large Folders Of Footage

Unfortunately FIOS is not an option at my apartment complex. My feeling about mailing out drives is this, it is that most people I deal with in video production have a fast broadband connection ( at least 50Mbit/s download) my friend now has a 150/150 with FIOS. It seems silly to incur the shipping cost and risk to damage to the drive as well as having to wait for the person to mail the drive back to you when it can be uploaded in a few hours if you have a fast and steady connection. At 30 Mbit/s it should only take a few hours to upload 40GB as long as the connection is consistent.

My connection is 50/25 --more often than not I see that my upload speed is actually 30 Mbit/s but like I said when I use FTP It seems that I am getting slammed by the ISP, just looking for a good fast alternative to FTP
Rich Adrion is offline   Reply With Quote
Old July 22nd, 2014, 11:47 AM   #5
Regular Crew
 
Join Date: Oct 2013
Location: New Milford NJ
Posts: 56
Re: Uploading Large Folders Of Footage

If the pricing changes for Dropbox (100GB) I might sign up. Amazon is giving you 200GB for $5 a month but they need to do something about the upload speed..I rather just skip the middle man and just find a fast direct solution other than FTP
Rich Adrion is offline   Reply With Quote
Old July 22nd, 2014, 11:53 AM   #6
Major Player
 
Join Date: May 2014
Location: Brandon, England
Posts: 342
Re: Uploading Large Folders Of Footage

It may be worth trying an upload with only 4 connections to see if they throttle that, if they don't it could be quicker overall.

Just a thought.

Dave
Dave Baker is offline   Reply With Quote
Old July 22nd, 2014, 12:11 PM   #7
Regular Crew
 
Join Date: Oct 2013
Location: New Milford NJ
Posts: 56
Re: Uploading Large Folders Of Footage

My understanding is that a single large file upload will get throttled and that providing multiple connections helps avoid that...I could be wrong but that is how I interpreted what I had read in a few articles related to FTP transfers and how ISPs deal with them
Rich Adrion is offline   Reply With Quote
Old July 23rd, 2014, 02:02 AM   #8
Inner Circle
 
Join Date: Feb 2009
Location: Brisbane, Australia
Posts: 2,257
Re: Uploading Large Folders Of Footage

Rather than ship a hard drive, you can burn that data to a dual layer BluRay (50G capacity) and simply send the disc through the mail/courier. Cheap as chips to do.

With ftp, why not try changing the port number that you use? Chances are that the ISP is throttling based on the network port being used for the data stream. Changing to an alternate port might just side step this.

Andrew
Andrew Smith is offline   Reply With Quote
Old July 23rd, 2014, 05:13 AM   #9
Regular Crew
 
Join Date: Oct 2013
Location: New Milford NJ
Posts: 56
Re: Uploading Large Folders Of Footage

You would be surprised at how many people in event video production have never burned a Blu-Ray disk so they don't own a Blu-Ray compatible drive. I know guys who have not even burned a standard DL disk...They just compress the hell out of the footage to make it fit on the disk.

In regards to the FTP port--Port 21 is the default port for FTP and I have mine set to much higher port setting , it does not help unfortunately .

I may need to go this route
Bypass Your ISP's Throttling of Netflix or Other Videos with a VPN
Rich Adrion is offline   Reply With Quote
Old July 23rd, 2014, 07:37 AM   #10
Inner Circle
 
Join Date: Feb 2009
Location: Brisbane, Australia
Posts: 2,257
Re: Uploading Large Folders Of Footage

I think an VPN tunnel would be the next option to try out.

Shame that so many people (with their pretty computers) turn out to be so clueless when it comes to understanding what they are doing.

Andrew
Andrew Smith is offline   Reply With Quote
Old July 23rd, 2014, 09:48 AM   #11
Major Player
 
Join Date: Dec 2005
Posts: 848
Re: Uploading Large Folders Of Footage

Quote:
Originally Posted by Andrew Smith View Post
I think an VPN tunnel would be the next option to try out.

Shame that so many people (with their pretty computers) turn out to be so clueless when it comes to understanding what they are doing.

Andrew
Yes I try to use scp in preference to ftp for file transfers as it appears to be much more stable and I rarely drip a connection. Also, I don't remember the vendor I met at NAB a couple of years ago that had some type of file transfer technology supposedly optimized for speed - not sure how that would work if your data has high randomness/low compressibiliy, will look around and see if I still have the literature.

Found it - http://www.filecatalyst.com/
Jim Michael is offline   Reply With Quote
Old July 24th, 2014, 03:05 AM   #12
Regular Crew
 
Join Date: Oct 2013
Location: New Milford NJ
Posts: 56
Re: Uploading Large Folders Of Footage

Yes I saw File Catalyst but that service is really for large production houses. The cost for the server service is at least $5,000 a year
Rich Adrion is offline   Reply With Quote
Old July 24th, 2014, 03:55 AM   #13
Inner Circle
 
Join Date: Feb 2009
Location: Brisbane, Australia
Posts: 2,257
Re: Uploading Large Folders Of Footage

Much cheaper to purchase an external BluRay drive and just give it to the client.

Andrew
Andrew Smith is offline   Reply With Quote
Old July 30th, 2014, 04:20 PM   #14
Inner Circle
 
Join Date: Aug 2005
Location: Atlanta/USA
Posts: 2,507
Re: Uploading Large Folders Of Footage

Take a look at BitTorrent Sync.

BitTorrent Sync - Get Started on Desktop
__________________
Ervin Farkas, CDVS
Certified Legal Videographer
Ervin Farkas is offline   Reply
Reply

DV Info Net refers all where-to-buy and where-to-rent questions exclusively to these trusted full line dealers and rental houses...

Professional Video
(800) 833-4801
Portland, OR

B&H Photo Video
(866) 521-7381
New York, NY

Z.G.C.
(973) 335-4460
Mountain Lakes, NJ

Abel Cine Tech
(888) 700-4416
N.Y. NY & L.A. CA

Precision Camera
(800) 677-1023
Austin, TX

DV Info Net also encourages you to support local businesses and buy from an authorized dealer in your neighborhood.
  You are here: DV Info Net > The Tools of DV and HD Production > Open DV Discussion

Thread Tools Search this Thread
Search this Thread:

Advanced Search

 



Google
 

All times are GMT -6. The time now is 10:22 PM.


DV Info Net -- Real Names, Real People, Real Info!
1998-2017 The Digital Video Information Network