View Full Version : Best RAID for my needs. Please Help!


Rani Korkise
February 17th, 2010, 09:01 AM
Hi all great and helpful members!

I've been searching for quiet a long time to try and get my head around this raid thing, but there is too much info that don't exactly help me decide what "I" need, so I apologize for posting yet another thread about "Best Raid" topic!

We are a wedding production company in Sydney, We shoot mainly in SD but trying to move to HDV only, so far its been every machine for itself so we thought to improve work-flow to increase:
1 - Efficiency: all computers can access any wedding to for editing and encoding etc.
2 - Backup. I'm sure we've all been there when finished weddings get lost before finalizing.

So my questions are: (Bare in mind we need about 4-5 TB of space in total for all workstations excluding any backup space, & budget wise we're trying to stay under 2k).
Our estimated budget came from checking out ready built systems.

1 - Considering 4-5 machines editing and/or encoding HDV for DVD at the same time, what's the minimum throughput speed I need the raid to have and which raid system would you recommend i.e Lacie, Western Digital, Buffalo, Seagate, Iomega or G-Technology (8TB Raids (http://www.bhphotovideo.com/c/search?Ntt=8TB+Raids&N=0&Ns=p_PRICE_2|0)) or any other you care to share?
2 - Would you recommend we buy a system or build our own. If build, what specs/hardware?
3 - What type of raid would best suit us? E.I raid 5,6,10?


Finally, thank you so much in advance for helping me sort this dilemma!
Edit: Guys, please don't hijack the thread? :)

Harm Millaard
February 17th, 2010, 11:55 AM
Pretty generic, but maybe helpful: Adobe Forums: To RAID or not to RAID, that is the... (http://forums.adobe.com/thread/525263)

Stephen Knapp
February 17th, 2010, 01:58 PM
Very impressive article Harm! Thanks for pointing to it. I was impressed not only by the substance of the main article, but also the discussion and tips that followed.

My question is derived from that discussion, using the basic configuration you recommended to KLFI as the starting point. Let us say you were going to expand parts of that setup into the use of arrays.

C: would do well to be in a Raid 1
D: what do you think of the use of a pair of 150 Gb raptor drives in a raid 0 for this?
E: is this where you would use the Areca controlled Raid 3? With how many 1Tb drives?
F: How much capacity is needed here for maximum system utility?

I am not sure how you would make use of a 12 drive Raid 30 array in an editing setup. Can you help me expand my vision through understanding?

Harm Millaard
February 17th, 2010, 04:04 PM
A couple of basic assumptions that you started out with: 4-5 computers, a $ 2K- budget and 5 TB required space (total or for each workstation?). Now these factors combined make it challenging to say the least if not impossible, because Adobe does not work nicely off network drives.

I don't know what switches are in use nor what storage capacity you currently have that can be reused, nor if each workstation has dual NIC's. What is the degree to which each workstation needs to access the same files/clips possibly at the same time? Do you already use a NAS and if so, is it iSCSI?

If you can give those details, maybe someone here can come up with a brilliant idea.

Harm Millaard
February 17th, 2010, 04:29 PM
C: would do well to be in a Raid 1
D: what do you think of the use of a pair of 150 Gb raptor drives in a raid 0 for this?
E: is this where you would use the Areca controlled Raid 3? With how many 1Tb drives?
F: How much capacity is needed here for maximum system utility?


C: a Raid1 would protect you from a disk failure and possibly increase performance by a tiny bit. Cost: one extra disk per workstation. Advantage: No need for backing up each work station. I would use a Velociraptor as a boot disk. SSD's have not yet proven to have any advantage over conventional disks in video editing.

D: Good idea, but keep the costs in mind.

E: The Areca controller is not exactly cheap. The one I have is around $ 1,200, including BBM and cache. If you want around 5 TB effective storage space, I would suggest 7 disks of 1 TB in a raid3, of which one as hot-spare, so you have 5 TB net space and are safeguarded against 2 disk failures in that array. The alternative is a 7 disk raid6, but it is not quite as fast as a raid3, even though with those arrays the difference will not mean much in performance.

F: I'm not quite sure what you mean by this.

On my system, which is not exactly run-of-the-mill, I found that I get best performance with all my temp files on my D drive (2 x 1 TB Raid0) and everything project related on my main array (E: 12 x 1 TB Raid30).

Rani Korkise
February 17th, 2010, 09:24 PM
First of all Harm I want to congratulate you on an awesome article! I'll be sure to go through it thoroughly to get a better Idea about raid systems especially to the fact it being a very recent article.

A couple of basic assumptions that you started out with: 4-5 computers, a $ 2K- budget and 5 TB required space (total or for each workstation?).

I'm sorry for not clarifying that, yes 5TB total space needed for the 4-5 workstations :)
My budget estimates came from checking on already built raids (8TB Raids (http://www.bhphotovideo.com/c/search?Ntt=8TB+Raids&N=0&Ns=p_PRICE_2|0))


Now these factors combined make it challenging to say the least if not impossible, because Adobe does not work nicely off network drives.

We currently work on premiere one 3 machines, another has edius & another coming with FCP...

I don't know what switches are in use nor what storage capacity you currently have that can be reused, nor if each workstation has dual NIC's.
I'm sorry for being a newbie about this but I don't know what switches or NIC's are, I hope this clears it up: All I can tell you that the workstations are standard desktops with normal connections. As for reusable storage, I doubt we have any HDD's we'd like to reuse because they've all been through rough seas in the last 1-2 yrs and may give up anytime soon, The newest being 1TB and the rest 500GB, (The newest = 1.5+ yrs). So let's assume I have to start from scratch...

What is the degree to which each workstation needs to access the same files/clips possibly at the same time? Do you already use a NAS and if so, is it iSCSI?

Good question. It is a minimal degree that more than one workstation will be using the same files... As for NAS, I don't know what that is, and I'm pretty sure that if we used it I would've known what it is...

Hope this gives you a better idea.
Thank you once again!

Harm Millaard
February 18th, 2010, 11:49 AM
Rani,

Your answers cleared up a lot. The LaCie unit may serve you well, even when LaCie does not have a stellar reputation. LaCie | 8TB 4big Quadra External Hard Drive RAID Array | 301435U (http://www.bhphotovideo.com/c/product/624484-REG/LaCie_301435U_8TB_4big_Quadra_External.html#specifications)

It is one of the few units that fit in your indicated budget and that has the required eSATA connector and has hot-swappable bays and has raid3 support. All of the key ingredients I would look at. And most importantly, it is easy for you to install, because if you don't know about switches and NIC's, we better keep it in the KISS realm.

I hope this helps you.

Steve Kalle
February 20th, 2010, 01:56 AM
I highly recommend using iSCSI instead of regular network shares due to: 1) much better connection reliablility (so you don't have to reboot computers and/or routers/switches) and 2) faster transfer speeds between workstations and file server 3) iSCSI 'network' drives show as an attached drive on each workstation so the OS and programs treat it as one - this gets past Premiere's poor network share performance 5) no need to be connected to a workstation - connects to a switch/router

One of the best iSCSI Raid solutions is this from Enhance. Supports Raid 3, 5, 6, 30...
Newegg.com - Enhance Technology T8 IP iSCSI-to-SATA Desktop RAID Storage - Server RAID Systems (http://www.newegg.com/Product/Product.aspx?Item=N82E16816201038)

Here is a benchmark - 1st is with only 1 NIC and 2nd is with 2 NICs/Teaming enabled(MPIO)
EnhanceRAID RS8 IP (iSCSI) Benchmark (http://www.enhance-tech.com/products/ultrastor/RS8ip_benchmark.html)

The first few paragraphs explain iSCSI a bit better.
Maximo PC (http://www.enhance-tech.com/product_review/iSCSI_SANs_Compared.html)

The cost will be a bit more than $2k but will provide far better performance and far better reliability.

The other parts to get are the NICs for each workstation. You can either get 1 or 2 for each depending on your budget and performance needs.

Newegg.com - Intel PILA8460M 10/ 100Mbps PCI PRO/100 M Desktop Adapter 1 x RJ45 - Network Interface Cards (http://www.newegg.com/Product/Product.aspx?Item=N82E16833106022)
Newegg.com - Intel PWLA8391GT 10/ 100/ 1000Mbps PCI PRO/1000 GT Desktop Adapter 1 x RJ45 - Network Interface Cards (http://www.newegg.com/Product/Product.aspx?Item=N82E16833106121)

And a 'Gigabit' switch : Newegg.com - D-Link DGS-2208 10/100/1000Mbps 8-Port Desktop Green Ethernet Switch 8 x RJ45 8K MAC Address Table 144KB per Device Packet Buffer Memory Buffer Memory - Switches (http://www.newegg.com/Product/Product.aspx?Item=N82E16833127082)
This is the fastest switch I have used.

These Samsung 1TB drives, if you can find them in stock.
Newegg.com - SAMSUNG Spinpoint F3 HD103SJ 1TB 7200 RPM 32MB Cache SATA 3.0Gb/s 3.5" Internal Hard Drive -Bare Drive (http://www.newegg.com/Product/Product.aspx?Item=N82E16822152185)

Hope I haven't confused you too much.

PS If you need this data to be accessed by all computers, then that Lacie does not work as well because the connection to the other computers is totally reliant on the computer its connected to. Furthermore, multiple computers accessing the Lacie will create a bottleneck and greatly reduce performance because there is only one ethernet/network connection to handle all the data.

Rani Korkise
February 20th, 2010, 09:55 PM
Hi Guys. First of all I wanted to thank you for your great and helpful advice.
Things have changed, I have a friend that is an IT senior engineer, so don't worry about me purchasing/config switches or routers, He can do all that.

Harm: I just realized that the LaCie | 8TB 4big Quadra External Hard Drive RAID Array | 301435U (http://www.bhphotovideo.com/c/product/624484-REG/LaCie_301435U_8TB_4big_Quadra_External.html#specifications) has no NIC, We don't think it would be able to handle multiple workstations unless its done by different connection e.g FW/USB, which then creates a bottleneck and we will be expanding our workstations to 6+ in the near future. :)
Hence our point of view is that unit does not meet our requirements?


Steve: I highly recommend using iSCSI instead of regular network shares due to: 1) much better connection reliability (so you don't have to reboot computers and/or routers/switches) 5) no need to be connected to a workstation - connects to a switch/router

1- What do you mean by more reliability in terms of restarting hardware e.g computers and/or routers/switches.
2 - Even though the unit you recommended has only 2GbE Ports, does that mean I can have a switch/router connected to one of these ports so I can connect more workstations depending on the size of the switch/router and if so would it still be able to cater the throughput needed for at least 5 workstations editing/encoding HDV?


We think its best that we stick to a network solution as it will support our future growth? Plus the performance is much better compare to other connections unless you have a better idea...

Thanks in advance!

Steve Kalle
February 21st, 2010, 01:58 AM
1) I have found that the typical network sharing has issues with workstations losing connection with the sharing computer, which can be caused by different operating systems and/or routers & switches, just to name a few causes. This leads to people rebooting computers and/or routers/switches. iSCSI is more reliable due to its architecture, mainly being SCSI over IP.

2) With the 2 Gbe ports, you have several choices in how they are used: ie., connecting both ports to an 8 port switch, these 2 ports can distribute the bandwidth from the file server to the workstations. For optimum performance, I would either: 1) divide the 8 drives and separate the encoding to its own set of drives or 2) keep the encoding output local to each workstation and transfer the files once encoding is finished.

Another performance option is installing 2 of those Intel NICs in each workstation and 'Team' or Bond them. This will allow full bandwidth for each workstation, which is a bit over 200MB/s to that Enhance iSCSI I linked to. However, having 2 ethernet connections from each workstation requires another switch to be added (so, +$45).

Oh yeah, you want Cat 6 cable for optimum speed/bandwidth; although, I have used quality Cat 5e and reached very good speeds.

And for future expansion: it will be as simple as connecting to the switch and setup the iSCSI on the new computer plus adding 1-2 Intel NICs. (the Intel NICs are far better than any onboard/built in NICs)

If you choose this path, the next aspect to discuss is the best Raid setup to use, which depends on how you will use the SAN/File server and the number of drives you get.

Just to begin, I really like the Samsung F3 1TB because 1) its the fastest and 2) the reliability seems to be outstanding according to the newegg ratings - if there are many people with bad drives, they will score accordingly, and this drive has gotten better scores than all others. I have been a Seagate fan (I have 8 of their 7200.12 1TB drives and 7 1-2yr older drives) but I am looking to add 4-6 Samsung F3's.

Rani Korkise
March 11th, 2010, 07:37 AM
Hi Steve.

First of all I would like to apologize for taking long to reply to your great post, been waiting to get together with my friend to type the following questions.

1 - What recommendations on which path to take in choosing switch, smart switch or a router? and why?

2 - What level of RAID would you recommend? From what we gathered wouldn't a RAID10 be the most suitable? If you suggest other type of raid, please explain why.

3 - Since EnhanceRAID T8 IP Desktop RAID 6 Desktop Storage System (http://www.enhance-tech.com/products/desktop/t8_ip.html#Tab1) is what you strongly recommend, we checked at the manufacturers website, they only seem to recommend/support Hitachi, Seagate Barracuda and Maxtor Diamond MAX HDD's. The Samsung F3 1TB doesn't seem to be supported?

4 - In terms of expansion: The system has only 8 trays and supports HDD's upto 1.5TB's so after RAID will give me a total of 6TB available for storage, what if we will require to add more or larger HDD's? Buy another system?

5 - Most importantly, now that I'm interested in buying the Enhance T8, I can't seem to find it anywhere else, not on newegg, enhance-tech.com or their suppliers... Are there other systems that are similar in performance/reliability and hopefully around the same price range?

Once again, thank you for your kind and great help!

Steve Kalle
March 13th, 2010, 02:00 AM
1) For link aggregation (aka bonding/teaming) to work, the switch must be capable which requires a smart or managed switch, so this Newegg.com - NETGEAR GS108T 10/100/1000Mbps Gigabit Smart Switch 8 x RJ45 8,000 media access control (MAC) addresses per system MAC Address Table 128 KB embedded memory per unit Buffer Memory - Switches (http://www.newegg.com/Product/Product.aspx?Item=N82E16833122203)
Of the 8 ports, 2 to iSCSI array, 1 to each workstation OR add another switch and 2 gigabit NICs to each workstation.

2) Personally, I like Raid 10 and have used it on my last 3 workstations. However, I don't know if it suits your needs because you lose half your drives.
One idea I have: using 1TB drives, take 6 and put them in Raid 5, giving you 5TB. Then use the last 2 drives in Raid 1 to store the encodes.

3+4) I looked into it and found that the Hitachi and WD 2TB drives are supported. It seems their website isn't updated often enough with new info. Also, Enhance Tech is a technology partner with Seagate and Hitachi. For the money, the Hitachi 2TB drive is only $160-170 and is 7200rpm. Your network connection is the bottleneck so it really doesn't matter how fast the drives are. The only downside to the Hitachis is they use a bit more power and run a little warmer. If there is good airflow, I don't think there would be a problem.

How much space do you need now, and how much do you think will be added within a year?

5) There is this: Newegg.com - Enhance Technology R8 IP 2U 8-Drive iSCSI-to-SATA RAID Storage System - Server RAID Systems (http://www.newegg.com/Product/Product.aspx?Item=N82E16816201022) Its the rackmount version and is identical. You don't need a rack, just a flat surface to sit it on. However, I found the T8 IP on pcmall.com Enhance Technology ENHANCERAID T8 IP SYSTEMS FEATURES GIGB T8-IP (http://www.pcmall.com/p/product~dpno~7504278~pdp.egeigbd;jsessionid=FC37AA4C343AE38E341E1DFE25E3D24D)

I have researched the Thecus N8800Pro, which is another iSCSI/NAS but it uses different file systems: ZFS, XFS & ext3. From what I have read, XFS would need to be used due to various reasons. There is also the N8800 and N7700Pro. I like the N8800 because it has 2 PCI-e x1 slots to add 2 more Intel Gbe NICs, which should increase performance if needed.

Paul Mailath
March 13th, 2010, 09:17 AM
I'm looking at using 3 1.5tb drives in a raid 5 for project storage - each wedding gets dumped and is secure until it's ready for editing.

I'm setting up 2 1tb drives in a raid 0 and active projects get moved to this raid while I'm working on them.

Archived projects get moved to separate drives in another computer at the other end of the house.

operating system & programs are on their own 1tb drive

Jarred Capellman
March 20th, 2010, 09:46 AM
I built a Athlon X2 4gb ram system in a 4U Rackmount case to house my 6 1.5TB Seagates in RAID 10 (aka RAID 1+0) last year. For connectivity I did as many have suggested and bonded 2 Intel gigabit cards, providing over 200mb/sec sustained, which is still the bottleneck from a read perspective as the array gets over 400mb/sec read sustained, even more if the data is in the raid controller's memory. I went with the 8 channel Highpoint RocketRaid 4320 as they are daisy chainable to 128 drives and was 50% off last Spring during a promo. For an OS drive I just bought an 80gb WD Scorpio Blue laptop drive, since the OS drive is rarely hit and the 2.5" drives use less power.

I didn't see it mentioned in this thread, but be sure to enable Jumbo Frames on your NICs, larger file transfers benefit from it immensely. Also if possible use Windows 2008 R2 for the file server and Windows 7 for the workstations, the rewrite of the network stack in the Windows 7/2008 R2 Kernel is much improved over XP/Vista.

Tim Kolb
March 23rd, 2010, 10:41 AM
I'll also add my compliments to Harm on a very solid article.

One thing he wrote on the bottom hasn't been addressed yet (or I missed it) and that's an uninterruptible power supply...a battery backup.

I have dual power supplies on my array and have a UPS for each side. One thing you need to look at is the power output FROM BATTERY. These things typically have a maximum load spec for when they're simply conveying/filtering shore power and a separate and always LOWER maximum load when running from the battery.

Dedicated Arrays use some juice, and a battery backup that kicks in and supplies inadequate power could damage your system worse than a clean power interruption would.

For this thread, networked storage may or may not be a good solution. It will certainly be more expense and potentially a bigger headache for someone who is trying to edit and isn't stimulated by computer networking issues... Granted, once it's set up it should run, but without IT experience (and even pretty savvy IT guys are typically a little out of their element when they see what we need to pull through a network in sustained data rate), troubleshooting will bring your whole facility to its knees if all edit systems are using a central network storage system for media.

My recommendation would be to get a reasonable, inexpensive RAID system for each station, as was suggested. (removable drives are always a plus) If one drive system has a problem, the other stations are still running... You don't have a single-system glitch that takes your whole office dark.

You could still have a network and get an inexpensive, self-contained, network attached storage drive for standard resources like graphics and music libraries and anything else that each station may need centralized access to...but I think that media local to the workstations is a better way to manage risk. Keeping a given wedding on a given disk seems like a pretty simple way to keep files straight. Encoding for DVD/BluRay will typically not tax disk throughput as the processing takes time and you could easily have an encoding station set up that you take the drive to, connect it and start the encode...

It's not sexy, but with very little effort, you could probably gain redundancy and project delineation by using self-contained portable disks as master backups for each project as you edit them on a small RAID system on the edit station.

Also, keep in mind that you're planning on editing HDV...it's the same datarate as DV. You'll still need about 12GB/hour to store it and about the same drive bandwidth to play it out. What you'll need is bigger processors to encode/decode it. It's a bigger task than editing DV in that sense.

Faster drives are always good...don't misunderstand me, but I think your potential for growth may not be as hobbled as you think with self-contained or local drives/RAID media storage if you create a system for tracking files and backing up.

...just a devil's advocate angle on the discussion.

Rani Korkise
March 25th, 2010, 04:12 AM
First of all thank you all so much for your contributions and efforts in helping me find a solution.

Steve:
1 - Forgive my ignorance, but do the hdd's need to be the same brand/model/capacity/cashe/rpm? Because I'm thinking of "buy as you go" by the time I need extra HDD's what if the HDD's I've already used in the system are discontinued and I can't get the exact same HDD's?

2 - So the cost isn't a big lump sum, would we be able to start the NAS with 2 HDDs and add more to the RAID10 when needed? Is it a simple or tricky procedure?

3 - I did not find any good HDD comparison sites so please which sites do you use...

4 - From what I found the Hitachi HDD's look promising but don't have good reviews or benchmarks compared to other 2TB HDD's (Charts, benchmarks 2009 3.5? Desktop Hard Drive Charts, h2benchw 3.12: Avg Read Throughput (http://www.tomshardware.com/charts/2009-3.5-desktop-hard-drive-charts/h2benchw-3.12-Avg-Read-Throughput,1010.html)).
On the other hand. Also I have noticed people tend to stay away from "green" HDD's as it uses a different spindle technology and and reduces performance.
What would you recommend to be the cheapest 2TB that is still safe and fast enough for the system? (Please try to specify model numbers)

5 - Unfortunately Newegg does not ship outside the U.S and I'm in the land of OZ... Amazon seems to have very competetive prices but judging by the reviews I'm not going to risk getting ripped off and cheated... Any good price websites you recommend apart from bhphotovideo?

6 - I found the N7700 at Thecus N7700 7 Bay NAS Storage (http://www.eaegis.com/thecusn77007bay.aspx) for about $900 which is a significant difference from the T8.
I'm confused about N7700, N7700PRO, N8800 and N8800PRO! You can run a comparison on all thecus products at Thecus NAS Comparison (http://www.thecus.com/comparison.php?set_language=english) can you please clarify the main differences there that won't be good enough for my needs apart from the amount of HDD bays? (I'm thinking of buying 2TB HDD's to make up the difference in capacity to save the money.)

I need to know if the performance advantages of each system is worth the price difference (performance to price ratio).
So in short, Which is the best value for money NAS that would give me great benefits over the other?


Jarred:
Thank you for pointing out the Jumbo Frames, I'll be looking into that. According to (Network Connectivity — Which adapters support Jumbo Frames? (http://www.intel.com/support/network/sb/cs-001911.htm)) looks like the NIC's Steve recommended do support Jumbo Frames so that's a bonus!

OS is a major player, currently all our workstations are on XP. Would changing to windows 7 offer any advantage over XP with my intended setup (NAS)?


Tim:
Thank you for your input! For yrs and yrs we have been working with external HDD's for each working machine, our goal is not mainly for redundancy, but for the convenience of each editor being able to access any wedding from any machine, or 2 or more editors working on the same project simultaneously... It's inconvenient if you want to encode or capture a certain wedding on a certain HDD but not being able to do so because that HDD is being used by the editor for a different wedding and having to wait for them to finish work for us to get what we need...

In terms of troubleshooting, we hope there won't be much of that and I'm fortunate enough to have best friend that lives close by who is I.T savvy and is an actual I.T engineer for a company, so fingers crossed, this will be a good trial for us in the direction of server/nas.

However you have raised a couple of valuable points I never thought of before.

1 - Thanks to Harm's article: BUY A UPS! Thankfully they're not too pricey...

In your point of views: Let's say the NAS gives up one day while still under warranty, would the company provide us with a courtesy NAS to work on while our one is getting repaired? If not, what would you recommend to have when the S**t hits the fan one day and the NAS eventually dies?

Once again thank you all so much (Especially Steve for seeing this through all the way), and I'm sorry if I'm pushing my luck and being too greedy for info. I'm sure you know how frustrating all this can be.

Steve Kalle
March 25th, 2010, 12:49 PM
1) Yes, the drives should all be identical. You can find new drives for 2-3 years after first being released. Major OEMs (Dell, HP..) stock large amounts of drives for this reason.

Another option is to take those 'old' drives and use them as backup drives when you decide to upgrade/expand. By that time, 2TB drives will be cheap and 3TB and 4TB drives will be available.

2) Raid 10 requires a minimum of 4 drives - did you mean Raid 1 for the 2 drives? To your question, yes, you can add drives later to expand from Raid 1 to Raid 10 or from a 4 drive Raid 10 to a 6 or 8 drive Raid 10.

3) I use tomshardware.com. Here are links for 2 reviews of several drives.
Benchmark Results: Power Consumption : High-Capacity Business Hard Drives: Biggest Of The Bunch (http://www.tomshardware.com/reviews/2tb-hdd-energy,2371-11.html)
Power Consumption And Efficiency : Three New Desktop Hard Drives For 2010 (http://www.tomshardware.com/reviews/HDD-6Gbit,2528-10.html)

4) The Hitachi 2TB drives sacrifice some performance in order to remain inexpensive by using existing drive tech rather than using something brand new, which would drive the cost up. However, the network connection will be the limiting factor. A 4 drive Raid 10 with these Hitachi's will completely saturate 2 bonded gigabit NICs.

5) Other sites: zipzoomfly.com (don't know about AU), mwave.com.au, I have had good experiences with Dell - contact their business sales and they discount prices. The Dell rep I use in the US discounts prices without me even asking plus they might have good financing deals.

6) The N7700 is the best price to performance. The 'Pro' versions have the ability to add a 10Gbe card and have 'Dual DOM' - maybe your IT pal can explain the benefits of Dual DOM.

To your question about warranty and what happens when something breaks: you have 2 options for maximum uptime: 1) purchase a 2nd unit and use it for something like backups. If the main unit dies, you can move the drives to the 2nd unit. Option 2 is building a server with off-the-shelf parts that can be easily replaced. However, this is more complicated and can cost nearly what 2 N7700 units cost.

Rani Korkise
September 20th, 2010, 02:05 AM
Hey Steve!

Thanks for your reply and I'm sorry for my delay, the last few months have been very hectic for me. Finally have the time now to put the concentration back on a NAS.

Reviewing the prices of the HDD's we spoke about, the Hitachi Ultrastar HUA722020ALA330 has not changed much in price at all. It is still around the $300AU... http://www.hitachigst.com/tech/techlib.nsf/techdocs/5EDA5472B7792D9D8625760A0003E88B/$file/UltraStarA7K2000_datasheet.pdf

However, The WD Caviar Black WD2001FASS is around $200AU... Western Digital Caviar Black 2TB (WD2001FASS) : 500GB Per Platter: Three Next-Gen 7,200 RPM Hard Drives (http://www.tomshardware.com/reviews/2tb-hdd-7200,2430-3.html)

Since they both come with 5 Yr warranty and both are one of the top generation in their manufacturers... I think they should both be close in performance/life?
The price is what's very different though and since I'm buying around 8 HDD's I think that's a significant difference...

Or even http://www.newegg.com/Product/Product.aspx?Item=N82E16822145298 which is only $150AU...

I could really use your experienced input as I'm running in circles here. Even if you know of a good alternative please suggest it.

Thank you very much!

Steve Kalle
September 20th, 2010, 04:52 PM
The Hitachi 'Deskstar' 2TB is perfectly fine. However, stay away from any WD Caviar Black (and Caviar Blue) because they have an inherent design flaw and don't work well in Raid.

Rani Korkise
September 21st, 2010, 09:15 AM
You're a Champion Steve!

You just halved my originally considered cost ($300ea)! Thank you very much!

Mike Calla
September 21st, 2010, 11:07 AM
just to quickly add i have a hardware Caldigit raid which i spent big bucks on - -BUT recently on the advice of storage forum moderator i built a windows software RAID with 5 drives, in RAID0 (back up is on a another drive plus master copies and transcoded copies on another two drives, all on a removable esata i/o docking bay)

my scratch disk is SSD.

Its fast enough for three streams of uncompressed HD and i couldn't be happier.
Best thing is i have another machine as a back up - if this machine goes belly up i can pop in my software raid drives with out a hitch. Something I can't do that easily on my Caldigit machine...which i found out the hard way!

And coping back ups is faster than RAID5 rebuilding itself.

And it was helluva lot cheaper than my caldigit! A LOT CHEAPER!

PS even two drives worked with one stream of HD

Steve Kalle
September 21st, 2010, 09:25 PM
Have you decided on which NAS unit you will get?

To answer a prior question, Windows 7 makes a huge difference in network transfer speed compared to XP.

Rani Korkise
September 24th, 2010, 10:46 AM
Hey Steve,

I wanted to reach a final decision about the smart switch/managed switch.
You have so far pasted two links of what you like:
Newegg.com - NETGEAR GS108T-100NAS 10/100/1000Mbps Gigabit Smart Switch 8 x RJ45 8,000 media access control (MAC) addresses per system MAC Address Table 128 KB embedded memory per unit Buffer Memory (http://www.newegg.com/Product/Product.aspx?Item=N82E16833122203)
Newegg.com - D-Link DGS-2208 10/100/1000Mbps 8-Port Desktop Green Ethernet Switch 8 x RJ45 8K MAC Address Table 144KB per Device Packet Buffer Memory Buffer Memory (http://www.newegg.com/Product/Product.aspx?Item=N82E16833127082)
The NETGEAR GS108T is a little cheaper.
Our situation at the moment is 2 editors using macbook pro's that are within a yr old. Their NIC's are OEM. I'm also in the process of purchasing a Mac Pro to do all the processing/capturing etc for the other two machines. So which one should I decide on? Or is there something you recommend even more now days?

Unfortunately the friend that was supposed to help me with all this has gone overseas for the next few months and I wonder how I'd be able to set the connections/config of the switch myself. Too many things like snmp, link aggregation, vlans, stp, port mirroring, port auth, jumbo frames. It's already lost me! Is there any easy way of doing any of this?

Thank you!

Steve Kalle
September 24th, 2010, 11:07 AM
Well, this is all very good timing because I have been looking into a SAN and NAS so I have learned a few things, including a misconception on my part.

I was wrong about link aggregation/bonding - it does not increase total speed for a SINGLE connection. So, you cannot take 4 1Gb ports and get more than 120MB/s to any single computer. However, for multiple computers accessing the server at the same time, bonding does help.

Are you all Apple? If so, there is some good news: Apple's 'AFP' apparently works great as a NAS protocol and requires little setup on your part.

Ooops, I just read your earlier posts and you are both PC & Mac so AFP won't work.

Yes, there is an easy way of doing it: pay someone $20,000 for a turnkey solution :p

Get the Netgear - I have this switch now.

I can promise that some will say this: 1) get Smalltree NICs for Mac Pro's 2) pay $20k for a turnkey solution.

Something else I just remembered from my recent research: if using iSCSI, you must see if the server uses 'Volume Level' or 'File Level' sharing. With Volume level, each computer has its own volume on the server and no 2 computers can access the same volume. File level is having a single volume for all computers to share. Many inexpensive server solutions use volume level to prevent corrupted files but some do use File level. Many $20k solutions use File level and implement a Metadata tracking system that lets 2 people open the same Premiere (or FCP) project, edit at the same time and save both editor's projects as one without overwriting any project data.

Steve Kalle
September 24th, 2010, 12:27 PM
FYI, Enhance Tech sells their base product through other companies including Proavio and Thecus.

Because you have both PC & Mac, your only options are iSCSI or SneakerNet - this means downloading data to each computer and/or moving drives around and attaching to each computer.

Over at the Cow, someone has been able to get either the 8 or 16bay Enhance to work.

Rani Korkise
September 26th, 2010, 03:25 AM
Damn it! This changes everything!
Thanks for pointing these things out! Now how can we know if the N7700 HAS "File Level" capabilities

The damn Small tree NIC looks real good but I don't think there's anyway to fit it on the laptops :)

By the way, the 2 editors ATM are both on macbooks so I guess we can use Apple's 'AFP' ATM and if anything changes in the future we can change protocol's then right?

Many $20k solutions use File level and implement a Metadata tracking system that lets 2 people open the same Premiere (or FCP) project, edit at the same time and save both editor's projects as one without overwriting any project data.

That would be perfect! Some projects (like same day highlights) among many other things would be a piece of cake we could get two or more editors working on it at the same time. Can I implement something like this kind of metadata tracking system?

Because you have both PC & Mac, your only options are iSCSI or SneakerNet - this means downloading data to each computer and/or moving drives around and attaching to each computer.

Over at the Cow, someone has been able to get either the 8 or 16bay Enhance to work.

Could you elaborate on that please? Are you saying that I would still have to copy the files onto each machine THEN can I work on files? This way there is absolutely no use for me in doing any of this! lol
This goes against any advantages/solutions a NAS solution offers...

P.S Thanks for your prompt reply! :)

Steve Kalle
October 6th, 2010, 09:27 PM
Sorry for the long time to reply.

"By the way, the 2 editors ATM are both on macbooks so I guess we can use Apple's 'AFP' ATM and if anything changes in the future we can change protocol's then right?"

-Yes, just make sure that your NAS device supports AFP and iSCSI.

"Can I implement something like this kind of metadata tracking system?"

-Only the $10,000+ systems include any sort of metadata tracking.

"Could you elaborate on that please? Are you saying that I would still have to copy the files onto each machine THEN can I work on files? This way there is absolutely no use for me in doing any of this! "

-I was referring to 'SneakerNet', which is the cheap way of 'sharing' files by moving external drives around.