Software RAID or folder synchronization?

Hey drop us a line about the show. Feel free to ask questions, provide feedback and criticism, or just ramble on about anything your little heart desires.

Moderators: snarkout, Patrick, dann

Post Reply
Tsuroerusu
Posts: 2551
Joined: Mon Sep 05, 2005 8:51 am
Location: Silkeborg, Denmark
Contact:

Software RAID or folder synchronization?

Post by Tsuroerusu » Tue Mar 18, 2008 5:52 pm

Yesterday I ordered two 500 GB drives (One for backup), hopefully I will get them soon. Since there is no option, for me, to use Sun's ZFS file system (Solaris/OpenSolaris does not run, on pretty much anything, without proprietary drivers and components [1], and FreeBSD 7's ZFS port is not ready for production yet, nor is FreeBSD 7.x itself quite ready for production yet, according to what I have heard), I was planning to either write some shell scripts to set up as a cron job, or find some folder synchronization program that would copy any new or changed files to the other drives, and remove deleted ones on a regular basis. However, I was wondering, does anybody in here have any experience with software RAID-1 under GNU/Linux? How well does it work? How reliable is it? Can anybody recommend it?

----------
[1] http://www.opensolaris.org/os/about/no_source/
Image
Image

"Hatred does not cease by hatred, but only by love. This is the eternal rule."
- Siddhattha Gotama (Buddha), founder of Buddhism.

diazamet
Posts: 38
Joined: Thu Feb 21, 2008 7:42 am

Re: Software RAID or folder synchronization?

Post by diazamet » Wed Mar 19, 2008 5:24 am

If you are interested in ZFS, have you looked as Nexenta (http://www.nexenta.org/os)? It's an OS/Distribution that uses the OpenSolaris kernel with the GNU userland tools.

You would just need to check if the drivers you need are opensource or not.

Tsuroerusu
Posts: 2551
Joined: Mon Sep 05, 2005 8:51 am
Location: Silkeborg, Denmark
Contact:

Re: Software RAID or folder synchronization?

Post by Tsuroerusu » Wed Mar 19, 2008 6:14 am

diazamet wrote:If you are interested in ZFS, have you looked as Nexenta (http://www.nexenta.org/os)? It's an OS/Distribution that uses the OpenSolaris kernel with the GNU userland tools.

You would just need to check if the drivers you need are opensource or not.
I have already been looking at that, and even the drivers for a freaking Realtek 10/100 ethernet networking card, and even more astonishingly a generic IDE HBA driver ... are proprietary!! I'm willing to bet that the Linux kernel and all of the BSDs have had this for close to 10 years.

Sadly no Solaris distribution is an option, and FreeBSD's ZFS support so far is just experimental. So ZFS is not an option, which is sad, because it's like THE solution I need. * sigh * , oh well that's life! Maybe things will change in the future, preferably sooner than later.

Thanks for the tip anyway, I appreciate it.
Image
Image

"Hatred does not cease by hatred, but only by love. This is the eternal rule."
- Siddhattha Gotama (Buddha), founder of Buddhism.

User avatar
snarkout
Site Admin
Posts: 1342
Joined: Tue Aug 16, 2005 9:35 pm

Re: Software RAID or folder synchronization?

Post by snarkout » Wed Mar 19, 2008 5:30 pm

I'd avoid softraid, personally.
Shared pain is lessened, shared joy is increased; thus do we refute entropy.
--Spider Robinson

diazamet
Posts: 38
Joined: Thu Feb 21, 2008 7:42 am

Re: Software RAID or folder synchronization?

Post by diazamet » Thu Mar 20, 2008 3:56 am

Why would you avoid softraid?

User avatar
snarkout
Site Admin
Posts: 1342
Joined: Tue Aug 16, 2005 9:35 pm

Re: Software RAID or folder synchronization?

Post by snarkout » Thu Mar 20, 2008 7:44 am

It eats cpu, fails, and generally sucks. If it were worth a shit people worldwide would throw their expensive raid cards in the trash to go with fakeraid.
Shared pain is lessened, shared joy is increased; thus do we refute entropy.
--Spider Robinson

User avatar
Patrick
Site Admin
Posts: 2519
Joined: Tue Apr 27, 2004 11:38 am
Location: Easton, PA
Contact:

Re: Software RAID or folder synchronization?

Post by Patrick » Thu Mar 20, 2008 7:53 am

I use one of these 3ware Raid cards in my server:
http://www.newegg.com/Product/Product.a ... 6816116030

I have 2x 500 gig hard drives with RAID1 mirroring. Been working like a champ for over a year.
Ego contemno licentia

Tsuroerusu
Posts: 2551
Joined: Mon Sep 05, 2005 8:51 am
Location: Silkeborg, Denmark
Contact:

Re: Software RAID or folder synchronization?

Post by Tsuroerusu » Thu Mar 20, 2008 8:15 am

Patrick wrote:I use one of these 3ware Raid cards in my server:
http://www.newegg.com/Product/Product.a ... 6816116030
It's extremely weird, I can't find any 3ware controllers that costs less than 850 dollars in Denmark. I could buy one from another country within the EU, but that would be a pain if it ever broke and I had to return it. Buying one from the US is not a good option because of import taxes (Within the EU there's no sorts of import taxes).
Patrick wrote:I have 2x 500 gig hard drives with RAID1 mirroring. Been working like a champ for over a year.
The real test of a RAID controller though, is it's ability to recover from a problem, and the steps needed to restore the array to normal function when a problem has occurred. Have you had the chance to test that on your 3ware controller?
Image
Image

"Hatred does not cease by hatred, but only by love. This is the eternal rule."
- Siddhattha Gotama (Buddha), founder of Buddhism.

User avatar
Patrick
Site Admin
Posts: 2519
Joined: Tue Apr 27, 2004 11:38 am
Location: Easton, PA
Contact:

Re: Software RAID or folder synchronization?

Post by Patrick » Thu Mar 20, 2008 9:50 am

Tsuroerusu wrote: The real test of a RAID controller though, is it's ability to recover from a problem, and the steps needed to restore the array to normal function when a problem has occurred. Have you had the chance to test that on your 3ware controller?
Not yet (knock on wood).
Ego contemno licentia

User avatar
jnash2001
Posts: 19
Joined: Tue Sep 18, 2007 10:10 am

Re: Software RAID or folder synchronization?

Post by jnash2001 » Thu Mar 20, 2008 10:55 am

why not "rsync --delete" every night?
it can even archive the deleted files, iirc.
one package, one script, less fiddling 8)

User avatar
HerbVista
Posts: 7
Joined: Fri Mar 21, 2008 12:44 pm

Re: Software RAID or folder synchronization?

Post by HerbVista » Fri Mar 21, 2008 4:40 pm

Several years ago I tried software RAID-1 on SuSE 8.x
I tested the mirror by disconnecting a drive ... at boot time the "MD" software kept complaining that "disk quorum" wasn't met ... and as a result the "md" software would not activate the raid group ...
... I couldn't figure how to "ignore quorum" to force the MD software to bring the raid-1 group online ...
... I may have missed an option to ignore quorum when building the Raid Group.

In any case, my point it to actually test the case where a drive fails before putting to much important data on the system.

I didn't see any performance issues with the software RAID-1 but I did not push a lot if I/O's ...

I usually use 3-Ware Raid cards for hardware Raid when using bare metal Linux.

Lately on small systems I generally just use motherboard/chipset provided Raid-1 groups and use XP Pro to get driver support and then use VMWare to provide Linux images on the raid protected drives ... not a servers solution.

Some of my suggestions are expensive however ... and modeled after commercial approaches ....

Post Reply