Jump to content


Photo

unRAID combined with WHS


  • Please log in to reply
12 replies to this topic

#1 AbleTech

AbleTech

    HSS 1 Post Wonder

  • Members
  • 8 posts

Posted 28 June 2011 - 10:00 PM

At the HHS meetup on Saturday I heard a few of the attendees speaking about unRAID and my interest was piqued (that means "stimulated" in case you were wondering). So I researched it a bit. If you're not familiar with unRAID let me give you a brief introduction.

unRAID is a very cool Linux-based software raid solution that can handle random hardware and HDD combinations and can recover and rebuild data if a HDD is lost or corrupted. The software is free for use with up to 3 HDDs and from what I have read it works well alongside WHS. The benefit of this option is that it does not use duplication to protect your data (like WHS) and so you get to use the full capacity of your drives (minus a parity drive) for storage instead of only half. As mentioned, unRAID uses a parity drive which allows for any drive that fails to be replaced and rebuilt. The software OS can be run off of a small flash drive on old hardware. One of the major benefits of a solution like this is that you can use it to backup your WHS OS which is great with WHS 2011. I'm considering putting together an unRAID test box using some old hardware and see if it might be a good way to manage my HDD storage pool in conjunction with WHS 2011.

Here is an article about use of unRaid instead of, and in addition to, WHS 2011: http://www.mediasmar...rney-to-unraid/

Here is a link to the developer of unRaid and the download site: http://lime-technology.com/

I am curious to hear from any of you that have used unRAID. What do you like about it? What do you hate about it? How would you use it in conjunction with WHS?
Current WHS v1 Rig: - Lian Li PC-Q08B Mini-ITX case - LEPA G500-MA 500w 80+ Gold modular PSU - Zotac H55ITX-A-E motherboard - Intel Core i3-560 processor - 4GB G.Skill Ripjaws DDR3 1333 - 3 x Samsung Spinpoint F4 2TB HDD - Samsung Blu-ray drive

#2 pcdoc

pcdoc

    HSS Legend

  • Moderators
  • 3,593 posts
  • LocationLos Angeles, California

Posted 28 June 2011 - 10:48 PM

Thanks for the info. I looked at this once and thought it might make a good backup to WHS. In another words, syncing your data from the WHS to unRaid. This is basically a software RAID 5 and would make a great addition. I still prefer using a hardware raid solution in the server but this is a fantastic way to recycle your old server and get a second copy of the data. Thanks for the write up.

Main Server - WHS 2011, Core I5-2500, 12T RAID 5 (5x3T) + 2T of Mirror + 2T of backup
Second Server - 2008R2, Core I5-2500, 12T RAID 5
Main Systems - Core I7-2600k, 16 Gigs DDR3-1600, 180 Gig Intel 330 SSD Max IOPS 240 Gig Vertex 3, 2T Sata 3 for local Backup
Other systems - Core I7-2600, Core I3-530's, Core I5-2500, Core I7-920, Core I3-2100, and G620 (see System List)
My Blogs - The Docs Blog and Tablet Resource
BYOB Videos - TheBYOBPodcast
For a complete system List: Computer Systems


#3 cskenney

cskenney

    HSS Elite

  • Administrators
  • 1,363 posts
  • LocationNorthern Illinois

Posted 29 June 2011 - 05:45 AM

Use the search function here in the forums and you will find many, many references made to unRaid. In fact, I believe Geek-accountant has an unRaid server. There are numerous other members that appear to be either running an unRaid server or have tried it out.
WHS - HP EX485 MediaSmart Server Intel Celeron 2 Ghz, 2 GB RAM, 1 TB system drive, 2 x 2 TB storage drive<br />
<br />

#4 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 838 posts
  • LocationAtlanta Area

Posted 29 June 2011 - 04:55 PM

Yes I am. I have posted about and talked about it in Live chat and always thought I was the only fan. Now I find out you guys talked about it at the the meet up. Dang, I wish I could have been there.

As cskenney pointed out, I have an Unraid server. It's been running for over a year now and I have had no problems. Love the thing. I actually moved most of my storage to it before we even found out MS was dropping DE from the WHS. My problem with how WHS protected the data was by using duplication. With over 500 movies on the server, my only real choice on WHS was to leave them unprotected because I was not going to buy double the drives. So i switched to using Unraid as my main storage server and only use WHS for PC backups, which it is great at doing.

When we found out DE was being dropped, my first thought was no problem I will run WHS as a VM on my Xenserver and use Unraid's NFS option to provide expandable storage to the WHS VM. That plan failed as I was never able to get it to run reliable.

A few things to think about before doing this:

  • Parity drive needs to be as big or bigger than the largest data drive
  • Don't use slow drives as your parity drive, transfers to the server are limited by the slowest drive being written too
  • Even with fast drives, transfer speeds will be less than a true RAID solution
  • If you need a controller card for additional ports, don't use a standard PCI version one

The thing I love about it is the user shares which can be spread across all the drives or limited to specific drives. Also love that you can use different sized drives and add additional ones when needed. I am using a Norco 4020 case, so I have LOTS of room to grow.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#5 ImTheTypeOfGuy

ImTheTypeOfGuy

    HSS Master

  • Donating Member
  • 2,362 posts
  • LocationhOUston

Posted 29 June 2011 - 08:10 PM

When we found out DE was being dropped, my first thought was no problem I will run WHS as a VM on my Xenserver and use Unraid's NFS option to provide expandable storage to the WHS VM. That plan failed as I was never able to get it to run reliable.

A few things to think about before doing this:

  • Parity drive needs to be as big or bigger than the largest data drive
  • Don't use slow drives as your parity drive, transfers to the server are limited by the slowest drive being written too
  • Even with fast drives, transfer speeds will be less than a true RAID solution
  • If you need a controller card for additional ports, don't use a standard PCI version one
The thing I love about it is the user shares which can be spread across all the drives or limited to specific drives. Also love that you can use different sized drives and add additional ones when needed. I am using a Norco 4020 case, so I have LOTS of room to grow.


With your Xenserver VM you just gave me a thought. I am running s2008r2 with several VM's, WHS2011 being one. Maybe I should set up a raid 5 array for my data (documents, spreadsheets, media, etc) with s2008r2 and not within the WHS2011 VM. This should work find as long as it isn't difficult to share the array from within s2008r2.

Being able to add drives to unRAID is a big plus. have you tested read/write speeds? If yes, what were the results and how did they compare to a Raid 5 array?
ITTOG


- WHS V1: Dell XPS 420; Quad Core @ 2.66 GHz; 4 GB RAM
- S2008R2: Lian Li PC-A70F, EVGA X58 3X SLI, i7 920 @ 2.67 GHz; 12 GB RAM, 2 x 250 GB WD Black Caviar in IcyDock Enclosure with Raid 1, EVGA GeForce GT 240, 12TB RAID5
- HTPC: Silverstone Lascala, Gigabyte GA-H55-USB3, i3 530 @ 2.93 GHz, 4 GB Ram, 60 GB OCZ Vertex 2 SSD, 12TB RAID5
- Personal Desktop: Lian Li PC-9F, ASUS Sabertooth P67, i7 2600k @ 4.1 GHz, 16 GB RAM, 2 x 120 GB OCZ Vertex 2 SSD's in Raid 0, EVGA GTX580
- Kids Desktop: Dell Dimension 8400 Pentium 4 560, 3.6GHz, 2 GB RAM - Lets not forget this beauty!
- Other Devices: iPad, Boxee Box, XBox's, PS3, Wii, and HP TouchPad

#6 AbleTech

AbleTech

    HSS 1 Post Wonder

  • Members
  • 8 posts

Posted 29 June 2011 - 08:17 PM

Yes I am. I have posted about and talked about it in Live chat and always thought I was the only fan. Now I find out you guys talked about it at the the meet up. Dang, I wish I could have been there.


The meet up was a fun time... but I'll try not to pour lemon juice on your paper cut. ;P
Great to hear from someone who has real experience with unRAID! Thanks for your input. I have a few questions for you.

- Do you stream your movies from the unRAID server? Bluray or just DVD? If so, have you been satisfied with the read speeds?
- When you mention trying to run WHS as a VM and use unRAID as the storage... At what point did this concept fail? Was there a failure on the part of WHS to interface with the unRAID storage pool?
Current WHS v1 Rig: - Lian Li PC-Q08B Mini-ITX case - LEPA G500-MA 500w 80+ Gold modular PSU - Zotac H55ITX-A-E motherboard - Intel Core i3-560 processor - 4GB G.Skill Ripjaws DDR3 1333 - 3 x Samsung Spinpoint F4 2TB HDD - Samsung Blu-ray drive

#7 ImTheTypeOfGuy

ImTheTypeOfGuy

    HSS Master

  • Donating Member
  • 2,362 posts
  • LocationhOUston

Posted 29 June 2011 - 08:29 PM

Yes I am. I have posted about and talked about it in Live chat and always thought I was the only fan. Now I find out you guys talked about it at the the meet up. Dang, I wish I could have been there.



I missed your comment about live chat. I wish that was used by the forums more often. I really like using chat on another forum I frequent (non-tech).
ITTOG


- WHS V1: Dell XPS 420; Quad Core @ 2.66 GHz; 4 GB RAM
- S2008R2: Lian Li PC-A70F, EVGA X58 3X SLI, i7 920 @ 2.67 GHz; 12 GB RAM, 2 x 250 GB WD Black Caviar in IcyDock Enclosure with Raid 1, EVGA GeForce GT 240, 12TB RAID5
- HTPC: Silverstone Lascala, Gigabyte GA-H55-USB3, i3 530 @ 2.93 GHz, 4 GB Ram, 60 GB OCZ Vertex 2 SSD, 12TB RAID5
- Personal Desktop: Lian Li PC-9F, ASUS Sabertooth P67, i7 2600k @ 4.1 GHz, 16 GB RAM, 2 x 120 GB OCZ Vertex 2 SSD's in Raid 0, EVGA GTX580
- Kids Desktop: Dell Dimension 8400 Pentium 4 560, 3.6GHz, 2 GB RAM - Lets not forget this beauty!
- Other Devices: iPad, Boxee Box, XBox's, PS3, Wii, and HP TouchPad

#8 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 838 posts
  • LocationAtlanta Area

Posted 29 June 2011 - 09:39 PM

With your Xenserver VM you just gave me a thought. I am running s2008r2 with several VM's, WHS2011 being one. Maybe I should set up a raid 5 array for my data (documents, spreadsheets, media, etc) with s2008r2 and not within the WHS2011 VM. This should work find as long as it isn't difficult to share the array from within s2008r2.

Being able to add drives to unRAID is a big plus. have you tested read/write speeds? If yes, what were the results and how did they compare to a Raid 5 array?


Well, one of the reasons I gave some of the points I did was because I learned it the hard way. Many of those things I said to do or not to do, I did the wrong way. For example, i used the 5400rpm green drives and my parity drive is slowing down everything. In addition, I have half the drive connected to the MB and the other half connected to a PCI controller card. And guess what, the way the drives are laid out, my parity drive is using that PCI controller. I do have a faster drive to swap with the parity a d PICe controller card to swap in there as well. Just need to find some time away from my other new hobby, the photography podcast. I am starting to forget what the wife looks like. :(

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#9 no-control

no-control

    HSS Elite

  • BYOB Podcasters
  • 1,779 posts
  • LocationSoCal

Posted 29 June 2011 - 09:44 PM

Maybe I should set up a raid 5 array for my data (documents, spreadsheets, media, etc) with s2008r2 and not within the WHS2011 VM. This should work find as long as it isn't difficult to share the array from within s2008r2.


Unless you're very familiar with NTFS and Share permissions and how they stack. I wouldn't use shares from WS2008R2. I tried this for my video RAID Stack and while I had it working. It was more setup than I liked and not very flexible. No comment on the other parts of your question, sorry

#10 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 838 posts
  • LocationAtlanta Area

Posted 29 June 2011 - 09:58 PM

The meet up was a fun time... but I'll try not to pour lemon juice on your paper cut. ;P
Great to hear from someone who has real experience with unRAID! Thanks for your input. I have a few questions for you.

- Do you stream your movies from the unRAID server? Bluray or just DVD? If so, have you been satisfied with the read speeds?
- When you mention trying to run WHS as a VM and use unRAID as the storage... At what point did this concept fail? Was there a failure on the part of WHS to interface with the unRAID storage pool?


Yea, yea, keep pouring into that wound.

I have streamed DVD's and they did fine. Actually streamed DVD's to several locations at once and they did fine. I have not tried a Bluray yet however.

Due to the stupid decisions I made about the build on the front end, see my other reply, my write speeds are horrible. Normally under 20MBS. Read speeds, I have seen as low as 20MBS and as high as 45MBS. Again, I think this may be related to my PCI controller. I guess I will find out when I swap it out.

The failure when using Unraid to supply NFS storage to the VM server was I think an Unraid issue. What happened was Xenserver kept losing the connection to the storage. I posted this in the Unraid forums and the basic response was that I was trying that no had done before and they doubted it would work. They where right.

I missed your comment about live chat. I wish that was used by the forums more often. I really like using chat on another forum I frequent (non-tech).


The chat I am talking about is during the Live show. Not here in the forums. No one else seemed interested in Unraid.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#11 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 838 posts
  • LocationAtlanta Area

Posted 29 June 2011 - 10:03 PM

One more thing. When I moved the WHS out of my Norco case and moved Unraid into it, i didn't move hardware. What I did was pull the USB stick with the Unraid OS (Unraid runs from a USB stick) from it's current hardware and plug it into the new hardware. It booted up fine and all I had to do was tell it what drives go where (ie, the numbering, this was important thing to do before moving the drives).

If that's not impressive, I left out one thing. Before putting the USB stick in the new system, I put it in my system and upgrade the OS from v4.5 to v4.7. So between moving it from one set of hardware to another, I also upgraded the OS to the newest version. I was impressed!

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#12 ImTheTypeOfGuy

ImTheTypeOfGuy

    HSS Master

  • Donating Member
  • 2,362 posts
  • LocationhOUston

Posted 30 June 2011 - 09:14 PM

Well, one of the reasons I gave some of the points I did was because I learned it the hard way. Many of those things I said to do or not to do, I did the wrong way. For example, i used the 5400rpm green drives and my parity drive is slowing down everything. In addition, I have half the drive connected to the MB and the other half connected to a PCI controller card. And guess what, the way the drives are laid out, my parity drive is using that PCI controller. I do have a faster drive to swap with the parity a d PICe controller card to swap in there as well. Just need to find some time away from my other new hobby, the photography podcast. I am starting to forget what the wife looks like. :(


Well, if you ever find that time, let us know what kind of increased performance you get. It is tough being a husband, father, and hobbyest (is that a word)? I feel your pain.

Unless you're very familiar with NTFS and Share permissions and how they stack. I wouldn't use shares from WS2008R2. I tried this for my video RAID Stack and while I had it working. It was more setup than I liked and not very flexible. No comment on the other parts of your question, sorry


That is not what I wanted to hear. If it was more than you wanted to manage then it will probably be more than I want as I like set it and forget it.

[

One more thing. When I moved the WHS out of my Norco case and moved Unraid into it, i didn't move hardware. What I did was pull the USB stick with the Unraid OS (Unraid runs from a USB stick) from it's current hardware and plug it into the new hardware. It booted up fine and all I had to do was tell it what drives go where (ie, the numbering, this was important thing to do before moving the drives).

If that's not impressive, I left out one thing. Before putting the USB stick in the new system, I put it in my system and upgrade the OS from v4.5 to v4.7. So between moving it from one set of hardware to another, I also upgraded the OS to the newest version. I was impressed!



That is impressive. I don't know much about unRAID but I have read all your posts about it and it has my interest. The USB concept it really cool.
ITTOG


- WHS V1: Dell XPS 420; Quad Core @ 2.66 GHz; 4 GB RAM
- S2008R2: Lian Li PC-A70F, EVGA X58 3X SLI, i7 920 @ 2.67 GHz; 12 GB RAM, 2 x 250 GB WD Black Caviar in IcyDock Enclosure with Raid 1, EVGA GeForce GT 240, 12TB RAID5
- HTPC: Silverstone Lascala, Gigabyte GA-H55-USB3, i3 530 @ 2.93 GHz, 4 GB Ram, 60 GB OCZ Vertex 2 SSD, 12TB RAID5
- Personal Desktop: Lian Li PC-9F, ASUS Sabertooth P67, i7 2600k @ 4.1 GHz, 16 GB RAM, 2 x 120 GB OCZ Vertex 2 SSD's in Raid 0, EVGA GTX580
- Kids Desktop: Dell Dimension 8400 Pentium 4 560, 3.6GHz, 2 GB RAM - Lets not forget this beauty!
- Other Devices: iPad, Boxee Box, XBox's, PS3, Wii, and HP TouchPad

#13 AbleTech

AbleTech

    HSS 1 Post Wonder

  • Members
  • 8 posts

Posted 01 July 2011 - 06:28 PM

Thanks for the info geek-accountant. Very helpful. Now if unRAID adds iSCSI functionality I will be in heaven. I ultimately want to build a poor-man's NAS that will replace my WHS2011 storage pool. As I understand it though, unRAID won't currently function in this way.

YodaFett just posted an interesting alternative here though... I can see my storage solution getting more and more complicated by the minute! :rolleyes:
Current WHS v1 Rig: - Lian Li PC-Q08B Mini-ITX case - LEPA G500-MA 500w 80+ Gold modular PSU - Zotac H55ITX-A-E motherboard - Intel Core i3-560 processor - 4GB G.Skill Ripjaws DDR3 1333 - 3 x Samsung Spinpoint F4 2TB HDD - Samsung Blu-ray drive




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users