Jump to content
RESET Forums (homeservershow.com)
  • Dual RAID Setup on Windows Home Server 2011 and adding drives to a RAID 5 array


    Dave
     Share

    Since Windows Home Server 2011 was released without Drive Extender you may be wondering how you are going to protect your data on the server now.  One method is to use RAID.  I’m not going to get into the fundamentals of RAID in this article but if you want more information you can visit a wiki article that goes over all the different flavors of RAID.  I’m also not going to go over a highly detailed step by step on how to do it but rather show you that it can be done and give you a basis of how to accomplish it.  There are many different ways to do it due to all the different hardware that is available.  I’ll give you the hardware that I used and hopefully that will help give you some direction.

     

    Here is what we are going to do.  Install WHS2011 on a mirror of two hard drives using the Icy Dock MB982SPR-2S and then use the Intel SATA ports as a RAID 5 array on the Gigabyte P55-USB3 motherboard.  At the end of the article I’m going to attempt to increase the RAID 5 array by adding a drive and hopefully not lose any data while trying!

     

    Here are some refresher links if you would like to take a deeper look at these parts.

     

    http://homeservershow.com/icy-dock-mb982spr-2s-review.html

     

    mb982spr_2hdd_1280x8531.jpg

     

    This little jewel has a JMicron RAID chip built into it.  The RAID is done on the enclosure so you only have to run one SATA port to it.

     

    Here is the test server build in detail in case you would like to see all the parts:  http://homeservershow.com/vail-test-server-build.html

     

    The ports used on the P55 motherboard are as follows:

     

    image5.png

     

    I used one of the JMicron ports for the Icy Dock.  It’s the set of two white ports in the photo.  Use the blue Intel ports for the RAID5.

     

    If you don’t want to use the Icy Dock enclosure for this mirror you could simply use both the JMicron ports on the motherboard as the mirror.  If you want to save space in your case you can use a little box like the one below.

     

    VailBuild008.jpg

     

    It’s the StarUSA BPU-2535V2 1 x 3.5″ to 2 x 2.5″ SATA I/II Hot-Swap Drive Cage

     

    I did a head to head RAID comparison of the Intel ports vs. the JMicron ports on the motherboard in this article.  It is also required reading!

     

    OS Mirror

     

    The Icy Dock mirrored install is a breeze.  You can do it two ways.  Set the switch on the box to mirror and install or do the install to one drive then use the Icy Dock software after you install WHS2011 to setup the mirror while you are logged in via Remote Desktop.  You can’t do this in WHS2011’s Dashboard.  Windows Home Server 2011 will automatically load the drivers for this Icy Dock RAID enclosure during install.  No extra drivers needed.

     

    mb982spr-2s_feature21.jpg

     

    There is not a whole lot to it.  Once you have installed WHS2011 verify the OS drive in the dashboard and it is the correct size.

     

    RAID 5

     

    The RAID 5 array is no more difficult than the mirror.  We will be using the blue Intel ports on the board.

     

    IMAG0647

     

    Here are some of the drives being used for the tests.  I’m using the MB973SP-B trayless 3 in 3 SATA backplane module from Icy Dock.

     

    Install your drives to these SATA ports and power it up.  The first thing you have to do is enter bios setup and designate the ports as RAID.

     

    IMAG0648

     

    In this motherboard RAID is under Integrated Peripherals.

     

    IMAG0649

     

    Now the ports are set to RAID.

     

    Reboot the box saving your bios settings and be ready to recognize a different in the RAID bios screen.  It will list all your drives and allow you to hit a key combination like CTRL-I to enter RAID bios setup.  It’s here where you will designate RAID 5.

     

    Set the RAID up as per the defaults choosing RAID 5.  Save and exit.  When your server reboots you will have one hard drive in your dashboard.  This is your array although it’s not useable yet.  You will be notified via alerts that the drive is ready to be formatted.  Format and your done!

     

    You now have two RAID arrays setup on your new WHS2011 server.  One mirror for the OS and one RAID 5 for the data.

     

    image

     

    In this screen shot you can see the OS Drive that is 60GB and the rest of the remaining space on it which is 172.7GB.  The Intel Raid shows up as 931GB free.

     

    You can go further into this adventure by installing the Intel(Intel Rapid Storage Technology) and/or the JMicron RAID software on your server via remote desktop.  This software will help you check the RAID health and do repairs if needed.

     

    Some extra info.

     

    I had a hodge-podge collection of hard drives to test with.

     

    500Gb

     

    1.5Gb

     

    1.0Gb

     

    I used all these drives in the RAID 5 array.  I don’t really recommend this as I think it’s better to go with like drives.  As large as you can afford if possible.  The 500 GB drive I have installed in this array is dragging down the total size of usable space.  Let’s break down these drives though.  They add up to to 3Tb of total storage.  In version 1 of WHS this would be 1.5TB if you used duplication and filled the pool up with data.  It’s a 1 to 1 ratio.

     

    This hodge-podge RAID 5 array came in at roughly 1TB of usable space.  That’s not a very efficient use of the SATA ports which reiterates the point of installing like sized drives and large ones if possible.

     

    We have all heard the horror stories of how long it takes to format RAID arrays with software based RAID.  This RAID 5 array is not large by any standard but it only took around a minute to format it. Can’t beat that!

     

    Can you expand the RAID 5 Array?

     

    It’s the million dollar question.  Can you successfully add a hard drive to the RAID array without losing your data that's already on the array?  This is the whole reason I started this article.  I want to know!

     

    I powered the server off and added a 1.5TB drive to a blue SATA port which is now controlled by RAID.  I’m going to attempt this via the software Intel provides for the motherboard, Intel Rapid Storage Technology. (verify your setup before installing)

     

    image

     

    In this shot you can see the RAID 5 array at the top right.  Everything with it looks good.  However, the software is reporting a new drive sitting all by itself.

     

    image

     

    It’s even visible in the dashboard which expels one myth that I thought was true about setting the Intel ports to RAID.  I thought that all the ports were set to RAID and you couldn’t load a drive on a free port without using it in the array.  Looks like I was wrong.  Notice I have some data on it as well.  I’m expecting to lose that data if I’m able to insert the drive into the array.

     

    I’m going to follow the IRST instructions of “Reset disk to Normal.”

     

    image

     

    I’m not sure what it did but the drive is now green.

     

    image

     

    Click on the array on the top right and Add Disk.

     

    image

     

    Here is the warning that any data on the drive will be lost.  Also, it states that once the process is complete I will need to reboot and increase the size of the volume using Windows Disk Management.

     

    image

     

    The drive is now added.  The process took about 30 seconds.

     

    image

     

    Back in the dashboard WHS2011 still reports the old size of around 1TB but the drive did disappear.  Reboot time.

     

    image

     

    After the reboot I checked IRST to see what was going on with the array before I did anything else.  It reports that it is Migrating data and there is a caution flag on the drive I just added.  Dashboard still reports the old size of 1TB but the data I had on the array is still intact.  I’m not real sure what it’s doing at this point and it’s going very slow!

     

    image

     

    In Disk Management I can see that I have unallocated space ready to be added to the volume.

     

    image

     

    In Disk Management right click the healthy RAID volume and click Extend Volume. Don't click on the unallocated space.

     

    image

     

    Next you will see what is available to add.

     

    image

     

    image

     

    The RAID volume has now grown.

     

    Errors

     

    I clicked through this at a lightning pace since it’s just a test and I don’t have any real data to lose if it failed.  As soon as I clicked finish on the Extend Volume Wizard the IRST application notified me that a drive in the array has failed.  It’s not the drive that I just added though.  It’s the 500GB drive in the array.  The irony to this is I was going to attempt to remove this drive from the array since it’s the smallest and is really holding back the entire array due to it’s size.  My best guess is that the array is now too big and the smaller drive can no longer participate in the array due to it’s size.

     

    In a normal situation I would have let the IRST finish the data migration before attempting to extend the volume.  I also would never have added a 500GB drive to a RAID 5 array.  I just happened to find the 1.5TB drive after I had already started the testing.  I will follow up and let you know how it all turns out.

     

    UPDATES:

     

    raidok-215x300.jpg

     

    The rebuild finished sometime overnight so I can't tell you how long it took but everything looks good.  I've received a few messages from some guys that know more about RAID than myself and have some better explanations for you.

    When setting up raids with different size disks (regardless of raid 0,1,5,10, etc) The array will use the size of the smallest disk on all the disks.  In plain english if you have a 500gb, 1tb, and 1.5tb drives in an array it is going to treat each drive as a 500gb drive so all of that extra space will be wasted. You definitly want to use same size drives.

    Well stated.  I was trying to say that!  He also goes on with a quick RAID lesson.  The stuff I didn't want to get into!

    The way raid 5 works is that it is kind of a mixture of raid 1 and 0. It stripes the drives for performance but also kind of mirrors. the reason i say "kind of" is because it uses a parity system. What it does in a 3 drive array is use 1/3 of each disk for the parity data. on the first drive it has parity data for drives 2 and 3....on the second drive it has parity data for drives 1 and 3.....and so on.  What happens is when a drive fails the array uses the parity data on the 2 remaining drives to rebuild the array.

     

    When you added the 4th drive into the array it is actually generating and adding the parity information to that drive (and other drives for that drive) in the background so that all 4 drives now have the parity blocks.   this is all for raid 5 only by the way. It will go slow for a while until the parity is built on the new drive.

    That makes perfect sense.  Better yet, all my clicking and rushing through this process didn't effect it one bit.  It all works and all the data is good on the array.  I think that speaks highly of the technology if I can't mess it up!  I also think this is a good lesson displaying the effects of RAID and using unlike sizes of drives.  As in, don't do it.  I'm willing to bet most WHS v1 owners don't have same size drives throughout their system.  When I bought my v1 server a 500GB drive was awesome to have and soooo big!  Now 2TB drives are pretty much the standard.  I have a mishmash of sizes from 1.0 to 2TB in my MediaSmart Server today.

     

    Last Test

     

    Get rid of that 500 GB drive.  I don't see a clear cut way to remove a drive via the IRST software.  I'm going to further test this thing but powering the server off and pulling the 500GB drive out.  That should also suffice as a disaster recovery test.

     

    1removed500-300x206.jpg

     

    After it's removal IRST is all kinds of annoyed.  One drive is not in good state and the 500 is reported missing.

     

    2resetdisk4tonormal-300x204.jpg

     

    The drive that is reported "At Risk" has a link to click to reset it to normal.  I've seen this once before and it just takes a few seconds although I don't know why it's doing it.  I still cannot find a way to remove the drive from the array.  Update:  Some sort of SMART event is taking place.  I'll have to dig deeper to see what.

     

    moz-screenshot-1.png3dm-300x131.jpg

     

    Disk Management looks normal as well.  Looks like I need to reboot it and look at the RAID BIOS utility.  Once I looked in there it became clear.  There was an option to remove a drive from the RAID array.  That's what I was hoping to find in IRST but didn't.  The caveat is I had to add yet another hard drive in order to remove a hard drive.  The contents of this 500 were to be moved to the new drive.  It's a larger drive as well so I'm not sure what it will look like in IRST.  I'm hoping that my RAID 5 volume would increase.  The BIOS also told me that the rebuild would happen in the OS.  So I saved and selected exit.

     

    Once inside WHS2011 the IRST application shows the array as rebuilding.  It looks to be progressing faster than the original rebuild but still it's a slow process.  A question though.  I replaced the 500GB drive with a 2TB drive.  Shouldn't my volume size increase?  Is the RAID hardware only using 500GB out of the 2TB to replace the 500GB drive that is being removed?  Sounds confusing but my volume did not grow.  It's still rebuilding so I will wait and see.  More to come...

     

    goodarray-300x146.jpg

     

    Finished Rebuilding

     

    increase-size.jpg

     

    Just as suspected.  Increase size is now available.

     

    2increasespace-300x126.jpg

     

    1newsize.jpg

     

    Size of volume increased!

     

    A question was asked about resources during a rebuild.  I don't see much of a problem in this area.

     

    graph-103x300.jpg graph2-105x300.jpg

     

    And that's it.  The end of the marathon RAID post.

     Share


    User Feedback

    Recommended Comments

    Thanks for the write-up. Great job! It's nice to see that onboard RAID will function well enough. But inquiring minds want to know what happens when the total size of a RAID 5 storage drive goes over 2.1 TB. Is it format as GPT and all will be well? Or does the OS balk at this? It was interesting to see that adding a drive to RAID 5 was fairly easy, just took some time. I'd have been interested to know what the CPU was doing as this was happening. I'd also wonder how it would affect something like video streaming.
    Link to comment
    Share on other sites

    OK. Having listened to HSS podcast 122, I know we can create and use drive partitions larger than ~2.1 TB but we won't be able to back up a single file on those partitions due to a limitation of the server backup program. Wait!? What? Really?? Come on, Microsoft. Let's get this straightened out.
    Link to comment
    Share on other sites

    Math time, Raid 5 uses the same space on each drive as the smallest drive. So, if you have a 2TB, 1.5TB, 1.5TB, and 1 TB drive, it will only use 1 TB from each. 4 x .954 TB = 3.816 TB. Since there are 4 drives, 25% of the raid space on each drive will be used for Parity data. 3.816 TB x .75 = 2.862 TB
    Link to comment
    Share on other sites

    What is great is that it just worked when Dave pulled the 500MB drive out and replaced it with a larger (in this case 2TB) drive and was able to rebuild the array using the new lowest common denominator size of the drives, 1 TB. I mean, we all want it to do this, and expect is *should* but in the real world it never seems to work that smoothly. I would have expected it to keep the array using the same size (i.e. 500GB/drive) until you backed up your data and rebuilt the array. This means you could add larger drives one at a time as you bought them, and once all the drives had exceeded the array's current smallest drive size, it would expand again. So the next step is for Dave to replace the 1 TB drive with a 1.5 (or larger) drive, and then the 4-drive array would grow to 4.3 TB! (4 * 1.431 [usable] TB - 1 * 1.431 TB for striping = 4.293 TB array.)
    Link to comment
    Share on other sites

    Can you do a read/write benchmark with the raid 5 array? I recently tried to set up a raid 5 with 3 1tb black drives (2 wd1001fals and 1 wd1002faex) and I was getting slow speeds, data corruption and IRQL not less or equal blue screens.
    Link to comment
    Share on other sites

    Yea I was skimming the article and i kind of flew over the part where 1 drive was taken out and replaced with a bigger drive. That was my mistake
    Link to comment
    Share on other sites

    Thanks for sharing your findings. I was doing some research on poor motherboard raid/fakeraid performance and came across this. On a side note, I've been using fakeraid (ICH10R) for about 2 years now. Read/write speeds have been fine, and not a reason for concern. I recently added a 1.5 TB drive to my existing array (3 x 1.5). The raid expansion and related data migration process is taking forever; beyond any semblance of reason. Its been a few hours over 1 week now, and its only reached 58%. Couple of questions: - Should it take this long? - CPU utilization is very low, between 2% and 5%. I'm guessing the bottleneck is the HDD? - Would a rebuild (if called for in the future) take this long?
    Link to comment
    Share on other sites

    Sorry I missed type my address for coxhaus, it should be leecoxhouse@gmail.com. Please correct as I missed typed my email and can not join using the name coxhaus._I guess you know that a 8 drive RAID5 is much faster and wastes only 1 drive for parity. Two RAIDS are inefficient._Thanks_lee
    Link to comment
    Share on other sites

    What happens to the data on the hard drives such as shared media when reformatting windows server os on main drive? do they get wiped upon new installation or they remain intact & able to use them for streaming again?
    Link to comment
    Share on other sites



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now

  • Our picks

    • I throw this out every once in a while.  Is anyone interested in writing up "semi-formal" reviews here on the forums?  I say semi-formal because they don't have to be pro level, just a good attempt at telling the story about the gear.  Something you have purchased lately.  You don't have to go buy stuff, just incorporate what you have already have purchased.  Hit me up with any questions.  You never know where it will lead!
        • Like
      • 3 replies
    • D-Link has dropped a couple of new products and additions to their lineup of smart home gear.  Hold on because there is a lot of gear!
      Let's start with cameras.  D-Link has new Wi-Fi cameras, the Full HD Pan and Tilt Pro Wi-Fi Camera (DCS-8302LH) and Full HD Indoor and Outdoor Pro Wi-Fi Camera (DCS-8526LH).  These are not just new, and good looking cams, they can now perform people detection and glass break detection.  The new cameras also feature expanded ways for customers to save video, including ONVIF Profile S, which enables custom storage and streaming options to personal NAS devices, built-in storage microSD capacity up to 256 GB, as well as free and paid cloud storage options. 
       

       
      This year's camera models include both an indoor and an outdoor model. The outdoor model features a spotlight and siren that can be triggered when motion is detected, deterring potential intruders. The indoor model pans around to give a full 360-degree view of any room and tracks motion. Both include two-way audio. 
      Full HD Pan and Tilt Pro Wi-Fi Camera is the model (DCS-8302LH), available in Q2, 2020, and retail pricing will be $99.99.
      Full HD Indoor and Outdoor Pro Wi-Fi Camera is the model (DCS-8526LH), available in Q3, 2020, and retail pricing will be $119.99.
      One of my favorite products is Wi-Fi.  D-Link has a whole lot of new products coming including Wi-Fi 6, Mesh, Alexa and Google Assistant integration, IFTTT, Parental Controls, and more!
       

       
      There are so many new SKU's that I can't make heads or tails of them!  I'm going to be speaking with D-Link more this week and will sort all of these out. I do want you to see all they are offering and what the release date and projected retail pricing will be.

      AC1900 Scalable Mesh Wi-Fi Router (COVR-1900-US), Q1 2020, $119.99
      AC1750 Mesh Wi-Fi Router (DIR-1750-US), Q1 2020, $99.99
      AC1900 Mesh Wi-Fi Router (DIR-1950-US), Q1 2020, $119.99
      AC1750 Mesh Wi-Fi Range Extender (DAP-1755-US), Q1 2020, $99.99
      AC1950 Mesh Wi-Fi Range Extender (DAP-1955-US), Q1 2020, $109.99
      Smart AX1500 Mesh Wi-Fi 6 Router (DIR-X1560-US), Q1 2020, $119.99
      Smart AX1800 Mesh Wi-Fi 6 Router (DIR-X1870-US), Q2 2020, $139.99
      Smart AX2400 Mesh Wi-Fi 6 Router (DIR-X2460-US), Q3 2020, $159.99
      Smart AX5400 Mesh Wi-Fi 6 Router (DIR-X5460-US), Q1 2020, $279.99
      AX1800 Mesh Wi-Fi 6 Range Extender (DAP-X1870-US), Q2 2020, $129.99
      AX1800 Whole Home Mesh System (COVR-X1872-US), QX22020, $269.99
        • Like
      • 0 replies
    • RESET Merch Shop
      Get ya Merch here!  I've created a T-Shirt shop with the famous RESET paperclip. I've pasted that clip on just about everything so you can wear it around town!  Cable bags, Coffee Mugs, T-Shirts, and more. 
       
      https://reset.threadless.com/
       
      or you can get it it via
       
      https://reset.fm/store
       
      Here is the main design.
       

       
      Below is a part of the order that I put in!  
       
       

       
      The Heather Grey above is the Extra Soft version and it is awesome.  I highly recommend the softness!    The "Chili Red" is the Tri-Blend and probably my favorite feel and color.

       
      This is the Zip-Up Hoody, Heather Indigo, Sponge Fleece, Men's, Large.  In my podcast I couldn't remember what style it was but it is Sponge Fleece. It's REALLY soft on the inside. Soft outside as well. The only problem is with the zip up hoody the logo is on the back. Regular hoody, it will be on the front.
       
      https://reset.threadless.com/
       
      or you can get it it via
       
      https://reset.fm/store
       
      Thank you for supporting this community. Everything you purchase will help keep the lights on the hard drives spinning.
       
      • 0 replies
    • OneDrive Personal Vault and expandable storage
      Microsoft's OneDrive has a few new features and options worth pointing out.  Personal Vault and Expandable Storage.
       
      Personal Vault is a protected area in OneDrive that can only be accessed with a strong authentication method or a second step of identity verification, such as your fingerprint, face, PIN, or a code sent to you via email or SMS. 
       
      Personal Vault gives you an added layer of protection for your most important files, photos, and videos—for example, copies of documents such as your passport, driver’s license, or insurance information—should someone gain access to your account or device.
      Plus, this added security won’t slow you down. You can quickly access your important documents, photos, and files with confidence wherever you are, on your PC, OneDrive.com, or your mobile device.

       
      Beyond a second layer of identity verification, Personal Vault also includes the following security measures:
       
      Scan and shoot—Using the OneDrive app, you can scan documents or shoot photos directly into your Personal Vault, keeping them off less secure areas of your device, like your camera roll.
      Automatic locking—No need to worry about whether you left your Personal Vault or your files open—both will close and lock automatically after a period of inactivity.
      BitLocker encryption—On Windows 10 PCs, OneDrive automatically syncs your Personal Vault files to a BitLocker-encrypted area of your local hard drive.
      Restricted sharing—To prevent accidental sharing, files in Personal Vault and shared items moved into Personal Vault cannot be shared.
       
      Taken together, these security measures help ensure that Personal Vault files are not stored unprotected on your PC, and your files have additional protection, even if your Windows 10 PC or mobile device is lost, stolen, or someone gains access to it or to your account.
       
      Expandable Storage
       
      If you are and Office 365 Subscriber you get 1 TB of OneDrive storage space with all the other Office goodies like Word, Excel, etc.  I know personally that I have gone over the 1TB limit and have always wanted to be able to add additional storage to my account.  Now you can!

       
      Pick and option and keep on hoarding, errr, I mean saving! Cancel anytime, upgrade at any moment.
      • 1 reply
    • Ubiquiti adds new items to the Unifi Line including UAP Flex HD and the Unifi Dream machine
      Ubiquiti has been busy.  There area ton of new items to recently released and I'm going to share two of my favorites.
       
      The UAP Flex HD and the Unifi Dream machine. The Flex HD is a mouthful of descriptors like most of UI gear is.  It's a 2Ghz 2x2 MIMO, 5GHz 4x4 MU-MIMO, POE, Indoor/Outdoor, multi mount, mesh point that is no bigger than a can of Coke.

       
      You will still need the Unifi controller although you can configure it with basic functionality with the Unifi App.  I've always found it's best to configure with your controller and then use the app as an add-on.  There are several mounting options that include sitting it on a shelf! That is something that Unifi has not had before unless you count the ceiling AP I have awkwardly mounted placed on top of a few books.  It can be found on the Unifi store for $179.
       
      https://store.ui.com/collections/wireless/products/unifi-flexhd
       
      The Dream Machine is an altogether different beast that I hope lives up to its naming.  This is the gateway drug, for lack of a better term, to the Unifi world.  The starter kit.  It is an Access Point, Gigabit Switch, Security Gateway, and the Cloud Key all in one package.  The latter being the most significant as this is something that has deterred new users from getting started with Unifi.  Requiring new users to purchase a $100 item just to run the AP's has been somewhat of a roadblock in the past.  Granted, that is improving every year with the ability to run it in the cloud, on a NAS, a Pi, Docker, MacOS, and of course Windows, it is still a barricade to getting up and running when manufacturers such as Eero offer simplicity in an app.
       

       
      The switch includes 4 LAN Ports and 1 WAN port.  All of which are Gigabit and security services such as IPS are rated at Gigabit speed. It's $299 in the Unifi store but I'm unsure how nicely it will play with other Unifi gear.  This may be a nice "first AP" with its built in Cloud Key if you can add additional units or other Unifi access points.
       
      https://store.ui.com/collections/routing-switching/products/unifi-dream-machine
      • 4 replies
×
×
  • Create New...