Jump to content


Photo

LSI 9260-4i Ups and Downs

raid lsi atto 9260

  • Please log in to reply
16 replies to this topic

#1 Greg Welch

Greg Welch

    HSS Champion

  • Donating Member
  • 436 posts
  • LocationLas Vegas, NV

Posted 13 August 2011 - 12:39 PM

Thought it was time i stop lurking in the Podcast and post a little in the forums LOL.


O.K. Guys whats your thoughts.


First the System then the problem

X8DTH-6F,E5620,12GB-ecc reg Ram,LSI MegaRaid 9260-4i raid card.

Ok just bought the LSI MegaRaid 9260-4i and not being able to wait for 4-2TB hatachi Drives

i put in 3-2TB WD EARS green drives in Raid 5 using LSI mega Raid Storage Manager then tried using ATTO to bench it ,

So sad, what happend?

Posted Image

O.K. after i was done wiping away the tears

i thought why not just stick a single drive on the 9260 and give it a bench with ATTO

Posted Image

what ? thats I i said ! (i did the test multiple times with the same results)

so i tried CMD

Posted Image

O.K. little more like Expected.

This is what my Raid Manager was set up like, remember this is just 1 drive till i order the 4 Hatachi the other below is the onboard SAS raid working as my WHS 2011 Raid

Posted Image


now when i do a drive to drive transfer.

from onboard SAS to the single Drive i get 250 MB to 300 MB Transfer speeds witha 4GB file

from single drive back to onboard Raid 100 to 110 MB with same 4GB file


So i Surmise

1)My single drive is working great
2) LSI MegaRaid 9260-4i dosn't like the 2TB WD EARS green drives (or its something i missed


side note :

I cant wait to get the 4 -2TB Hatachi Drives then a pinch of LSI Cachecade to finish it off


Well thanks for letting me ramble on p.s. still like lurking in the stream of the podcast LOL


Greg Welch aka WELCHWERKS

Server:

4U Norco case with Windows Server 2012 on Dual Xeon 5620's, Supermicro X8DTH-6F with IPMI , LSI Raid 9260-4i linked to Chenbro 24 port 6Gb expander for 24 drives including Cachecade 2.0/Fastpath, 48GB's ECC Registered PNY Ram, 10 Intel Teamed  Nics,  Raids: 4 Pair / 8 Drive Raid 10 with a global hot spare then 2 - 4 Drive Raid 5's (all using the the 4 x 64GB SSD Drives in Raid 1 with LSI CacheCade 2.0 for a total of 256 GB Cache) all on 6GB using SAS connectors in Norco 15U rack plus APC 1500 UPS, PFSENSE Router in 1U case with SSD, 24 port NETGEAR GS724T-300NAS switch,


 


#2 Greg Welch

Greg Welch

    HSS Champion

  • Donating Member
  • 436 posts
  • LocationLas Vegas, NV

Posted 13 August 2011 - 11:35 PM

O.k. let me start out by saying it wasnt the 9260 that didnt like the atto bench it was 1 of the 3 ears drives

i have sinse just raided the 2 good drives in raid 0 and look at these scores holy crap.

Posted Image

im starting to like this MB and Raid Card wonder what cachecade will do to bench scores :)

Server:

4U Norco case with Windows Server 2012 on Dual Xeon 5620's, Supermicro X8DTH-6F with IPMI , LSI Raid 9260-4i linked to Chenbro 24 port 6Gb expander for 24 drives including Cachecade 2.0/Fastpath, 48GB's ECC Registered PNY Ram, 10 Intel Teamed  Nics,  Raids: 4 Pair / 8 Drive Raid 10 with a global hot spare then 2 - 4 Drive Raid 5's (all using the the 4 x 64GB SSD Drives in Raid 1 with LSI CacheCade 2.0 for a total of 256 GB Cache) all on 6GB using SAS connectors in Norco 15U rack plus APC 1500 UPS, PFSENSE Router in 1U case with SSD, 24 port NETGEAR GS724T-300NAS switch,


 


#3 Greg Welch

Greg Welch

    HSS Champion

  • Donating Member
  • 436 posts
  • LocationLas Vegas, NV

Posted 14 August 2011 - 10:53 PM

o.k. this is for 2 ears drives in raid 0 512 sector and 512 format

so this tells a differnt story that above maybe i need a third test :)

Posted Image

Server:

4U Norco case with Windows Server 2012 on Dual Xeon 5620's, Supermicro X8DTH-6F with IPMI , LSI Raid 9260-4i linked to Chenbro 24 port 6Gb expander for 24 drives including Cachecade 2.0/Fastpath, 48GB's ECC Registered PNY Ram, 10 Intel Teamed  Nics,  Raids: 4 Pair / 8 Drive Raid 10 with a global hot spare then 2 - 4 Drive Raid 5's (all using the the 4 x 64GB SSD Drives in Raid 1 with LSI CacheCade 2.0 for a total of 256 GB Cache) all on 6GB using SAS connectors in Norco 15U rack plus APC 1500 UPS, PFSENSE Router in 1U case with SSD, 24 port NETGEAR GS724T-300NAS switch,


 


#4 timekills

timekills

    HSS Advanced

  • Donating Member
  • 615 posts
  • LocationFBTX

Posted 15 August 2011 - 11:11 AM

You're CDM shows a fairly linear growth - exactly what you'd want to see when you add an additional drive. Obviously there will be a point of diminishing return. The smaller file transfers will of course show less speed increase with additional hard drives because the RAID overhead is closer to the size ofthe file itself.

#5 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,601 posts

Posted 15 August 2011 - 11:36 AM

O.k. let me start out by saying it wasnt the 9260 that didnt like the atto bench it was 1 of the 3 ears drives

i have sinse just raided the 2 good drives in raid 0 and look at these scores holy crap.

Posted Image

im starting to like this MB and Raid Card wonder what cachecade will do to bench scores :)

On the face of it this has the look of cache reading/writing, rather than actual drive performance.

If at first you don't succeed, do it like your mother told you.


#6 Greg Welch

Greg Welch

    HSS Champion

  • Donating Member
  • 436 posts
  • LocationLas Vegas, NV

Posted 15 August 2011 - 02:06 PM

O.K. this is what im getting my raid 10 to the raid 0 above

now a couple of things i know will help.

1. the ears drives arent 6.0 Drives

2. the raid 10 is 4x2TB 6.0 but they are connected to the onboard SAS with no cache (but there own 64Mb each)

from onboard raid 10 to Raid 0 above a 4GB Folder (tangled movie if you must ask)

Posted Image

from Raid 0 to onboard Raid 10

Posted Image

these speeds are about the average for these file transfers

Server:

4U Norco case with Windows Server 2012 on Dual Xeon 5620's, Supermicro X8DTH-6F with IPMI , LSI Raid 9260-4i linked to Chenbro 24 port 6Gb expander for 24 drives including Cachecade 2.0/Fastpath, 48GB's ECC Registered PNY Ram, 10 Intel Teamed  Nics,  Raids: 4 Pair / 8 Drive Raid 10 with a global hot spare then 2 - 4 Drive Raid 5's (all using the the 4 x 64GB SSD Drives in Raid 1 with LSI CacheCade 2.0 for a total of 256 GB Cache) all on 6GB using SAS connectors in Norco 15U rack plus APC 1500 UPS, PFSENSE Router in 1U case with SSD, 24 port NETGEAR GS724T-300NAS switch,


 


#7 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,601 posts

Posted 15 August 2011 - 02:52 PM

O.K. this is what im getting my raid 10 to the raid 0 above

now a couple of things i know will help.

1. the ears drives arent 6.0 Drives

2. the raid 10 is 4x2TB 6.0 but they are connected to the onboard SAS with no cache (but there own 64Mb each)

from onboard raid 10 to Raid 0 above a 4GB Folder (tangled movie if you must ask)

Posted Image

from Raid 0 to onboard Raid 10

Posted Image

these speeds are about the average for these file transfers

silly me. I completely forgot about the existence of SATA III drives. I don't have any such drives so I have never run ATTO on one. I still find the discrepancy between read/write speeds a bit odd.

If at first you don't succeed, do it like your mother told you.


#8 Greg Welch

Greg Welch

    HSS Champion

  • Donating Member
  • 436 posts
  • LocationLas Vegas, NV

Posted 15 August 2011 - 09:33 PM

i know not ideal drives for testing, hoping to add 4-2tb hatachi 6.0 to the card in the next month once i get wife/cfo approval

Edited by welchwerks, 15 August 2011 - 09:33 PM.

Server:

4U Norco case with Windows Server 2012 on Dual Xeon 5620's, Supermicro X8DTH-6F with IPMI , LSI Raid 9260-4i linked to Chenbro 24 port 6Gb expander for 24 drives including Cachecade 2.0/Fastpath, 48GB's ECC Registered PNY Ram, 10 Intel Teamed  Nics,  Raids: 4 Pair / 8 Drive Raid 10 with a global hot spare then 2 - 4 Drive Raid 5's (all using the the 4 x 64GB SSD Drives in Raid 1 with LSI CacheCade 2.0 for a total of 256 GB Cache) all on 6GB using SAS connectors in Norco 15U rack plus APC 1500 UPS, PFSENSE Router in 1U case with SSD, 24 port NETGEAR GS724T-300NAS switch,


 


#9 c0op3r

c0op3r

    HSS Pro

  • Donating Member
  • 176 posts
  • LocationOrlando Fl

Posted 17 August 2011 - 06:42 PM

I have this card also, I was using the Intel on Board SATA RAID Controller for a RAID Ø, (2 Intel X-25 SSD's) but really wanted to get way from the quasi-software RAID. I was looking for a card that had on-board RAM and processor and was also more then PCIe 1x. So the LSI 9260-4i was basically the best price point for those specs without using the HighPoint (which I am not convinced are not using the processor of the workstation itself).

I am not going to make to many comments about how good the card is as I really don't have a lot of bases to make those kind of comments as I have only used a few cards.

I can show you the stats for the outcome of how the installation before and after.

This is CrystalDiskMark with the (2) Intel X-25 SSD's on the Intel Chipset RAID Controller RAID Ø configuration. This configuration yields a 7.9 on the Windows Experience Index.

Posted Image

Here is the CDM run on the LSI 9260-4i with the newest drivers and flash installed on the card:

Posted Image

The LSI was faster in everything except the 4k Read/Write QueDepth 32 I am not sure why. I am going to look at some of the option available for the LSI card, they have a battery which I see no need for as I have a Battery Back on the workstation. FastPath which is some sort of accelerator and CacheCade which looks like its used to put a SSD and a conventional Hard Drive in a strip to make it faster. Personally I think its a little crappy that they nickel and dime you for the extras, but I guess that is there business model.
___________________________
c0op3r

#10 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,601 posts

Posted 17 August 2011 - 07:02 PM

So the LSI 9260-4i was basically the best price point for those specs without using the HighPoint (which I am not convinced are not using the processor of the workstation itself).

I'm with you re: the HighPoint. Nothing against them, but they're what I call Host Bus Adapters rather than full RAID cards. For me, a true RAID card has to do all the processing on board, and have it's own memory for all data transactions. LSI is, AFAIK, still a good brand of these.

If at first you don't succeed, do it like your mother told you.


#11 c0op3r

c0op3r

    HSS Pro

  • Donating Member
  • 176 posts
  • LocationOrlando Fl

Posted 18 August 2011 - 05:33 AM

I'm with you re: the HighPoint. Nothing against them, but they're what I call Host Bus Adapters rather than full RAID cards. For me, a true RAID card has to do all the processing on board, and have it's own memory for all data transactions. LSI is, AFAIK, still a good brand of these.



Oh the one BIG set back to the LSI card (and this mght be for all Processor on board cards) is the my POST times are very long now, it add at least 20 to 30 seconds to startup.

Cooper
___________________________
c0op3r

#12 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,601 posts

Posted 18 August 2011 - 06:36 AM



Oh the one BIG set back to the LSI card (and this mght be for all Processor on board cards) is the my POST times are very long now, it add at least 20 to 30 seconds to startup.

Cooper

True, depending on the make/model of card the start times will increase by xx seconds, but unavoidable since they do have to load their own 'OS' as it were. Still, the benefit of increased performance from offloading the rest of the system makes it worth IMHO. The biggest downside I feel is the $$$. Full RAID cards ain't cheap baby! :P

If at first you don't succeed, do it like your mother told you.


#13 timekills

timekills

    HSS Advanced

  • Donating Member
  • 615 posts
  • LocationFBTX

Posted 18 August 2011 - 09:12 AM

You can offset that by disabling the card's ability to be bootable. You might (unfortunately) also have to set the onboard ports to RAID, even if you don't use them that way, but the onboard RAID BIOS checks are much, much faster than the add-on card's checks. If you disable the card's ability to boot, it won't go through the check during POST.

I could tell you how to do it with a lowly HBA-type adapter like the Highpoints ;) but you're on your own with the LSI's.

#14 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,601 posts

Posted 18 August 2011 - 10:25 AM

You can offset that by disabling the card's ability to be bootable. You might (unfortunately) also have to set the onboard ports to RAID, even if you don't use them that way, but the onboard RAID BIOS checks are much, much faster than the add-on card's checks. If you disable the card's ability to boot, it won't go through the check during POST.

I could tell you how to do it with a lowly HBA-type adapter like the Highpoints ;) but you're on your own with the LSI's.

Would be interesting to see how much time that can shave off.

If at first you don't succeed, do it like your mother told you.


#15 c0op3r

c0op3r

    HSS Pro

  • Donating Member
  • 176 posts
  • LocationOrlando Fl

Posted 18 August 2011 - 05:24 PM

You can offset that by disabling the card's ability to be bootable. You might (unfortunately) also have to set the onboard ports to RAID, even if you don't use them that way, but the onboard RAID BIOS checks are much, much faster than the add-on card's checks. If you disable the card's ability to boot, it won't go through the check during POST.

I could tell you how to do it with a lowly HBA-type adapter like the Highpoints ;) but you're on your own with the LSI's.



Can't do that, as I am booting from the card, the RAID Ø is my OS drive I have a 2TB WD Black for the data drive
___________________________
c0op3r

#16 tinkererguy

tinkererguy

    HSS Pro

  • Donating Member
  • 231 posts
  • LocationConnecticut

Posted 09 January 2012 - 12:16 AM

Fond of LSI 9260 and 9265 RAID controllers myself. Consider setting ATTO Disk Benchmark to help minimize the effects of the cache on the RAID controllers.

Looking forward to CacheCade 2.0 myself, due 1Q2012 for certain LSI cards:
http://tinkertry.com...gandesxsupport/

#17 fredp1

fredp1

    HSS Pro

  • Donating Member
  • 108 posts
  • LocationSydney, Australia

Posted 09 January 2012 - 05:09 AM

The Dell PERC H700 controller has a feature called “Cut-through IO (CTIO)” that should supposedly increase the throughput for SSD drive arrays.
I believe the Dell is similar to the LSI. (I have a Dell 700 but no SSD)

As per the documentation it says its enabled on an LD (logical drive) by disabling read ahead and enabling write through cache (WT + NORA).
You should see a perfromance increase on a SSD drive.

here are a couple of links
http://sqlblog.com/b...ugh-giggle.aspx
http://marcitland.bl...t-and-ssds.html
WHS 2011 Build - Fractel R3 Case, Gigabyte GA-Z68X-UD7-B3 MOBO, Corsair AX-750 PSU, Intel i5-2500K CPU w/8GB Corsair Vengeance DDR3 1333 RAM, ATI X300 series video, Dell Perc H700 Raid with 1Gb Cache. OS RAID 1 on twin Seagate Momentus 5400.6 SATA 3Gb/s 500Gb 2.5" Drives. Data is configured with 3 Seagate Barracuda Green 2Tb 5900 RPM drives in a RAID 5 configuration.

Main Desktop - Dell XPS 8300, ATI HD5700 series video, Intel i7-2600 CPU w/12GB RAM, Win 7-64 bit Home Preminum
Main Laptop - Dell Lattitude E5520, i5, 8Gb Ram, Win 7- 64bit Pro
Kids Desktop - Dell 8400, ATI HD5700 series, Win XP
Kids Laptop1 - Dell Lattitude, Win 7- 64 Bit Ultimate
Kids Laptop2 - Dell Inspiron, WIn 7- 64 Bit Home premium





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users