Jump to content


Photo

Super Router - Re-do


  • Please log in to reply
92 replies to this topic

#81 yodafett

yodafett

    HSS Champion

  • Members
  • 303 posts
  • LocationFt Worth, TX

Posted 07 April 2012 - 06:35 AM

Okay Mike....do the math....70k pictures a year? That's an average of 200 a day. That is one itchy trigger finger.....just kidding. You take some nice photos and have a great eye for composition.

Ahh but the true mastery of photography and one i have yet to master due to OCD is throwing awaying 90% of what you take
Bryan
Server i3 2100 8GB 1.5TB Mirrored | MacDell GX620 P4D 2.8 4GB 80GBHD running 10.6.7| MacDellBook D420 running OSX 10.6.8
Main 3.0 C2Quad 8gb 160 Raptor, 1TB Windows 7 Ult. x64 | ESXi C2Quad 2.83 250 and Mirrored 500GB | HTPC D525 4GB 60gb SSD Win7
iSCSI SAN HP N40L Microserver running 4x 3TB HD running Openfiler | HP N40L MicroServer running CommodoreVision Linux

#82 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 834 posts
  • LocationAtlanta Area

Posted 07 April 2012 - 08:05 AM

Okay Mike....do the math....70k pictures a year? That's an average of 200 a day. That is one itchy trigger finger.....just kidding. You take some nice photos and have a great eye for composition.


I know, it's a lot. But the average is skewed by large chunks. For example, I can take 1,200+ at a swim meet and that's all in about 6 hours.

Also, it wasn't 70k per year, the 70 number was the size of the files 70MB per RAW file from the D800. I shoot more like 40,000 images per year, but it could be as low as 20,000.

Ahh but the true mastery of photography and one i have yet to master due to OCD is throwing awaying 90% of what you take


It could be that I am a digital pack rat, but I never delete any of the images. I do cull them down to a reasonable number and only edit and share a few, but I never delete them. For example, I might shoot 1,200 images at a swim meet, but pick less than 300 to edit and post online for the parents.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#83 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 834 posts
  • LocationAtlanta Area

Posted 07 April 2012 - 10:45 AM

Did some stress testing this morning. While Crashplan had the upload saturated, I tried to push out TWO 720p streams (one to Justin TV another to LiveStream). CPU on broadcast server was hitting near 70%, but after an hour of testing, not a single dropped frame. Only problem is the speed I am pushing out to the stream is faster than anyone with a normal DSL connection, which means I can't really do this for a live show.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#84 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,528 posts

Posted 07 April 2012 - 10:47 AM

What a shame; you have more capacity than you need. Isn't it awful when capacity is wasted like that? :D

If at first you don't succeed, do it like your mother told you.


#85 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 834 posts
  • LocationAtlanta Area

Posted 07 April 2012 - 10:53 AM

I know, kind of crazy when my upload is higher than many people's download. O' well. The main thing I wanted to point out in the above comment was how well traffic shaping is working. Kids are up stairs playing games and I have asked them if they had any issues and all is good on their end. As far as they know, nothing else is going on even though our upload has been maxed out for days.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#86 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,528 posts

Posted 07 April 2012 - 11:15 AM

lol, with your bandwidth I'm not surprised. You're a lucky guy. I can't get more than 1 up.

If at first you don't succeed, do it like your mother told you.


#87 mattd390

mattd390

    HSS Pro

  • Donating Member
  • 233 posts
  • LocationGrand Blanc, Michigan

Posted 07 April 2012 - 11:24 AM

Exactly what I was thinking. Now that I am looking at picking up a Nikon D800, those 36mp files are going to take up a LOT of space. Each RAW file is about 70Mb+ and I take as much as 40,000/year.


Holy moly, you'd have to add a 3 TB drive a year at that rate right?

Server - I3 550 / GA-H55-USB3 / 8 GB / 7 TB storage / WHS 2011
Main Rig - i7 2600k / GA-Z68X-UD3-B3 / 16 GB / 240 GB Agility 3 SSD / Win 7 Ult
Super Router - Supermicro X7SPE-HF-D525-O / 4 GB / 40 GB Vertex SSD / PfSense
Laptop - Cyberpower X6-9100 / i7 2670QM / 16 GB / 240 GB Samsung 840 SSD / Win 7 Pro
HP Microserver - 2008R2 - 8 GB - 250 GB


#88 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 834 posts
  • LocationAtlanta Area

Posted 07 April 2012 - 12:57 PM

Holy moly, you'd have to add a 3 TB drive a year at that rate right?


Most of the sports shots I take will not be at the full 36MP. A lot of them will done using the 1.5 crop mode which is only 15MP and I think the RAW file size is in the low 20MB range.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#89 mattd390

mattd390

    HSS Pro

  • Donating Member
  • 233 posts
  • LocationGrand Blanc, Michigan

Posted 07 April 2012 - 01:03 PM

Most of the sports shots I take will not be at the full 36MP. A lot of them will done using the 1.5 crop mode which is only 15MP and I think the RAW file size is in the low 20MB range.


That's not so bad then :D.

Server - I3 550 / GA-H55-USB3 / 8 GB / 7 TB storage / WHS 2011
Main Rig - i7 2600k / GA-Z68X-UD3-B3 / 16 GB / 240 GB Agility 3 SSD / Win 7 Ult
Super Router - Supermicro X7SPE-HF-D525-O / 4 GB / 40 GB Vertex SSD / PfSense
Laptop - Cyberpower X6-9100 / i7 2670QM / 16 GB / 240 GB Samsung 840 SSD / Win 7 Pro
HP Microserver - 2008R2 - 8 GB - 250 GB


#90 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 834 posts
  • LocationAtlanta Area

Posted 07 April 2012 - 01:35 PM

Went out and cut the grass and left the broadcast server streaming a 720p stream to Justin TV and a second 720p stream at a much lower bit rate. More than 2.5 hours later not one dropped frame. I call the stress test complete and traffic shaping a success.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#91 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,528 posts

Posted 07 April 2012 - 01:38 PM

Went out and cut the grass and left the broadcast server streaming a 720p stream to Justin TV and a second 720p stream at a much lower bit rate. More than 2.5 hours later not one dropped frame. I call the stress test complete and traffic shaping a success.


I think you need another 432.63 hours of testing to be sure :) <j/k>

If at first you don't succeed, do it like your mother told you.


#92 yodafett

yodafett

    HSS Champion

  • Members
  • 303 posts
  • LocationFt Worth, TX

Posted 07 April 2012 - 01:47 PM

He should stream firefly series on one stream and battlestar galatica on the second just to be sure
Bryan
Server i3 2100 8GB 1.5TB Mirrored | MacDell GX620 P4D 2.8 4GB 80GBHD running 10.6.7| MacDellBook D420 running OSX 10.6.8
Main 3.0 C2Quad 8gb 160 Raptor, 1TB Windows 7 Ult. x64 | ESXi C2Quad 2.83 250 and Mirrored 500GB | HTPC D525 4GB 60gb SSD Win7
iSCSI SAN HP N40L Microserver running 4x 3TB HD running Openfiler | HP N40L MicroServer running CommodoreVision Linux

#93 Dan

Dan

    HSS Member

  • Members
  • 11 posts
  • LocationKansas City

Posted 17 January 2013 - 10:35 PM

Nice jmwills. There is a little quirk with the shaping. While you can create your own ques, doing so will break some of the graphs. So, I create a bunch of ques in the Traffic Shaper Wizard and then rename them to what I want. I then delete any rules and ques I don't want.


Hi.

Do you know if the "breaking of the graphs" is a 1.x or a 2.x thing? Earlier in the thread you said you were on 1.x, but wondered if you had tried it on 2.x yet. I'm on 2.x, and am trying to follow your advise of using the wizard to create everything then rename them. However, I can't get the wizard to create enough queues that I can "steal", they almost all seem to be valid. Also, in 2.x, the rules screen is very different than the one you showed in #45. I'm having a hard time translating. Any thoughts would be appreciated!

Thanks.




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users