Jump to content


Photo

Super Router


  • Please log in to reply
104 replies to this topic

#61 axiom00

axiom00

    HSS 1 Post Wonder

  • Members
  • 3 posts

Posted 24 May 2011 - 12:32 AM

geek-accountant and burix,

I am planning on going down the same path as you guys and running pfSense in a virtualize environment. Based on what I've been reading, PfSense under Xenserver is limited to 100mbps due the virtual NIC that Xenserver preseent to pfSense.

@geek-accountant: Have you noticed any issue with pFsense's LAN port cannot run at gigabit? I am assuming pfSense is handling all your routing, so does that impact your LAN speed when transferring files from one server?

@burix-With your setup of pfSense and Untangle under ESXi, are the virtual NIC's running @ 1 gigabit or is still limited to 100mbps like under Xenserver?

Thanks.

#62 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 836 posts
  • LocationAtlanta Area

Posted 26 May 2011 - 09:34 PM

Yes, pfSense will be limited to 100mbps under Xenserver. Since my ISP connection is only 60mbps, this is not a problem. Local network traffic does not flow through pfSense and instead flows through my switch which is a gig switch. So no, pfSense is not slowing down local traffic.

Tomorrow morning, I am tearing the whole thing down and replacing the CPU with a quad core. I know I have always said my Xenserver running the Super Router will only have the Super Router on it, but it has run so rock solid that I feel comfortable giving it a bit more juice (ie CPU) and letting it do some other light weight work like testing other non-Windows systems. This and the fact I am re-purposing my second Xenserver to be a Windows Storage Server running SQL and Sharepoint (I hope).

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#63 generious

generious

    HSS 1 Post Wonder

  • Members
  • 9 posts
  • LocationIreland

Posted 29 May 2011 - 01:03 PM

geek-accountant and burix,

I am planning on going down the same path as you guys and running pfSense in a virtualize environment. Based on what I've been reading, PfSense under Xenserver is limited to 100mbps due the virtual NIC that Xenserver preseent to pfSense.

@geek-accountant: Have you noticed any issue with pFsense's LAN port cannot run at gigabit? I am assuming pfSense is handling all your routing, so does that impact your LAN speed when transferring files from one server?

@burix-With your setup of pfSense and Untangle under ESXi, are the virtual NIC's running @ 1 gigabit or is still limited to 100mbps like under Xenserver?

Thanks.


depending on which virtual nic and virtual hardware version you have have either the virtual intel/amd adapters which are 10/100/1000 adapters.
or if you go with virtual hardware version 7 you can add in a vmxnet3 adapter which supports 10GB/s ( This is a great nic under windows VMs if all systems are in the same port groups and all using vmxnet3 adapters )

So no with VMware ESXi 4.1 update 1 you are not limted to 10/100 as you are with Xen.
To add to this what you can do on top of just pfsense and untangle is put a vyatta router in the mix.

Edited by generious, 29 May 2011 - 01:04 PM.


#64 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,583 posts

Posted 30 May 2011 - 09:29 AM

depending on which virtual nic and virtual hardware version you have have either the virtual intel/amd adapters which are 10/100/1000 adapters.
or if you go with virtual hardware version 7 you can add in a vmxnet3 adapter which supports 10GB/s ( This is a great nic under windows VMs if all systems are in the same port groups and all using vmxnet3 adapters )

So no with VMware ESXi 4.1 update 1 you are not limted to 10/100 as you are with Xen.
To add to this what you can do on top of just pfsense and untangle is put a vyatta router in the mix.

OK, seriously, how many routers does 1 person need on their home LAN? :) j/k

If at first you don't succeed, do it like your mother told you.


#65 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 836 posts
  • LocationAtlanta Area

Posted 30 May 2011 - 02:31 PM

Funny, I was just thinking how much I love my router last night. My PC was downloading a large file, the youngest kid and a friend were on Xbox Live playing an online game, the oldest was watching something on Youtube and the wife was watching a Netflix movie. I was playing Black Ops on Xbox Live and never once notice any connection issues or lag in the game, and neither did anyone else. Maybe I just am bad at picking pre-made routers, but non I have had in the past could handle all that and their not be issues somewhere. O, and the router had not been re-booted in a little over 100 days when all this was going on. And all this was on the Xenserver which as noted before can only do NIC's of 10/100 when Xen tools are not loaded. Since my connection is under 100mbps, it shouldn't be a problem.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#66 jmwills

jmwills

    HSS Genius

  • Donating Member
  • 5,128 posts
  • LocationHuntsville, AL

Posted 30 May 2011 - 02:46 PM

The 10/100 would be internal speeds, right?
Windows 7 Desktop - Antec 100 Case, Intel D8H67BL, OCZ 550W PSU, Intel i3-530 CPU w/16GB G-Skill DDR3 1333 RAM
Server 2012 - Fractal Arc Midi, CoolerMaster M600 PSU, ASUS P8H67V, Intel i5-2500 CPU w/32GBG-Skill DDR3 1333 RAM, 90 GIG OCZ SSD OS Drive – Roles: Hyper-V (WHS-SharePoint-DC-SQL-Exchange-WSE 2012), Print Server - Rocket RAID 2720 5x2TB
HTPC Build - Silverstone GD05 Case, ASUS P7H55-M PRO, CoolerMaster M600W PSU, Intel i3-530 CPU w/4GB G-Skill DDR3 1333 RAM. OCZ 60GB SSD Drive for the OS with a 120GB WD 2.5" Blue drive for data storage.
Travel Laptop: Dell XPSL502X 15.6"

#67 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 836 posts
  • LocationAtlanta Area

Posted 30 May 2011 - 03:12 PM

Internal to Xenserver and to the WAN address. The local traffic all flows through my switch.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#68 generious

generious

    HSS 1 Post Wonder

  • Members
  • 9 posts
  • LocationIreland

Posted 30 May 2011 - 03:44 PM

OK, seriously, how many routers does 1 person need on their home LAN? :) j/k

Hehe you don't want to know :)
I have a ton of gear at home(then again I work from home and I need a lab to work on so work has paid for most of the stuff)

You will start off with virtual utms and routers then eventually see this little thing called vlans and jumbo frames and ACLs and trunking ect then you know all about it hehe.

#69 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,583 posts

Posted 30 May 2011 - 03:49 PM

Hehe you don't want to know :)
I have a ton of gear at home(then again I work from home and I need a lab to work on so work has paid for most of the stuff)

You will start off with virtual utms and routers then eventually see this little thing called vlans and jumbo frames and ACLs and trunking ect then you know all about it hehe.

LOL, I work with all of those, but not at home, at least nowhere near all of them. I have Untangle as my home UTM. I have run VMs and DCs at home, but not now. I am using jumbo frames. VLANs are at work, along with ACLs. I've adopted a more KISS philosophy for home the last few years.

If at first you don't succeed, do it like your mother told you.


#70 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,583 posts

Posted 15 July 2011 - 10:25 AM

I just ran into an odd issue with Untangle that I thought I would pass along.

I was investigating the Captive Portal feature of Untangle. We have a project at work that calls for it. The trick is that it would be using ADSL rather than cable.

When I went to test the CP feature I ran into a problem. I put the ADSL modem (Actiontec GT701D) into transpartent bridging mode and set up Untangle to do PPPoE. It wouldn't work. I tried 3 different models of ADSL modems with the same results. Finally, I hit the Untangle Wiki and, guess what, they don't recommend using Untangle for PPPoE! I was shocked. I've never heard of a router that doesn't like PPPoE. And, despite everything I tried I still haven't gotten it to successfully make a DSL connection.

Untangle recommends putting the ADSL modem into bridging mode but have it do the PPPoE stuff. That seems a bit of a contradiction to me. I thought bridging meant the modem doesn't do the PPPoE stuff - it just passes the traffic back and forth and does the modulation. Anyone have any insight to what they mean?

BTW, when used in router mode, the ADSL modem does the PPPoE perfectly. I was actually just trying to simply things by not having 2 routers in the link. I would put Untangle into bridge mode but I do need to do a port forward to a device we need to administer and AFAIK Untangle has to be in router mode to do forwarding.

If at first you don't succeed, do it like your mother told you.


#71 no-control

no-control

    HSS Elite

  • BYOB Podcasters
  • 1,757 posts
  • LocationSoCal

Posted 17 July 2011 - 03:45 PM

Is it because the PPPoE you're using requires authentication? Only other reason I can see is due to the packet overhead of PPPoE. unTangle may just flat out reject it due to the overhead of the Ethernet packet in large frames. It's not the lightest program so maybe they figure with the extra needed for the PPoE it would kill their minimum specs (increase them).

Just my best guess.
VISIT MY NEW BLOG

Main Rig - i3-3225, H60, ASRock H77 mITX, 8GB G.Skill RJX, R6970 Lighting, 256GB M4 SSD, WD 500GB, Seasonic x650, CM Elite 210, Dell U3011 w/ 2x 2007fp PLP - W7 -|-
HTPC - G620, Big Shuriken, ASRock H77M , 4GB OCZ, 128GB G.Skill Falcon, .5TB WD CB, Sony BD-R, Corsair CX400, LianLi C37B - W7 -|-
VM Server - i3-3220, Z77-D3H, 32GB G.Skill, 250GB OS, 3x3TB WD GP R5, 4x300GB WD VR R0, Corsair CX430, Fractal R3 - WS2012 -|-
Lenovo Yoga 13 | Surface RT | HTC Titan
Find me on the internet

#72 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,583 posts

Posted 19 July 2011 - 07:22 AM

Is it because the PPPoE you're using requires authentication? Only other reason I can see is due to the packet overhead of PPPoE. unTangle may just flat out reject it due to the overhead of the Ethernet packet in large frames. It's not the lightest program so maybe they figure with the extra needed for the PPoE it would kill their minimum specs (increase them).

Just my best guess.

Like most PPPoE, a user ID and password are required. Is that what you mean by authentication, or are you talking about something else?

I have tried the user ID and password in both the ADSL modem and Untangle: it works in the modem, not in UT.

If at first you don't succeed, do it like your mother told you.


#73 no-control

no-control

    HSS Elite

  • BYOB Podcasters
  • 1,757 posts
  • LocationSoCal

Posted 20 July 2011 - 12:59 AM

Yeah that's what I meant. Sorry I can't be of more help. The above is/was my best guess! Posted Image
VISIT MY NEW BLOG

Main Rig - i3-3225, H60, ASRock H77 mITX, 8GB G.Skill RJX, R6970 Lighting, 256GB M4 SSD, WD 500GB, Seasonic x650, CM Elite 210, Dell U3011 w/ 2x 2007fp PLP - W7 -|-
HTPC - G620, Big Shuriken, ASRock H77M , 4GB OCZ, 128GB G.Skill Falcon, .5TB WD CB, Sony BD-R, Corsair CX400, LianLi C37B - W7 -|-
VM Server - i3-3220, Z77-D3H, 32GB G.Skill, 250GB OS, 3x3TB WD GP R5, 4x300GB WD VR R0, Corsair CX430, Fractal R3 - WS2012 -|-
Lenovo Yoga 13 | Surface RT | HTC Titan
Find me on the internet

#74 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,583 posts

Posted 20 July 2011 - 06:42 AM

Yeah that's what I meant. Sorry I can't be of more help. The above is/was my best guess! Posted Image

Your contributions are always appreciated, at least by me ;)

In the end, I set up both the modem and UT as routers. The modem couldn't do port forwarding and UT couldn't do PPPoE. Between them, it now works :)

If at first you don't succeed, do it like your mother told you.


#75 no-control

no-control

    HSS Elite

  • BYOB Podcasters
  • 1,757 posts
  • LocationSoCal

Posted 20 July 2011 - 09:30 PM

Hurray for overhead! Posted Image
VISIT MY NEW BLOG

Main Rig - i3-3225, H60, ASRock H77 mITX, 8GB G.Skill RJX, R6970 Lighting, 256GB M4 SSD, WD 500GB, Seasonic x650, CM Elite 210, Dell U3011 w/ 2x 2007fp PLP - W7 -|-
HTPC - G620, Big Shuriken, ASRock H77M , 4GB OCZ, 128GB G.Skill Falcon, .5TB WD CB, Sony BD-R, Corsair CX400, LianLi C37B - W7 -|-
VM Server - i3-3220, Z77-D3H, 32GB G.Skill, 250GB OS, 3x3TB WD GP R5, 4x300GB WD VR R0, Corsair CX430, Fractal R3 - WS2012 -|-
Lenovo Yoga 13 | Surface RT | HTC Titan
Find me on the internet

#76 Cino

Cino

    HSS Member

  • Members
  • 38 posts

Posted 25 July 2011 - 09:47 AM

@geek-accountant Nice setup. I've have tried this in the past but the performance drop wasn't worth it. I was using ESXi instead of Xenserver. My cable connect is 50/5. With pfSense bare-bone, i was getting 50/5. Running pfSense on ESXi, 50/5. ESXI with pfSense and unTangle running but traffic not passing thru it, 40-47/4. With pfSense to unTangle, 5-10/4(ouch). Setting up pfSense and unTangle with a cross-over cable so they had physical NICs, 30-40/4. Now I was running this on a Atom D510 with Intel NICs, so i'm thinking that is the issue; not enough horse power.. I should try this using Xenserver and see if the performance gets better. I could change the HW out, but i like 20w box :-)

#77 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 836 posts
  • LocationAtlanta Area

Posted 25 July 2011 - 05:38 PM

I don't think you will have much more luck with Xenserver. I was having some trouble with my untangle VM and right now am running with only pfSense. Part of the problem, I think, was the virtual NIC in Xenserver. Running pfSense alone, I am getting slightly above my 60/5 plan with an average speed of around 63-65 down. The up speed is right at 5.

As soon as I get some time, I am going to re-install Untangle and try only using physical NIC's and see if that works better. Untangle does require a bit more horsepower and can't compete with the speed of pfSense, but I am not willing to take more than a 5% haircut, and my latency needs to stay pretty low for all our online gaming.

Problem for me is, I don't know when I will have time to work on this. pfSense runs so rock solid that I never even think about it. It's not unusual for it to run 50, 60, or even 100+ days and not need a reboot. There are things I like about Untangle, but if I have to chose just one, I am sticking with pfSense, that's just my personal preference.

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site


#78 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,583 posts

Posted 25 July 2011 - 07:37 PM

ah, c'mon already; you're making me think about pfsense again, and my UT has been running so well too ;)

If at first you don't succeed, do it like your mother told you.


#79 Cino

Cino

    HSS Member

  • Members
  • 38 posts

Posted 26 July 2011 - 12:19 PM

I love pfSense... Been using it for 3+ years now. I wish my uptime was high but i'm always updating the code on my box.. I like running bleeding edge i guess.. My other half doesn't like it but she doesn't need to be on facebook all the time...lol

My hardware is overkill for pfsense but it allows me to run many packages without issues... Once pfsense 2.0 is officially release(its just about there) I'll be putting HVAP, Squid packages back on. I usually run snort but that package is broken right now as the dev is working on a nice upgrade for 2.0.

Since my ISP doesn't have IPv6 right now, I'm able to create an IPv6 tunnel with pfsense so my clients can access IPv6 enabled sites... neat stuff..

My only issue with pfsense is its HVAP and Squid/Squid Guard packages... They work well but the reporting isn't up to par i think. pfSense itself has great real-time reporting but isn't the greatest for historical data IMHO.

#80 geek-accountant

geek-accountant

    HSS Advanced

  • HSS Writers
  • 836 posts
  • LocationAtlanta Area

Posted 26 July 2011 - 05:27 PM

I wanted to try 2.0, but it would never even install. From the research I did, it may been an issue with AMD chips. Hopefully they will have that worked out before the official release of 2.0

ikon, if you had these setup as VM's, you could switch between pfSense and Untangle at will. Just turn one off and the other on. :D

unRAID server 18.5TB
WSS-2011 5TB internal + 4x3TB RAID 5 Mediasonic USB 3.0 external storage
Hyper-V server running 10 VM's(AMD 6 core with 16gig of ram - Raid 5 & Raid 0, plus USB 3 Mediasonic 4 drive enclosure)
pfSense & Untangle (aka, SUPER ROUTER) running as seperate machines
Broadcast server - broadcast the jpeg2RAW podcast - AMD 8 core 4Ghz, 8gig DDR3 1600, RAID 0
The jpeg2RAW podcast site





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users