Jump to content
RESET Forums (homeservershow.com)
Noth

Microserver Gen8 as a bhyve hypervisor on FreeBSD 12.1

Recommended Posts

Noth

Hello!

 

  I wanted to share with you a less usual OS setup on the wonderful Microserver Gen8. My setup is the following:

 

CPU: Xeon 1265Lv2 with HyperThreading enabled (yes I'm aware of the security problems there)

RAM: 16Gb of 1600MHz ram, HP brand (669239-081)

Storage: 1x32Gb SanDisk SDSSDRC032G for the OS (ada0 device), 4x4Tb SATA-III drives (2 Seagate     
ST4000VX007 & 2x Toshiba 4949K2E7FBBG) on a HP P222 card (with 512Mb of cache) configured as RAID5 for the VM storage (ciss0 device, 10.6Tb).

Network: the 2 1Gb bge devices are trunked using LACP as a lagg0 device.

 

I've been running this setup since FreeBSD 11.0 came out, with ZFS on the RAID storage. Each VM gets a ZFS block device for speed and to take advantage of the resilience features of the filesystem. You may wonder what FreeBSD offers you that other platforms don't? Well FreeBSD has native support of an interesting feature for running VMs, called jails. These function like chroots or containers but in a more locked down way, so if someone escapes their VM they've landed in the middle of nowhere. ZFS is native to FreeBSD, making it a platform of choice for storage applications. It also comes with a multithreaded version of PF,  the OpenBSD originated firewall, offering plenty of security whilst still being fast. Libvirt, for the Linux afficionados, is nearly completely supported. All your favourite building blocks and common applications are available too, and the tools are there if you need to port your own app.

 

 

- 5 OpenBSD VMs, including one for running Zabbix from to monitor my homelab, and a builder VM to handle all self built packages.

- One FreeBSD VM running Nextcloud with 6Tb of storage, using nginx+php+postgresql+redis for optimum speed

- One Ubuntu VM for testing purposes

- 4 Windows 2019 Core Server VMs (1xPDC,1xBDC,1xWSUS,1xWindows Administration Center)

- 1 Windows 10 1909 Pro (for configuring and managing WSUS, which is too much of a pain in powershell. Microsoft really need to develop a proper TUI (ncurses?) for their Core Server products!)

 

It can be a bit tight sometimes RAMwise but runs pretty smoothly 99% of the time. It's also decently fast. I use the vm-bhyve scripts to setup and configure the VMs, apart from ZFS block device creation which still isn't supported directly, so you have to do that by hand and then add it to the VM's template. FreeBSD supports all the hardware really nicely, although you can't use the HP tools like Linux or Windows have, but I don't see any advantage to those for my use case. Only issue with FreeBSD 12.1 has been that OpenBSD can't boot with less than 320Mb of RAM, whereas it could manage with 160Mbish previously. 

 

Here's some system output logs:

 

P222 card: # cciss_vol_status -V /dev/ciss0
Controller: Smart Array P222
  Board ID: 0x3350103c
  Logical drives: 1
  Running firmware: 8.32
  ROM firmware: 8.32
/dev/ciss0: (Smart Array P222) RAID 5 Volume 0 status: OK. 
  Physical drives: 4
         connector 2I box 0 bay 1                 ATA     ST4000VX007-2DT1                                 ZDH6P3XB CV11     OK
         connector 2I box 0 bay 2                 ATA     TOSHIBA HDWE140                              4949K2E7FBBG FP1R     OK
         connector 2I box 0 bay 3                 ATA     ST4000VX007-2DT1                                 ZDH6RFF1 CV11     OK
         connector 2I box 0 bay 4                 ATA     TOSHIBA HDWE140                              493BK1FTFBBG FP1R     OK
/dev/ciss0(Smart Array P222:0): Non-Volatile Cache status:
                   Cache configured: Yes
                 Total cache memory: 304 MiB
                        Cache Ratio: 25Read / 75Write
                  Read cache memory: 76 MiB
                 Write cache memory: 228 MiB
                Write cache enabled: Yes
   Flash backed cache present

 

LACP: ifconfig lagg0
lagg0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 9000
        options=c0099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,VLAN_HWTSO,LINKSTATE>
        ether b0:5a:da:87:45:ec
        inet6 fe80::b25a:daff:fe87:45ec%lagg0 prefixlen 64 scopeid 0x4
        inet6 2001:788:f126:dead::4 prefixlen 64
        inet 192.168.50.4 netmask 0xffffff00 broadcast 192.168.50.255
        laggproto lacp lagghash l2,l3,l4
        laggport: bge0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        laggport: bge1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
        groups: lagg
        media: Ethernet autoselect
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

 

and finally dmesg:

 

---<<BOOT>>---
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.1-RELEASE-p1 GENERIC amd64
FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1)
VT(vga): resolution 640x480
CPU: Intel(R) Xeon(R) CPU E3-1265L V2 @ 2.50GHz (2494.38-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306a9  Family=0x6  Model=0x3a  Stepping=9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
  Structured Extended Features3=0x9c000400<MD_CLEAR,IBPB,STIBP,L1DFL,SSBD>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16596131840 (15827 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <HP     ProLiant>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads
random: unblocking device.
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Pm1aControlBlock: 16/32 (20181213/tbfadt-748)
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Pm2ControlBlock: 8/32 (20181213/tbfadt-748)
Firmware Warning (ACPI): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20181213/tbfadt-850)
Firmware Warning (ACPI): Invalid length for FADT/Pm2ControlBlock: 32, using default 8 (20181213/tbfadt-850)
ioapic0: Changing APIC ID to 8
ioapic0 <Version 2.0> irqs 0-23 on motherboard
Launching APs: 1 6 7 4 2 3 5
Timecounter "TSC-low" frequency 1247191969 Hz quality 1000
random: entropy device external interface
000.000017 [4335] netmap_init               netmap: loaded module
[ath_hal] loaded
module_register_init: MOD_LOAD (vesa, 0xffffffff8112e0f0, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
acpi0: <HP ProLiant> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
ciss0: <HP Smart Array P222> port 0x4000-0x40ff mem 0xfbf00000-0xfbffffff,0xfbef0000-0xfbef03ff irq 16 at device 0.0 on pci1
ciss0: PERFORMANT Transport
pcib2: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci2: <ACPI PCI bus> on pcib2
ehci0: <Intel Cougar Point USB 2.0 controller> mem 0xfacf0000-0xfacf03ff irq 21 at device 26.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
usbus0: 480Mbps High Speed USB v2.0
pcib3: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 28.4 on pci0
pci4: <ACPI PCI bus> on pcib4
pci0:3:0:0: failed to read VPD data.
bge0: <Broadcom BCM5720 A0, ASIC rev. 0x5720000> mem 0xfabf0000-0xfabfffff,0xfabe0000-0xfabeffff,0xfabd0000-0xfabdffff irq 16 at device 0.0 on pci4
bge0: APE FW version: NCSI v1.3.16.0
bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus0: <MII bus> on bge0
brgphy0: <BCM5720C 1000BASE-T media interface> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Using defaults for TSO: 65518/35/2048
bge0: Ethernet address: b0:5a:da:87:45:ec
pci0:3:0:1: failed to read VPD data.
bge1: <Broadcom BCM5720 A0, ASIC rev. 0x5720000> mem 0xfabc0000-0xfabcffff,0xfabb0000-0xfabbffff,0xfaba0000-0xfabaffff irq 17 at device 0.1 on pci4
bge1: APE FW version: NCSI v1.3.16.0
bge1: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus1: <MII bus> on bge1
brgphy1: <BCM5720C 1000BASE-T media interface> PHY 2 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Using defaults for TSO: 65518/35/2048
bge1: Ethernet address: b0:5a:da:87:45:ed
pcib5: <ACPI PCI-PCI bridge> at device 28.6 on pci0
pci5: <ACPI PCI bus> on pcib5
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xfbdf0000-0xfbdf1fff irq 18 at device 0.0 on pci5
xhci0: 64 bytes context size, 32-bit DMA
xhci0: Unable to map MSI-X table 
usbus1 on xhci0
usbus1: 5.0Gbps Super Speed USB v3.0
pcib6: <ACPI PCI-PCI bridge> at device 28.7 on pci0
pci6: <ACPI PCI bus> on pcib6
vgapci0: <VGA-compatible display> mem 0xf9000000-0xf9ffffff,0xfbce0000-0xfbce3fff,0xfb000000-0xfb7fffff irq 16 at device 0.1 on pci6
vgapci0: Boot video device
uhci0: <HP iLO Standard Virtual USB controller> port 0x3c00-0x3c1f irq 16 at device 0.4 on pci6
usbus2 on uhci0
usbus2: 12Mbps Full Speed USB v1.0
ehci1: <Intel Cougar Point USB 2.0 controller> mem 0xface0000-0xface03ff irq 20 at device 29.0 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci1
usbus3: 480Mbps High Speed USB v2.0
pcib7: <PCI-PCI bridge> at device 30.0 on pci0
pci7: <PCI bus> on pcib7
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Cougar Point AHCI SATA controller> port 0x10c0-0x10c7,0x10c8-0x10cb,0x10d0-0x10d7,0x10d8-0x10db,0x10e0-0x10ff mem 0xfacd0000-0xfacd07ff irq 17 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahciem0: <AHCI enclosure management bridge> at channel 2147483647 on ahci0
device_attach: ahciem0 attach returned 6
acpi_tz0: <Thermal Zone> on acpi0
acpi_syscontainer0: <System Container> port 0x2e-0x2f on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff pnpid ORM0000 on isa0
uart1: <Non-standard ns8250 class UART with FIFOs> at port 0x2f8 irq 3 on isa0
uart1: non-PNP ISA device will be removed from GENERIC in FreeBSD 12.
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est0 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est1 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est2 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est3 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est4 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fdd00001f00
device_attach: est5 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est6 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1fb400001f00
device_attach: est7 attach returned 6
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ugen3.1: <Intel EHCI root HUB> at usbus3
ugen0.1: <Intel EHCI root HUB> at usbus0
ugen2.1: <HP UHCI root HUB> at usbus2
ugen1.1: <0x1912 XHCI root HUB> at usbus1
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
uhub1: <HP UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
uhub3: <0x1912 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
ada0 at ahcich4 bus 0 scbus7 target 0 lun 0
ada0: <SanDisk SDSSDRC032G 3.1.0> ACS-2 ATA SATA 3.x device
ada0: Serial Number 151561401293
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 30533MB (62533296 512 byte sectors)
da0 at ciss0 bus 0 scbus0 target 0 lun 0
da0: <HP RAID 5 OK> Fixed Direct Access SPC-3 SCSI device
da0: Serial Number PDSXH0ARH5F07A  
da0: 135.168MB/s transfers
da0: Command Queueing enabled
da0: 11446247MB (23441914544 512 byte sectors)
GEOM: da0: the primary GPT table is corrupt or invalid.
GEOM: da0: using the secondary instead -- recovery strongly advised.
Trying to mount root from zfs:zboot/ROOT/default []...
Root mount waiting for: usbus3 usbus2 usbus1 usbus0
uhub1: 2 ports with 2 removable, self powered
uhub3: 6 ports with 6 removable, self powered
uhub0: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
Root mount waiting for: usbus3 usbus2 usbus1 usbus0
ugen2.2: <BMC Virtual Keyboard> at usbus2
ukbd0 on uhub1
ukbd0: <Virtual Keyboard > on usbus2
kbd2 at ukbd0
ugen0.2: <vendor 0x8087 product 0x0024> at usbus0
uhub4 on uhub2
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
ugen3.2: <vendor 0x8087 product 0x0024> at usbus3
uhub5 on uhub0
uhub5: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus3
Root mount waiting for: usbus3 usbus1 usbus0
uhub5: 6 ports with 6 removable, self powered
uhub4: 6 ports with 6 removable, self powered
ugen3.3: <vendor 0x0424 product 0x2660> at usbus3
uhub6 on uhub5
uhub6: <vendor 0x0424 product 0x2660, class 9/0, rev 2.00/8.01, addr 3> on usbus3
Root mount waiting for: usbus3 usbus1
uhub6: 2 ports with 1 removable, self powered
ugen1.2: <Seagate Expansion> at usbus1
umass0 on uhub3
umass0: <Seagate Expansion, class 0/0, rev 3.00/7.10, addr 1> on usbus1
umass0:  SCSI over Bulk-Only; quirks = 0xc101
umass0:9:0: Attached to scbus9
Root mount waiting for: usbus3
da1 at umass-sim0 bus 0 scbus9 target 0 lun 0
da1: <Seagate Expansion 0710> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number NAADMFQE
da1: 400.000MB/s transfers
da1: 3815447MB (7814037167 512 byte sectors)
da1: quirks=0x2<NO_6_BYTE>
ugen3.4: <Generic Ultra Fast Media Reader> at usbus3
umass1 on uhub6
umass1: <Generic Ultra Fast Media Reader, class 0/0, rev 2.00/2.10, addr 4> on usbus3
umass1:  SCSI over Bulk-Only; quirks = 0xc100
umass1:10:1: Attached to scbus10
da2 at umass-sim1 bus 1 scbus10 target 0 lun 0
da2: <HP iLO LUN 00 Media 0 2.10> Fixed Direct Access SCSI device
da2: Serial Number 000002660A01
da2: 40.000MB/s transfers
da2: 256MB (524288 512 byte sectors)
da2: quirks=0x2<NO_6_BYTE>
da2: Write Protected
GEOM: da1: the primary GPT table is corrupt or invalid.
GEOM: da1: using the secondary instead -- recovery strongly advised.
GEOM_ELI: Device ada0p2.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
lo0: link state changed to UP
lagg0: link state changed to DOWN
ums0 on uhub1
ums0: <Virtual Mouse> on usbus2
CPU: Intel(R) Xeon(R) CPU E3-1265L V2 @ 2.50GHz (2494.38-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306a9  Family=0x6  Model=0x3a  Stepping=9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
  Structured Extended Features3=0x9c000400<MD_CLEAR,IBPB,STIBP,L1DFL,SSBD>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
bridge0: Ethernet address: 02:6e:41:39:86:00
bridge0: changing name to 'vm-public'
Security policy loaded: MAC/ntpd (mac_ntpd)
tap0: Ethernet address: 00:bd:69:21:f7:00
tap0: promiscuous mode enabled
vm-public: link state changed to DOWN
tap0: link state changed to UP
vm-public: link state changed to UP
nd6_dad_timer: cancel DAD on tap0 because of ND6_IFF_IFDISABLED.
tap1: Ethernet address: 00:bd:6e:29:f7:01
tap1: promiscuous mode enabled
tap1: link state changed to UP
nd6_dad_timer: cancel DAD on tap1 because of ND6_IFF_IFDISABLED.
tap2: Ethernet address: 00:bd:53:31:f7:02
tap2: promiscuous mode enabled
tap2: link state changed to UP
nd6_dad_timer: cancel DAD on tap2 because of ND6_IFF_IFDISABLED.
tap3: Ethernet address: 00:bd:95:39:f7:03
tap3: promiscuous mode enabled
nd6_dad_timer: cancel DAD on tap3 because of ND6_IFF_IFDISABLED.
tap4: Ethernet address: 00:bd:b5:41:f7:04
tap4: promiscuous mode enabled
tap4: link state changed to UP
nd6_dad_timer: cancel DAD on tap4 because of ND6_IFF_IFDISABLED.
tap5: Ethernet address: 00:bd:14:4b:f7:05
tap5: promiscuous mode enabled
tap5: link state changed to UP
tap3: link state changed to UP
nd6_dad_timer: cancel DAD on tap5 because of ND6_IFF_IFDISABLED.
tap6: Ethernet address: 00:bd:2a:53:f7:06
tap6: promiscuous mode enabled
tap6: link state changed to UP
nd6_dad_timer: cancel DAD on tap6 because of ND6_IFF_IFDISABLED.
tap7: Ethernet address: 00:bd:0c:5b:f7:07
tap7: promiscuous mode enabled
tap7: link state changed to UP
nd6_dad_timer: cancel DAD on tap7 because of ND6_IFF_IFDISABLED.
tap8: Ethernet address: 00:bd:d9:63:f7:08
tap8: promiscuous mode enabled
tap8: link state changed to UP
nd6_dad_timer: cancel DAD on tap8 because of ND6_IFF_IFDISABLED.
tap9: Ethernet address: 00:bd:34:6c:f7:09
tap9: promiscuous mode enabled
tap9: link state changed to UP
nd6_dad_timer: cancel DAD on tap9 because of ND6_IFF_IFDISABLED.
tap10: Ethernet address: 00:bd:12:74:f7:0a
tap10: promiscuous mode enabled
tap10: link state changed to UP
nd6_dad_timer: cancel DAD on tap10 because of ND6_IFF_IFDISABLED.
tap11: Ethernet address: 00:bd:28:7d:f7:0b
tap11: promiscuous mode enabled
tap11: link state changed to UP
nd6_dad_timer: cancel DAD on tap11 because of ND6_IFF_IFDISABLED.
bge0: link state changed to DOWN
bge0: link state changed to UP
bge1: link state changed to DOWN
bge1: link state changed to UP
lagg0: link state changed to UP
bge0: promiscuous mode enabled
bge1: promiscuous mode enabled
lagg0: promiscuous mode enabled

 

Edited by Noth

Share this post


Link to post
Share on other sites
nrf

that's a lot on 16 gig of ram. did you have to spend much time shoe-horning?

besides zfs on top of raid do you do backups somewhere else?

Share this post


Link to post
Share on other sites
Noth

I optimise RAM usage thanks to the graphs Zabbix generates for each VM, so the shoehorning works. I was surprised how little RAM Win2019 machines will use when they're mostly idle: 768Mb for a PDC! Microsoft have really worked hard on this. When I need to batch build a new release of OpenBSD packages (especially for browsers and LibreOffice) I shutdown the Win10 Pro VM so I can give the builder VM a couple of extra gigabytes. Win 10 Pro manages ok in just 4G if all it does is update itself and run the WSUS MMC. I have 16Gb of swap on the SSD to help things out but the few times I've run 2 extra 1Gb of RAM linux VMs, the machine runs out of memory fairly rapidly and panics, killing all processes, needing a hard reboot.

 

For backups I use the not perfect but usable and cheap method of the external USB drive, 4TB connected directly to the box, using daily incremental backups with duplicity. It runs pretty nicely, formatted with ZFS as well of course. I'm not a fan of cloud storage, so this method works for me.

 

Medium term, I'd like to upgrade to something with a lot more RAM and a few more cores but that's still a microserver. This forum has given me a few ideas but the cash layout for a base system will take a while to save enough money for.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now



×
×
  • Create New...