Router and Network Setup¶

I started my foray into custom networking using DD-WRT running on a Linksys WRT3200ACM. This worked well for a while but I noticed performance issues as my network grew. In October 2019 I decided to go all in and setup a pfsense router. And then in 2021 I switch to an OPNsense based router.

Router¶

• HP EliteDesk 800 G2 SFF Desktop PC
• Intel Core i5-6600T (quad core @ 3.3 GHz; upgraded from i5-6500)
• 8GB RAM
• 128GB SSD HDD
• Intel quad port 1G NIC
• Mellanox MCX354A-FCCT (40GigE)

• Running OPNsense : 23.7.9 (based on FreeBSD 13.2)

• em0 (top port) - em3 are the Intel 1G quad port interfaces
• em4 is the built in motherboard NIC

Main Switch¶

• 24 port 1000-BaseT POE ports
• 8 SFP+ (10G) ports
• 2 QSFP (40G) ports
• 2 QSFP (4x10G breakout) ports

Configuration¶

The network is subdivided into CopperLAN which is 1G copper and FiberLAN which is 10G fiber:

• CopperLAN
  • 192.168.1.1/16
  • Switch ports: 1/1/1-1/1/24; 1/2/1 (40G router uplink)
  • VLAN 10
• FiberLAN
  • 10.250.1.1/24
  • Switch ports: 1/3/1 - 1/3/8; 1/2/6 (40G router uplink)
  • VLAN 20

Port Connection Table¶

CopperLAN¶

FiberLAN¶

DHCP Assignments¶

CopperLAN¶

FiberLAN¶

10G Supplemental Switch¶

MikroTik CRS305-1G-4S

NOTE: Switch has two operating system options. SWOS is much simpler and therefore preferred for this application. Note that holding the reset button while powering only resets the RouterOS configuration not the SWOS configuration. To reset SWOS boot into RouterOS and navigate to the terminal, then enter this command:

/system swos reset-config

Also to set the boot OS: System > Routerboard > Settings > Boot OS

Reset Instructions¶

• Disconnect all network ports. Disconnect power, using tip of mechanical pencil press reset button and hold. Reconnect power. When green light flashes several times release the reset button.
• Switch will reboot into RouterOS.
• To connect connect to MGMT (1G) port to laptop. Set static address on laptop to 192.168.88.2/255.255.255.0 with gateway 192.168.88.1. Open web browser and navigate to 192.168.88.1.
• Enter basic details, including DHCP setup.
• Click Terminal button in upper right corner.
  • Enter this command to reset SwOS:
    

    /system swos reset-config
    

• Next navigate back to Webconfig to change boot configuration: System > Routerboard > Settings > Boot OS and set SwOS.
• Finally click the Reboot option on the side menu.
• Disconnect from laptop and connect MGMT port back to regular network. After reboot switch should be accessible at DHCP reservation address: 192.168.100.2.
• Default credentials are: admin/<no password>

Configuration¶

To use 1G port as management port go to RSTP tab and uncheck the checkbox next to MGMT. In Port Isolation tab, isolate MGMT from other ports.

Wireless AP¶

• https://www.commscope.com/product-type/enterprise-networking/wireless-access-points/indoor/r710/

Wireless Networks¶

• 57752d54616e67204c414e - legacy 5 GHz - WPA2
  • Decomissioned: June 22, 2024
• 4162726168616d204c696e6b737973 - legacy 2.4 GHz - WPA2
• Weyland-Yutani Corporate - 5 GHz/2.4 GHz - WPA3/WPA2

Backup Switch¶

• TP-LINK TL-SG1016D - 24 port "dumb" switch

Resources¶

• Fohdeesha Docs
• Brocade ICX Series Switches - STH Forum