Project

General

Profile

Router » History » Version 15

Anonymous, 11/23/2023 01:37 PM

1 1
h1. Router and Network Setup
2
3 13
I started my foray into custom networking using DD-WRT running on a Linksys WRT3200ACM. This worked well for a while but I noticed performance issues as my network grew. In October 2019 I decided to go all in and setup a pfsense router.  And then in 2021 I switch to an OPNsense based router.
4 1
5 3
h2. Router
6 1
7 2
!hp_elitedesk_800_G2.jpg!
8 1
9
* "HP EliteDesk 800 G2 SFF Desktop PC":https://support.hp.com/us-en/product/hp-elitedesk-800-g2-tower-pc/7633297/document/c04786146
10 11
* Intel Core i5-6600T (quad core @ 3.3 GHz; upgraded from i5-6500)
11 1
* 8GB RAM 
12
* 128GB SSD HDD 
13 13
* Intel quad port 1G NIC
14
* Mellanox MCX354A-FCCT (40GigE)
15 1
16 13
* Running "OPNsense":https://opnsense.org/ :  23.7.9 (based on FreeBSD 13.2)
17 1
18
| *Interface* | *MAC*| *Reserved IP* | *Notes* |
19 13
|WAN   (em4)               |dc:4a:3e:81:f5:49|10.0.0.188               |attached to DMZ on FIOS router|
20
|CopperLAN (mlxen0) |e4:1d:2d:dc:9b:b1|192.168.1.1 (static) |top port of Mellanox NIC|
21
|FiberLAN    (mlxen1)  |e4:1d:2d:dc:9b:b2|10.250.1.1 (static)  |bottom port of Mellanox NIC|
22 1
23 13
* em0 (top port) - em3 are the Intel 1G quad port interfaces
24
* em4 is the built in motherboard NIC
25 1
26 14
27
h2. Main Switch
28
29
!{width:30%}icx6610-24p-pe-900x900.jpg!
30
31
Main switch: "Brocade ICX-6610-24P":https://webresources.ruckuswireless.com/pdf/datasheets/ds-icx-6610.pdf
32
* 24 port 1000-BaseT POE ports
33
* 8 SFP+ (10G) ports
34
* 2 QSFP (40G) ports
35
* 2 QSFP (4x10G breakout) ports
36
37 1
h3. Configuration
38
39
The network is subdivided into CopperLAN which is 1G copper and FiberLAN which is 10G fiber:
40 13
41
* *CopperLAN*
42 1
** 192.168.1.1/16
43
** Switch ports: 1/1/1-1/1/24; 1/2/1 (40G router uplink)
44
** VLAN 10
45
* *FiberLAN*
46
** 10.250.1.1/24
47
** Switch ports: 1/3/1 - 1/3/8; 1/2/6 (40G router uplink)
48
** VLAN 20
49
50 14
h3. Port Connection Table
51 1
52 15
h4. CopperLAN
53 1
54 14
| *Port* | *Device / Branch* |
55
| 1      | living room - top port - AP (POE enabled)    |
56
| 2      | downstairs bedroom and rec room|
57 15
| 3      | upstairs front bedroom - office |
58
| 4      | upstairs middle bedroom - work office|
59
| 5      | living room - middle port |
60
| 6      | phalanx             |
61
| 7      | red-dragon        |
62
| 8      | red-dragon IPMI|
63 14
| 9      | _unused_          |
64
|10      | _unused_         |
65
|11     | _unused_          |
66
|12     | _unused_          |
67
|13     | _unused_          |
68
|14     | _unused_          |
69
|15     | _unused_          |
70
|16     | _unused_          |
71
|17     | _unused_          |
72
|18     | _unused_          |
73 1
|18     | _unused_          |
74
|20     | _unused_          |
75
|21     | _unused_          |
76
|22     | _unused_          |
77
|23     | _unused_          |
78
|24     | ICX-6610 console interface |
79
80 15
h4. FiberLAN
81
82
| *Port* | *Device / Branch* |
83
| 1      | office (to !MikroTik Switch)|
84
| 2      | phalanx 10G      |
85
| 3      | red-dragon 10G |
86
| 4      | _unused   |
87
| 4      | _unused   |
88
| 4      | _unused   |
89
| 4      | _unused   |
90
91 1
h2. 10G Supplemental Switch
92
93
!{width:30%}crs305_1g_4s.jpg!
94
95
"MikroTik CRS305-1G-4S":https://mikrotik.com/product/crs305_1g_4s_in
96
97
NOTE: Switch has two operating system options. SWOS is much simpler and therefore preferred for this application.  Note that holding the reset button while powering only resets the RouterOS configuration not the SWOS configuration. To reset SWOS boot into RouterOS and navigate to the terminal, then enter this command:
98
<pre>
99
/system swos reset-config
100
</pre>
101
102
Also to set the boot OS: System > Routerboard > Settings > Boot OS
103
104
h3. Reset Instructions
105
106
* Disconnect all network ports. Disconnect power, using tip of mechanical pencil press reset button and hold. Reconnect power.  When green light flashes several times release the reset button.
107
* Switch will reboot into RouterOS. 
108
* To connect connect to MGMT (1G) port to laptop. Set static address on laptop to 192.168.88.2/255.255.255.0 with gateway 192.168.88.1. Open web browser and navigate to 192.168.88.1. 
109
* Enter basic details, including DHCP setup.
110
* Click Terminal button in upper right corner. 
111
** Enter this command to reset SwOS:
112
<pre>
113
/system swos reset-config
114
</pre>
115
* Next navigate back to Webconfig to change boot configuration: System > Routerboard > Settings > Boot OS and set SwOS. 
116
* Finally click the Reboot option on the side menu.
117
* Disconnect from laptop and connect MGMT port back to regular network. After reboot switch should be accessible at DHCP reservation address: 192.168.100.2.
118
* Default credentials are: admin/<no password>
119
120
h3. Configuration
121
122
To use 1G port as management port go to RSTP tab and uncheck the checkbox next to MGMT. In Port Isolation tab, isolate MGMT from other ports.
123 8
124 1
h2. Wireless AP
125 8
126
!{width:50%}R710.jpg!
127 1
128 8
In August 2021 I replaced the WRT3200ACM with a Ruckus R710 access point.
129 1
* https://www.commscope.com/product-type/enterprise-networking/wireless-access-points/indoor/r710/
130 8
131
h3. Wiresless Networks
132 9
133 1
* 57752d54616e67204c414e - legacy 5 GHz - WPA2
134
* 4162726168616d204c696e6b737973 - legacy 2.4 GHz - WPA2
135
* Weyland-Yutani Corporate - 5 GHz/2.4 GHz - WPA3/WPA2
136
137
138
h2. DHCP Registrations
139
140
pfsense Box
141
* *MAC*: dc:4a:3e:81:f5:49
142
* *IP*: 10.0.188 (reserved)
143
144
h3. Switch
145 10
146 2
| *Device* | *MAC* | *Reserved IP* | *Hostname* | *Notes* |
147 1
|Aruba S3500-24P          |00:1a:1e:16:1a:c0|192.168.100.0 (static)|aruba-s3500        |main network switch; POE disabled|
148
|Ruckus R710               |58:b6:33:3b:17:e0|192.168.100.1            |r710|primary WiFi AP (see note above)|
149
|MikroTik CRS305-1g-4s|cc:2d:e0:91:42:6e|192.168.100.2            |mikrotik-switch-001|10G network switch; 1G for management|
150
|TP-Link Archer C2600    |18:a6:f7:5f:2b:06|192.168.100.3             |archerc2600|secondary WiFi AP|
151
152
h3. Wireless Clients
153
154
| *Device*          | *MAC*           | *Reserved IP*   | *Hostname* |
155
|Dell XPS 13 (wifi) |28:b2:bd:39:07:92|192.168.4.2      |xps               |
156
|phone              |b4:f7:a1:8f:98:8d|192.168.4.3      |g6-plus           |
157
|workstation (wifi) |10:f0:05:35:01:fb|192.168.4.4      |enthoo-wifi       |
158
|tablet             |84:55:a5:f7:3a:ec|192.168.4.5      |galaxy-tab-s      |
159
|MPD box            |a0:88:69:8c:33:ef|192.168.4.7      |CI320-wifi        |
160
|Raspberry Pi 3b+   |b8:27:eb:ef:eb:a1|192.168.4.9      |rpi001            |
161
|Raspberry Pi Zero W|b8:27:eb:d9:78:8a|192.168.4.10     |rpi-zw-001        |
162
|!ThinkPad T470     |f8:59:71:4e:ab:f6|192.168.4.12     |t470              |
163 12
|Raspberry Pi 3b+   |b8:27:eb:59:18:d2|192.168.4.14     |rpi002            |
164 1
|Raspberry Pi 4b    |dc:a6:32:19:16:70|192.168.4.16     |rpi003            |
165
|new tablet         |70:1f:3c:cd:30:63|192.168.4.17     |galaxy-tab-a      |
166
|Lenovo Carbon X1|74:d8:3e:b6:be:26|192.168.4.18     |carbon     |
167
168
h3. Wired Clients
169
170
| *Device*                                           | *MAC*           | *Reserved IP* | *Hostname* |
171
|Dell XPS 13 laptop                                  |a0:ce:c8:03:a1:c9|192.168.8.2    |xps-eth     |
172
|slingbox                                            |00:0d:c5:cf:0f:94|192.168.8.3    |slingbox    |
173
|[[wiki:Workstation|workstation]]                    |70:85:c2:39:83:67|192.168.8.4    |enthoo      |
174
|[[wiki:CustomComputers/2012/Phalanx|file server]]   |d0:50:99:51:75:a4|192.168.8.6    |phalanx     |
175
|[[wiki:CI320|MPD box]]                              |00:01:2e:58:d8:81|192.168.8.7    |CI320       |
176
|[[wiki:UltimateHTPC|HTPC]]                          |74:d4:35:4f:4e:04|192.168.8.8    |atto        |
177
|Raspberry Pi 3b+                                    |b8:27:eb:ba:be:f4|192.168.8.9    |rpi001-eth  |
178
|[[wiki:CustomComputers/2018/Brutus|brutus]]         |d0:50:99:46:c6:74|192.168.8.10   |brutus      | 
179
|!ThinkPad T470                                      |54:e1:ad:33:0f:0a|192.168.8.12   |t470-eth    |
180
|file2                                               |d0:50:99:51:76:4c|192.168.8.13   |file2       |
181
|Raspberry Pi 3b+                                    |b8:27:eb:0c:4d:87|192.168.8.14   |rpi002-eth  |
182
|red-dwarf                                           |00:25:90:86:4e:e6|192.168.8.15   |red-dwarf   |
183
|Raspberry Pi 4b                                     |dc:a6:32:19:16:6f|192.168.8.16   |rpi003-eth  |
184
|[[wiki:CustomComputers/2020/RedOctober|red-october]]|b4:2e:99:a5:1e:f0|192.168.8.17   |red-october |
185
186
h3. Printer Clients
187
188
| *Device*                | *MAC*           | *Reserved IP* | *Hostname* |
189
|HP Officejet Pro 8610    |34:64:a9:5e:0e:62|192.168.10.1   |hp-pro-8610 |
190
191
h3. Camera Clients
192
193
| *Device*           | *MAC*           | *Reserved IP* | *Hostname* |
194
|Reolink Argus Pro   |10:ce:a9:0b:e0:fe|192.168.12.1   |cam001      |
195
|Reolink RLC-410-5MP |ec:71:db:65:c9:4c|192.168.12.2   |cam002      |
196
197
h3. House Clients
198 7
199 1
| *Device*         | *MAC*           | *Reserved IP* | *Hostname* |
200
|Ecobee Thermostat |44:61:32:ac:17:cc|192.168.14.1   |ecobee      |
201 8
202 1
h3. Work Clients
203
204
| *Device*            | *MAC*           | *Reserved IP* | *Hostname* |
205 4
|BL Machine|70:85:c2:da:6c:3d|192.168.20.1   |corsair       |
206
207
h3. IPMI Interfaces
208
209
| *Device*                                     | *MAC*           | *Reserved IP* | *Hostname*  |
210
|[[wiki:CustomComputers/2012/Phalanx|phalanx]] |bc:5f:f4:fe:6b:cb|192.168.208.1  |phalanx-ipmi |
211
|[[wiki:CustomComputers/2018/Brutus|brutus]]   |bc:5f:f4:fe:7c:af|192.168.208.2  |brutus-ipmi  |
212 1
213
h2. 10G Network
214 14
215 1
The 10G network is -setup as a VLAN (17)- using `10.250.1.0/24` addressing. (I never could get the VLAN working).
216
217
| *Device*                                     | *MAC*           | *Reserved IP* | *Hostname* |
218
|[[wiki:CustomComputers/2012/Phalanx|phalanx]] |0c:c4:7a:1f:00:ae|10.250.1.2     |phalanx-10g |
219
|[[wiki:CustomComputers/2018/Brutus|brutus]]   |24:8a:07:e4:40:c1|10.250.1.3     |brutus-10g  |
220
|[[wiki:Workstation|enthoo]]                   |24:8a:07:e4:39:91|10.250.1.4     |enthoo-10g  |
221
|file2                                         |24:8a:07:e3:04:e1|10.250.1.5     |file2-10g   |
222
223
224
h2. Backup Switch
225
226
* TP-LINK TL-SG1016D - 24 port "dumb" switch
227
228
h2. Resources
229
230
 * "DD-WRT Installation, Upgrade & Basic Setup–Cliff Notes":https://www.dd-wrt.com/phpBB2/viewtopic.php?t=311117
231
 * "DD-WRT Forum - primary WRT3200ACM topic":https://forum.dd-wrt.com/phpBB2/viewtopic.php?t=304086