Project

General

Profile

Router » History » Version 14

Anonymous, 11/23/2023 01:31 PM
saving incremental changes

1 1
h1. Router and Network Setup
2
3 13
I started my foray into custom networking using DD-WRT running on a Linksys WRT3200ACM. This worked well for a while but I noticed performance issues as my network grew. In October 2019 I decided to go all in and setup a pfsense router.  And then in 2021 I switch to an OPNsense based router.
4 1
5 3
h2. Router
6 1
7 2
!hp_elitedesk_800_G2.jpg!
8 1
9
* "HP EliteDesk 800 G2 SFF Desktop PC":https://support.hp.com/us-en/product/hp-elitedesk-800-g2-tower-pc/7633297/document/c04786146
10 11
* Intel Core i5-6600T (quad core @ 3.3 GHz; upgraded from i5-6500)
11 1
* 8GB RAM 
12
* 128GB SSD HDD 
13 13
* Intel quad port 1G NIC
14
* Mellanox MCX354A-FCCT (40GigE)
15 1
16 13
* Running "OPNsense":https://opnsense.org/ :  23.7.9 (based on FreeBSD 13.2)
17 1
18
| *Interface* | *MAC*| *Reserved IP* | *Notes* |
19 13
|WAN   (em4)               |dc:4a:3e:81:f5:49|10.0.0.188               |attached to DMZ on FIOS router|
20
|CopperLAN (mlxen0) |e4:1d:2d:dc:9b:b1|192.168.1.1 (static) |top port of Mellanox NIC|
21
|FiberLAN    (mlxen1)  |e4:1d:2d:dc:9b:b2|10.250.1.1 (static)  |bottom port of Mellanox NIC|
22 1
23 13
* em0 (top port) - em3 are the Intel 1G quad port interfaces
24
* em4 is the built in motherboard NIC
25 1
26 14
27
h2. Main Switch
28
29
!{width:30%}icx6610-24p-pe-900x900.jpg!
30
31
Main switch: "Brocade ICX-6610-24P":https://webresources.ruckuswireless.com/pdf/datasheets/ds-icx-6610.pdf
32
* 24 port 1000-BaseT POE ports
33
* 8 SFP+ (10G) ports
34
* 2 QSFP (40G) ports
35
* 2 QSFP (4x10G breakout) ports
36
37 1
h3. Configuration
38
39
The network is subdivided into CopperLAN which is 1G copper and FiberLAN which is 10G fiber:
40 13
41
* *CopperLAN*
42 1
** 192.168.1.1/16
43
** Switch ports: 1/1/1-1/1/24; 1/2/1 (40G router uplink)
44
** VLAN 10
45
* *FiberLAN*
46
** 10.250.1.1/24
47
** Switch ports: 1/3/1 - 1/3/8; 1/2/6 (40G router uplink)
48
** VLAN 20
49
50 14
h3. Port Connection Table
51 1
52 14
* CopperLAN
53 1
54 14
| *Port* | *Device / Branch* |
55
| 1      | living room - top port - AP (POE enabled)    |
56
| 2      | downstairs bedroom and rec room|
57
| 3      | office (front room)     |
58
| 4      | middle bedroom (work office)|
59
| 5      | living room - middle port  |
60
| 6      | _unused_          |
61
| 7      | _unused_          |
62
| 8      | _unused_          |
63
| 9      | _unused_          |
64
|10      | _unused_         |
65
|11     | _unused_          |
66
|12     | _unused_          |
67
|13     | _unused_          |
68
|14     | _unused_          |
69
|15     | _unused_          |
70
|16     | _unused_          |
71
|17     | _unused_          |
72
|18     | _unused_          |
73
|18     | _unused_          |
74
|20     | _unused_          |
75
|21     | _unused_          |
76
|22     | _unused_          |
77
|23     | _unused_          |
78
|24     | ICX-6610 console interface |
79 4
80 1
h2. 10G Supplemental Switch
81
82
!{width:30%}crs305_1g_4s.jpg!
83
84
"MikroTik CRS305-1G-4S":https://mikrotik.com/product/crs305_1g_4s_in
85
86
NOTE: Switch has two operating system options. SWOS is much simpler and therefore preferred for this application.  Note that holding the reset button while powering only resets the RouterOS configuration not the SWOS configuration. To reset SWOS boot into RouterOS and navigate to the terminal, then enter this command:
87
<pre>
88
/system swos reset-config
89
</pre>
90
91
Also to set the boot OS: System > Routerboard > Settings > Boot OS
92
93
h3. Reset Instructions
94
95
* Disconnect all network ports. Disconnect power, using tip of mechanical pencil press reset button and hold. Reconnect power.  When green light flashes several times release the reset button.
96
* Switch will reboot into RouterOS. 
97
* To connect connect to MGMT (1G) port to laptop. Set static address on laptop to 192.168.88.2/255.255.255.0 with gateway 192.168.88.1. Open web browser and navigate to 192.168.88.1. 
98
* Enter basic details, including DHCP setup.
99
* Click Terminal button in upper right corner. 
100
** Enter this command to reset SwOS:
101
<pre>
102
/system swos reset-config
103
</pre>
104
* Next navigate back to Webconfig to change boot configuration: System > Routerboard > Settings > Boot OS and set SwOS. 
105
* Finally click the Reboot option on the side menu.
106
* Disconnect from laptop and connect MGMT port back to regular network. After reboot switch should be accessible at DHCP reservation address: 192.168.100.2.
107
* Default credentials are: admin/<no password>
108
109
h3. Configuration
110
111
To use 1G port as management port go to RSTP tab and uncheck the checkbox next to MGMT. In Port Isolation tab, isolate MGMT from other ports.
112 8
113 1
h2. Wireless AP
114 8
115
!{width:50%}R710.jpg!
116 1
117 8
In August 2021 I replaced the WRT3200ACM with a Ruckus R710 access point.
118 1
* https://www.commscope.com/product-type/enterprise-networking/wireless-access-points/indoor/r710/
119 8
120
h3. Wiresless Networks
121 9
122 1
* 57752d54616e67204c414e - legacy 5 GHz - WPA2
123
* 4162726168616d204c696e6b737973 - legacy 2.4 GHz - WPA2
124
* Weyland-Yutani Corporate - 5 GHz/2.4 GHz - WPA3/WPA2
125
126
127
h2. DHCP Registrations
128
129
pfsense Box
130
* *MAC*: dc:4a:3e:81:f5:49
131
* *IP*: 10.0.188 (reserved)
132
133
h3. Switch
134 10
135 2
| *Device* | *MAC* | *Reserved IP* | *Hostname* | *Notes* |
136 1
|Aruba S3500-24P          |00:1a:1e:16:1a:c0|192.168.100.0 (static)|aruba-s3500        |main network switch; POE disabled|
137
|Ruckus R710               |58:b6:33:3b:17:e0|192.168.100.1            |r710|primary WiFi AP (see note above)|
138
|MikroTik CRS305-1g-4s|cc:2d:e0:91:42:6e|192.168.100.2            |mikrotik-switch-001|10G network switch; 1G for management|
139
|TP-Link Archer C2600    |18:a6:f7:5f:2b:06|192.168.100.3             |archerc2600|secondary WiFi AP|
140
141
h3. Wireless Clients
142
143
| *Device*          | *MAC*           | *Reserved IP*   | *Hostname* |
144
|Dell XPS 13 (wifi) |28:b2:bd:39:07:92|192.168.4.2      |xps               |
145
|phone              |b4:f7:a1:8f:98:8d|192.168.4.3      |g6-plus           |
146
|workstation (wifi) |10:f0:05:35:01:fb|192.168.4.4      |enthoo-wifi       |
147
|tablet             |84:55:a5:f7:3a:ec|192.168.4.5      |galaxy-tab-s      |
148
|MPD box            |a0:88:69:8c:33:ef|192.168.4.7      |CI320-wifi        |
149
|Raspberry Pi 3b+   |b8:27:eb:ef:eb:a1|192.168.4.9      |rpi001            |
150
|Raspberry Pi Zero W|b8:27:eb:d9:78:8a|192.168.4.10     |rpi-zw-001        |
151
|!ThinkPad T470     |f8:59:71:4e:ab:f6|192.168.4.12     |t470              |
152 12
|Raspberry Pi 3b+   |b8:27:eb:59:18:d2|192.168.4.14     |rpi002            |
153 1
|Raspberry Pi 4b    |dc:a6:32:19:16:70|192.168.4.16     |rpi003            |
154
|new tablet         |70:1f:3c:cd:30:63|192.168.4.17     |galaxy-tab-a      |
155
|Lenovo Carbon X1|74:d8:3e:b6:be:26|192.168.4.18     |carbon     |
156
157
h3. Wired Clients
158
159
| *Device*                                           | *MAC*           | *Reserved IP* | *Hostname* |
160
|Dell XPS 13 laptop                                  |a0:ce:c8:03:a1:c9|192.168.8.2    |xps-eth     |
161
|slingbox                                            |00:0d:c5:cf:0f:94|192.168.8.3    |slingbox    |
162
|[[wiki:Workstation|workstation]]                    |70:85:c2:39:83:67|192.168.8.4    |enthoo      |
163
|[[wiki:CustomComputers/2012/Phalanx|file server]]   |d0:50:99:51:75:a4|192.168.8.6    |phalanx     |
164
|[[wiki:CI320|MPD box]]                              |00:01:2e:58:d8:81|192.168.8.7    |CI320       |
165
|[[wiki:UltimateHTPC|HTPC]]                          |74:d4:35:4f:4e:04|192.168.8.8    |atto        |
166
|Raspberry Pi 3b+                                    |b8:27:eb:ba:be:f4|192.168.8.9    |rpi001-eth  |
167
|[[wiki:CustomComputers/2018/Brutus|brutus]]         |d0:50:99:46:c6:74|192.168.8.10   |brutus      | 
168
|!ThinkPad T470                                      |54:e1:ad:33:0f:0a|192.168.8.12   |t470-eth    |
169
|file2                                               |d0:50:99:51:76:4c|192.168.8.13   |file2       |
170
|Raspberry Pi 3b+                                    |b8:27:eb:0c:4d:87|192.168.8.14   |rpi002-eth  |
171
|red-dwarf                                           |00:25:90:86:4e:e6|192.168.8.15   |red-dwarf   |
172
|Raspberry Pi 4b                                     |dc:a6:32:19:16:6f|192.168.8.16   |rpi003-eth  |
173
|[[wiki:CustomComputers/2020/RedOctober|red-october]]|b4:2e:99:a5:1e:f0|192.168.8.17   |red-october |
174
175
h3. Printer Clients
176
177
| *Device*                | *MAC*           | *Reserved IP* | *Hostname* |
178
|HP Officejet Pro 8610    |34:64:a9:5e:0e:62|192.168.10.1   |hp-pro-8610 |
179
180
h3. Camera Clients
181
182
| *Device*           | *MAC*           | *Reserved IP* | *Hostname* |
183
|Reolink Argus Pro   |10:ce:a9:0b:e0:fe|192.168.12.1   |cam001      |
184
|Reolink RLC-410-5MP |ec:71:db:65:c9:4c|192.168.12.2   |cam002      |
185
186
h3. House Clients
187 7
188 1
| *Device*         | *MAC*           | *Reserved IP* | *Hostname* |
189
|Ecobee Thermostat |44:61:32:ac:17:cc|192.168.14.1   |ecobee      |
190 8
191 1
h3. Work Clients
192
193
| *Device*            | *MAC*           | *Reserved IP* | *Hostname* |
194 8
|BL Machine|70:85:c2:da:6c:3d|192.168.20.1   |corsair       |
195 2
196
h3. IPMI Interfaces
197
198
| *Device*                                     | *MAC*           | *Reserved IP* | *Hostname*  |
199
|[[wiki:CustomComputers/2012/Phalanx|phalanx]] |bc:5f:f4:fe:6b:cb|192.168.208.1  |phalanx-ipmi |
200 4
|[[wiki:CustomComputers/2018/Brutus|brutus]]   |bc:5f:f4:fe:7c:af|192.168.208.2  |brutus-ipmi  |
201
202
h2. 10G Network
203
204
The 10G network is -setup as a VLAN (17)- using `10.250.1.0/24` addressing. (I never could get the VLAN working).
205
206
| *Device*                                     | *MAC*           | *Reserved IP* | *Hostname* |
207
|[[wiki:CustomComputers/2012/Phalanx|phalanx]] |0c:c4:7a:1f:00:ae|10.250.1.2     |phalanx-10g |
208
|[[wiki:CustomComputers/2018/Brutus|brutus]]   |24:8a:07:e4:40:c1|10.250.1.3     |brutus-10g  |
209
|[[wiki:Workstation|enthoo]]                   |24:8a:07:e4:39:91|10.250.1.4     |enthoo-10g  |
210
|file2                                         |24:8a:07:e3:04:e1|10.250.1.5     |file2-10g   |
211
212
h2. Main Switch - Port Assignments
213
214 1
Copper ports:
215
216 14
217 1
218
Port assignments (SFP_ fiber):
219
220
| *Port* | *Device / Branch* |
221
| 0      | office (to !MikroTik Switch)|
222
| 1      | phalanx 10G             |
223
| 2      | brutus 10G              |
224
| 3      | pfsense LAN (router)    |
225
226
h2. Backup Switch
227
228
* TP-LINK TL-SG1016D - 24 port "dumb" switch
229
230
h2. Resources
231
232
 * "DD-WRT Installation, Upgrade & Basic Setup–Cliff Notes":https://www.dd-wrt.com/phpBB2/viewtopic.php?t=311117
233
 * "DD-WRT Forum - primary WRT3200ACM topic":https://forum.dd-wrt.com/phpBB2/viewtopic.php?t=304086