Arista 交换机Spine-Leaf互联配置参考
v1.0, modified by Nick@20210528
Arista网络基于具有双重冗余红色和蓝色网络的叶脊结构。通过将Tektronix PTP双重主控器分发到红色和蓝色网络,PTP分配也可以实现冗余。
当前网络的配置如下:
- 单个PTP GM通过第一个PTP分发交换机分发到红色和蓝色网络中的两个Leaf1交换机
- 当前没有叶/脊配置。两个网络上仅使用Leaf1来承载IP组播流量。 由于网络是完全冗余的(即所有源和目标均使用2022-7),因此计划是关闭红色网络,同时保持蓝色侧运行,然后正确配置叶/主干红色网络。
这项工作完成并经过测试后,它将开始生效,然后蓝色网络将被配置为叶/脊,如下所示:
下表列出了设备的管理地址和红色/蓝色分配。
名称 | IP1 | IP2 |
---|---|---|
PTP通用1 | 10.118.180.10 | 不需要 |
PTP GM 2 | 不需要 | 10.118.180.11 |
PTP距离开关 | 10.118.180.12 | 10.118.180.13 |
脊柱开关 | 10.118.180.220 | 10.118.180.230 |
叶1 | 10.118.180.221 | 10.118.180.231 |
叶2 | 10.118.180.222 | 10.118.180.232 |
Arista Leaf Spine网络设计
Arista网络基于双冗余叶子/主干拓扑,其中每个红色和蓝色网络都有一个主干和两个叶子交换。媒体结构是一个600Gig主干,由每个Leaf交换机6x100Gig链接组成。叶子和主干之间的路由协议是BGP(边界网关协议),它是通过在彭布罗克大厦的Cisco网络上使用的OSPF(开放式最短路径优先)选择的。
VLAN 204分配给Red Leaf1,VLAN 214分配给Red Leaf2
VLAN 208分配给Blue Leaf1,VLAN 218分配给Blue Leaf2
PTP在红色和蓝色网络(PTP域0)上的所有交换机上均可用
有关这些VLAN的详细信息,请参阅 Arista媒体网络上设备的VLAN和IP地址分配。
BGP ASN分配表
交换机 | ASN |
---|---|
红叶1 | 65010 |
蓝叶1 | 65110 |
红叶2 | 65030 |
蓝叶2 | 65130 |
红脊1 | 65020 |
蓝脊1 | 65120 |
### 1.红色网络结构设计
2.蓝色网络结构设计
Arista Switch Configurations
### Red Spine Config
7280RedSpine1#show run
! Command: show running-config
! device: 7280RedSpine1 (DCS-7280CR2A-30, EOS-4.24.4M)
!
! boot system flash:/EOS-4.24.4M.swi
!
transceiver qsfp default-mode 4x10G
!
service routing protocols model ribd
!
hostname 7280RedSpine1
!
ptp priority1 254
ptp mode boundary
!
spanning-tree mode mstp
!
no aaa root
!
username admin role network-admin secret sha512 $6$Jt2uKF86n/U7xNpf$YRBrI68MeLgLZSxVhXWC9hTEMhC6WRumfGH9t2vRJ1qxiNXcAp2Vr32smF1rmOlmkvay8PuEWcSydfp99ZrTF1
!
vrf instance MGMT
description Management Traffic
!
interface Ethernet1/1
description P2P Link to RedLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.193/31
arp aging timeout 900
pim ipv4 sparse-mode
ptp enable
ptp announce interval 0
ptp delay-req interval -3
ptp sync interval -3
!
interface Ethernet2/1
description P2P Link to RedLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.195/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet3/1
description P2P Link to RedLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.197/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet4/1
description P2P Link to RedLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.199/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet5/1
description P2P Link to RedLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.201/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet6/1
description P2P Link to RedLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.203/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet7/1
description P2P Link to RedLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.205/31
arp aging timeout 900
pim ipv4 sparse-mode
ptp enable
ptp announce interval 0
ptp delay-req interval -3
ptp sync interval -3
!
interface Ethernet8/1
description P2P Link to RedLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.207/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet9/1
description P2P Link to RedLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.209/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet10/1
description P2P Link to RedLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.211/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet11/1
description P2P Link to RedLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.213/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet12/1
description P2P Link to RedLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.207.215/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet13/1
!
interface Ethernet14/1
!
interface Ethernet15/1
!
interface Ethernet16/1
!
interface Ethernet17/1
!
interface Ethernet18/1
!
interface Ethernet19/1
!
interface Ethernet20/1
!
interface Ethernet21/1
!
interface Ethernet22/1
!
interface Ethernet23/1
!
interface Ethernet24/1
!
interface Ethernet25/1
!
interface Ethernet26/1
!
interface Ethernet27/1
!
interface Ethernet28/1
!
interface Ethernet29/1
!
interface Ethernet30/1
!
interface Loopback0
description RouterID
ip address 192.168.207.220/32
!
interface Management1
vrf MGMT
ip address 10.118.180.220/24
!
ip routing
no ip routing vrf MGMT
!
ip route vrf MGMT 0.0.0.0/0 10.118.180.1
!
router bgp 65010
router-id 192.168.207.220
distance bgp 20 200 200
maximum-paths 6 ecmp 64
neighbor 192.168.207.192 remote-as 65020
neighbor 192.168.207.192 maximum-routes 12000
neighbor 192.168.207.194 remote-as 65020
neighbor 192.168.207.194 maximum-routes 12000
neighbor 192.168.207.196 remote-as 65020
neighbor 192.168.207.196 maximum-routes 12000
neighbor 192.168.207.198 remote-as 65020
neighbor 192.168.207.198 maximum-routes 12000
neighbor 192.168.207.200 remote-as 65020
neighbor 192.168.207.200 maximum-routes 12000
neighbor 192.168.207.202 remote-as 65020
neighbor 192.168.207.202 maximum-routes 12000
neighbor 192.168.207.204 remote-as 65030
neighbor 192.168.207.204 maximum-routes 12000
neighbor 192.168.207.206 remote-as 65030
neighbor 192.168.207.206 maximum-routes 12000
neighbor 192.168.207.208 remote-as 65030
neighbor 192.168.207.208 maximum-routes 12000
neighbor 192.168.207.210 remote-as 65030
neighbor 192.168.207.210 maximum-routes 12000
neighbor 192.168.207.212 remote-as 65030
neighbor 192.168.207.212 maximum-routes 12000
neighbor 192.168.207.214 remote-as 65030
neighbor 192.168.207.214 maximum-routes 12000
network 192.168.207.220/32
redistribute connected
!
router multicast
ipv4
routing
!
router pim sparse-mode
ipv4
rp address 192.168.207.220
!
end
Blue Spine Config
7280BlueSpine1#show run
! Command: show running-config
! device: 7280BlueSpine1 (DCS-7280CR2A-30, EOS-4.24.4M)
!
! boot system flash:/EOS-4.24.4M.swi
!
transceiver qsfp default-mode 4x10G
!
service routing protocols model ribd
!
hostname 7280BlueSpine1
!
ptp priority1 254
ptp mode boundary
!
spanning-tree mode mstp
!
no aaa root
!
username admin role network-admin secret sha512 $6$LkIOEvqvWsYiDify$vZozQGSKUfUgme/xRff2tbTYLMtvDNp/vTDg0B2uSq0d6txc5pXb8BXMTNWop6Xe8aHVW2xnJWDm.TLgnLZR2.
!
vrf instance MGMT
description Management Traffic
!
interface Ethernet1/1
description P2P Link to BlueLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.193/31
arp aging timeout 900
pim ipv4 sparse-mode
ptp enable
ptp announce interval 0
ptp delay-req interval -3
ptp sync interval -3
!
interface Ethernet2/1
description P2P Link to BlueLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.195/31
arp aging timeout 900
pim ipv4 sparse-mode
ptp enable
ptp announce interval 0
ptp delay-req interval -3
ptp sync interval -3
!
interface Ethernet3/1
description P2P Link to BlueLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.197/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet4/1
description P2P Link to BlueLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.199/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet5/1
description P2P Link to BlueLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.201/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet6/1
description P2P Link to BlueLeaf1
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.203/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet7/1
description P2P Link to BlueLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.205/31
arp aging timeout 900
pim ipv4 sparse-mode
ptp enable
ptp announce interval 0
ptp delay-req interval -3
ptp sync interval -3
!
interface Ethernet8/1
description P2P Link to BlueLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.207/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet9/1
description P2P Link to BlueLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.209/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet10/1
description P2P Link to BlueLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.211/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet11/1
description P2P Link to BlueLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.213/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet12/1
description P2P Link to BlueLeaf2
logging event link-status
speed forced 100gfull
no switchport
ip address 192.168.211.215/31
arp aging timeout 900
pim ipv4 sparse-mode
!
interface Ethernet13/1
!
interface Ethernet14/1
!
interface Ethernet15/1
!
interface Ethernet16/1
!
interface Ethernet17/1
!
interface Ethernet18/1
!
interface Ethernet19/1
!
interface Ethernet20/1
!
interface Ethernet21/1
!
interface Ethernet22/1
!
interface Ethernet23/1
!
interface Ethernet24/1
!
interface Ethernet25/1
!
interface Ethernet26/1
!
interface Ethernet27/1
!
interface Ethernet28/1
!
interface Ethernet29/1
!
interface Ethernet30/1
!
interface Loopback0
description RouterID
ip address 192.168.211.230/32
!
interface Management1
vrf MGMT
ip address 10.118.180.230/24
!
ip routing
no ip routing vrf MGMT
!
ip route vrf MGMT 0.0.0.0/0 10.118.180.1
!
router bgp 65110
router-id 192.168.211.230
distance bgp 20 200 200
maximum-paths 6 ecmp 64
neighbor 192.168.211.192 remote-as 65120
neighbor 192.168.211.192 maximum-routes 12000
neighbor 192.168.211.194 remote-as 65120
neighbor 192.168.211.194 maximum-routes 12000
neighbor 192.168.211.196 remote-as 65120
neighbor 192.168.211.196 maximum-routes 12000
neighbor 192.168.211.198 remote-as 65120
neighbor 192.168.211.198 maximum-routes 12000
neighbor 192.168.211.200 remote-as 65120
neighbor 192.168.211.200 maximum-routes 12000
neighbor 192.168.211.202 remote-as 65120
neighbor 192.168.211.202 maximum-routes 12000
neighbor 192.168.211.204 remote-as 65130
neighbor 192.168.211.204 maximum-routes 12000
neighbor 192.168.211.206 remote-as 65130
neighbor 192.168.211.206 maximum-routes 12000
neighbor 192.168.211.208 remote-as 65130
neighbor 192.168.211.208 maximum-routes 12000
neighbor 192.168.211.210 remote-as 65130
neighbor 192.168.211.210 maximum-routes 12000
neighbor 192.168.211.212 remote-as 65130
neighbor 192.168.211.212 maximum-routes 12000
neighbor 192.168.211.214 remote-as 65130
neighbor 192.168.211.214 maximum-routes 12000
network 192.168.211.230/32
redistribute connected
!
router multicast
ipv4
routing
!
router pim sparse-mode
ipv4
rp address 192.168.211.230
!
end
Red PTP Distribution Config
! Command: show running-config
! device: PTPDistRed (DCS-7020TR-48, EOS-4.21.5F)
!
! boot system flash:/EOS-4.21.5F.swi
!
ip igmp snooping vlan 200 static 224.0.1.129 interface Ethernet49
!
transceiver qsfp default-mode 4x10G
!
hostname PTPDistRed
!
ptp source ip 10.118.251.2
ptp mode boundary
!
spanning-tree mode mstp
!
no aaa root
!
username admin role network-admin secret sha512 $6$lqffo1ef.p.XA8fs$.pOKgdU2pAn25ecrP3JrSmoYZNCvpxTdDzjSNjbUoP.hUoomAvuAGFsjwnKh9XV52PdD.h97PqwmVCSAR58He/
!
vlan 200
name BluePTPvlan
!
interface Ethernet1
description Tektronix GM
switchport access vlan 200
ptp enable
ptp announce interval 0
ptp sync interval -3
ptp delay-req interval -3
!
interface Ethernet2
!
interface Ethernet3
!
interface Ethernet4
!
interface Ethernet5
!
interface Ethernet6
!
interface Ethernet7
!
interface Ethernet8
!
interface Ethernet9
!
interface Ethernet10
!
interface Ethernet11
!
interface Ethernet12
!
interface Ethernet13
!
interface Ethernet14
!
interface Ethernet15
!
interface Ethernet16
!
interface Ethernet17
!
interface Ethernet18
!
interface Ethernet19
!
interface Ethernet20
!
interface Ethernet21
!
interface Ethernet22
!
interface Ethernet23
!
interface Ethernet24
!
interface Ethernet25
!
interface Ethernet26
!
interface Ethernet27
!
interface Ethernet28
!
interface Ethernet29
!
interface Ethernet30
!
interface Ethernet31
!
interface Ethernet32
!
interface Ethernet33
!
interface Ethernet34
!
interface Ethernet35
!
interface Ethernet36
!
interface Ethernet37
!
interface Ethernet38
!
interface Ethernet39
!
interface Ethernet40
!
interface Ethernet41
!
interface Ethernet42
!
interface Ethernet43
!
interface Ethernet44
!
interface Ethernet45
!
interface Ethernet46
!
interface Ethernet47
!
interface Ethernet48
!
interface Ethernet49
description PTP Blue GM
ptp enable
ptp announce interval 0
ptp sync interval -3
ptp delay-req interval -3
ptp role master
!
interface Ethernet50
description PTP Red GM
ptp enable
ptp announce interval 0
ptp sync interval -3
ptp delay-req interval -3
ptp role master
!
interface Ethernet51
description PTP GV-Fabric
ptp enable
ptp announce interval 0
ptp sync interval -3
ptp delay-req interval -3
ptp role master
!
interface Ethernet52
!
interface Ethernet53
!
interface Ethernet54
!
interface Management1
ip address 10.118.180.12/24
!
interface Vlan200
description BluePTPvlan
ip address 10.118.251.1/24
ip pim sparse-mode
!
ip route 0.0.0.0/0 10.118.180.1
!
ip routing
!
ip multicast-routing
!
end
PTPDistRed#
Blue PTP Distribution Config
! Command: show running-config
! device: PTPDistBlue (DCS-7020TR-48, EOS-4.21.5F)
!
! boot system flash:/eos-4.21.5f.swi
!
transceiver qsfp default-mode 4x10G
!
hostname PTPDistBlue
!
spanning-tree mode mstp
!
no aaa root
!
username admin role network-admin secret sha512 $6$ni/MYkyjDJ2x2bo7$i2uOXlPk8LfCssCmOIrntt/szTlREhfYoD0bNe7Me.co.un6JeSBOP.UWgxHc8Ua4Odz5eDJLyh.eJmMhIVfa1
!
interface Ethernet1
!
interface Ethernet2
!
interface Ethernet3
!
interface Ethernet4
!
interface Ethernet5
!
interface Ethernet6
!
interface Ethernet7
!
interface Ethernet8
!
interface Ethernet9
!
interface Ethernet10
!
interface Ethernet11
!
interface Ethernet12
!
interface Ethernet13
!
interface Ethernet14
!
interface Ethernet15
!
interface Ethernet16
!
interface Ethernet17
!
interface Ethernet18
!
interface Ethernet19
!
interface Ethernet20
!
interface Ethernet21
!
interface Ethernet22
!
interface Ethernet23
!
interface Ethernet24
!
interface Ethernet25
!
interface Ethernet26
!
interface Ethernet27
!
interface Ethernet28
!
interface Ethernet29
!
interface Ethernet30
!
interface Ethernet31
!
interface Ethernet32
!
interface Ethernet33
!
interface Ethernet34
!
interface Ethernet35
!
interface Ethernet36
!
interface Ethernet37
!
interface Ethernet38
!
interface Ethernet39
!
interface Ethernet40
!
interface Ethernet41
!
interface Ethernet42
!
interface Ethernet43
!
interface Ethernet44
!
interface Ethernet45
!
interface Ethernet46
!
interface Ethernet47
!
interface Ethernet48
!
interface Ethernet49
!
interface Ethernet50
!
interface Ethernet51
!
interface Ethernet52
!
interface Ethernet53
!
interface Ethernet54
!
interface Management1
ip address 10.118.180.13/24
!
ip route 0.0.0.0/0 10.118.180.1
!
no ip routing
!
end
PTPDistBlue#
PTP Grandmaster Configuration
Arista网络中有两个SPG8000A Tektronix PTP Grandmaster,但是目前仅使用一个。它们都将其配置保存为默认的开机状态,但是如果出现问题,两者的corect PTP配置应如下所示:
VLANs and IP address allocations for equipment on the Arista Media Network
Work in progress as the Arista network design is currently being formalised and deployed…
As all Media devices are in one large VLAN they must be well behaved devices to avoid flooding the VLAN with rouque mulitcast traffic.
Red Network VLANs and IP address ranges
Devices | Subnet | Mask | Inverse Mask | Subnet Size | Host Range | Gateway | Broadcast | VLAN | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
All End Points onLeaf1 | 192.168.204.0 | 255.255.254.0 | 0.0.1.255 | 510 | 192.168.204.1 to 192.168.205.254 | 192.168.204.1 | 192.168.205.255 | 204 | |||||||
All End Points onLeaf2 | 192.168.214.0 | 255.255.254.0 | 0.0.1.255 | 510 | 192.168.214.1 to 192.168.215.254 | 192.168.214.1 | 192.168.215.255 | 214 | |||||||
Infrastructure | 192.168.207.192 | 255.255.255.192 | 0.0.0.63 | 62 | 192.168.207.194 to 192.168.207.254 | 192.168.207.193 | 192.168.207.255 | DO NOT USE ! THIS IS FOR NETWORK USE ONLY – Loopback, PTP, RP’s, Router ID’s etc |
Blue Network VLANs and IP address ranges
Team | Subnet | Mask | Inverse Mask | Subnet Size | Host Range | Gateway | Broadcast | VLAN | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
All End Points on Leaf1 | 192.168.208.0 | 255.255.254.0 | 0.0.1.255 | 510 | 192.168.208.1 to 192.168.209.254 | 192.168.208.1 | 192.168.209.255 | 208 | |||||||
All End Points on Leaf2 | 192.168.218.0 | 255.255.254.0 | 0.0.1.255 | 510 | 192.168.218.1 to 192.168.219.254 | 192.168.218.1 | 192.168.219.255 | 218 | |||||||
Infrastructure | 192.168.211.192 | 255.255.255.192 | 0.0.0.63 | 62 | 192.168.211.194 to 192.168.211.254 | 192.168.211.193 | 192.168.211.255 | DO NOT USE ! THIS IS FOR NETWORK USE ONLY – Loopback, PTP, RP’s, Router ID’s etc |