Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #180887

LACP: Debian/KVM attached to Cisco Nexus

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

Hi all

We encounter issues in combination with Linux bonding (LACP) and Cisco
Nexus. I am aware that there are several posts describing this issue,
however none of them helped me really resolving the issue.

*Setup:*
- 2xCisco Nexus5000
- KVM Hosts attached with LACP to both nexus devices (bond0)
- LACP interface and VPC is UP
- KVM Bridge br9 is attached to bond0.9 (vlan 9)
- Host A is a VM on the KVM host attached to br9

*Issues*
- Downloading files from XY to  Host A is slow
- Uploading files from Host A to XY is fast
- Based on tcpdump we could see that there are retransmissions (TCP Dup
Ack, TCP Out of Order)
- On the bonding interface bond0, we see incoming packets dropped

On this blog there was done almost the same thing:
https://raymii.org/s/tutorials/KVM_with_bonding_and_VLAN_tagging_setup_on_Ubuntu_12.04.html

Did we miss something? Configuration is underneath.

Thanks and regards
plataleas





### KVM Host  ####
# cat /etc/debian_version
7.5
# uname -a
Linux kvm 3.2.0-4-amd64 #1 SMP Debian 3.2.57-3 x86_64 GNU/Linux

#lsmod | grep bonding
bonding                79169  0

#lsmod | grep 802
8021q                  23480  0


### sysctl ####
|net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-iptables = 0
net.bridge.bridge-nf-call-arptables = 0

|### Network Config ####
#cat /etc/network/interfaces.conf
auto bond0
iface bond0 inet static
  address 0.0.0.0
  netmask 0.0.0.0
  bond-slaves none
  bond-mode 4     # LACP
  bond-miimon 100
  bond-lacp-rate 1
auto eth4
iface eth4 inet manual
  bond-master bond0
auto eth5
iface eth5 inet manual
  bond-master bond0


auto br9
iface br9 inet static
      address
0.0.0.0                                                                                                                     

      netmask 0.0.0.0
      bridge_ports bond0.9
      bridge_fd 9          
      bridge_hello 2        
      bridge_maxage 12       
      bridge_stp off         

### Cisco Nexus Config ####

#
interface Ethernet1/21
  switchport mode trunk
  channel-group 4 mode active  # Active = LACP

# show run int po4
interface port-channel4
  switchport mode trunk
  vpc 4


# brctl show | grep br9
br9        8000.90e2b25b8b18    no        bond0.9

# cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0

802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
Active Aggregator Info:
    Aggregator ID: 2
    Number of ports: 2
    Actor Key: 33
    Partner Key: 32773
    Partner Mac Address: 00:23:04:ee:be:01

Slave Interface: eth4
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 90:e2:ba:5b:8b:88
Aggregator ID: 2
Slave queue ID: 0

Slave Interface: eth5
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 90:e2:ba:5b:8b:89
Aggregator ID: 2
Slave queue ID: 0

Back to linux.debian.user | Previous | Next | Find similar | Unroll thread

Thread

LACP: Debian/KVM attached to Cisco Nexus plataleas <plataleas@gmail.com> - 2017-05-09 17:50 +0200

csiph-web