Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #209218 > unrolled thread

NIC Bonding 802.3ad LACP without switch

Back to article view | Back to linux.debian.user

Contents

  NIC Bonding 802.3ad LACP without switch basti <mailinglist@unix-solution.de> - 2019-05-27 14:20 +0200
    Re: NIC Bonding 802.3ad LACP without switch Sven Hartge <sven@svenhartge.de> - 2019-05-27 15:10 +0200
    Re: NIC Bonding 802.3ad LACP without switch Reco <recoverym4n@enotuniq.net> - 2019-05-27 15:10 +0200
      Re: NIC Bonding 802.3ad LACP without switch basti <mailinglist@unix-solution.de> - 2019-05-27 15:40 +0200
        Re: NIC Bonding 802.3ad LACP without switch Reco <recoverym4n@enotuniq.net> - 2019-05-27 15:50 +0200
          Re: NIC Bonding 802.3ad LACP without switch basti <mailinglist@unix-solution.de> - 2019-05-27 16:40 +0200
            Re: NIC Bonding 802.3ad LACP without switch Reco <recoverym4n@enotuniq.net> - 2019-05-27 16:50 +0200
          Re: NIC Bonding 802.3ad LACP without switch basti <basti@unix-solution.de> - 2019-05-27 17:20 +0200
            Re: NIC Bonding 802.3ad LACP without switch Sven Hartge <sven@svenhartge.de> - 2019-05-27 17:40 +0200
              Re: NIC Bonding 802.3ad LACP without switch deloptes <deloptes@gmail.com> - 2019-05-27 21:00 +0200
              Re: NIC Bonding 802.3ad LACP without switch basti <mailinglist@unix-solution.de> - 2019-05-29 09:30 +0200
                Re: NIC Bonding 802.3ad LACP without switch Sven Hartge <sven@svenhartge.de> - 2019-05-29 11:10 +0200
        Re: NIC Bonding 802.3ad LACP without switch deloptes <deloptes@gmail.com> - 2019-05-27 20:50 +0200
      Re: NIC Bonding 802.3ad LACP without switch Sven Hartge <sven@svenhartge.de> - 2019-05-27 17:40 +0200

#209218 — NIC Bonding 802.3ad LACP without switch

Hello,
I have 2 Servers both of them has an dual port nic, I want to bond this
and try to configure this in 802.3ad mode. There are no switch beween,
and there is no crossover cable installed.

Can this mode be used in this setup?
How must I configure the other side? (I have use this howto,
https://www.snel.com/support/lacp-bonding-on-debian-7-8-9/)

Best Regards,

[toc] | [next] | [standalone]

#209221

basti <mailinglist@unix-solution.de> wrote:

> I have 2 Servers both of them has an dual port nic, I want to bond this
> and try to configure this in 802.3ad mode. There are no switch beween,
> and there is no crossover cable installed.

"and there is no crossover cable installed"?

Beside the point that Gigabit Ethernet does no longer need special
cross-over cables to work, what do you want to achieve here?

The different bonding protocols have some very special ways of working
and selection the right one depends on what the problem is.

Grüße,
Sven.

-- 
Sigmentation fault. Core dumped.

[toc] | [prev] | [next] | [standalone]

#209222

	Hi.

On Mon, May 27, 2019 at 01:48:39PM +0200, basti wrote:
> Can this mode be used in this setup?

AFAIK standard linux bonding can only use Passive LACP in 802.3ad.

> How must I configure the other side?

That's means you have to use openvswitch on either side as it can be
configured to send LACPDUs (i.e. you can switch it to Active LACP).

I'd say it'll be easier to use balance-alb or balance-tlb in such setup.

Reco

[toc] | [prev] | [next] | [standalone]

#209224

Hello sven,
hello reco,

I want to speedup my network connection beween srv-a and srv-b. There is
only a 1:1 connection.
I have try to use balance-alb and copy some files from a to b with only
112 MB/s with dd and netcat.

So Im not shure if balance-alb use both interfaces.

On 27.05.19 15:09, Reco wrote:
> 	Hi.
> 
> On Mon, May 27, 2019 at 01:48:39PM +0200, basti wrote:
>> Can this mode be used in this setup?
> 
> AFAIK standard linux bonding can only use Passive LACP in 802.3ad.
> 
>> How must I configure the other side?
> 
> That's means you have to use openvswitch on either side as it can be
> configured to send LACPDUs (i.e. you can switch it to Active LACP).
> 
> I'd say it'll be easier to use balance-alb or balance-tlb in such setup.
> 
> Reco
> 

[toc] | [prev] | [next] | [standalone]

#209225

	Hi.

On Mon, May 27, 2019 at 03:36:38PM +0200, basti wrote:
> Hello sven,
> hello reco,
> 
> I want to speedup my network connection beween srv-a and srv-b. There is
> only a 1:1 connection.

Any bonding mode will utilize a single link in such case.
The 'catch 22' for active-active bonding is that you can utilize more
that one link for egress traffic (assuming multiple receivers), but
ingress traffic will be the same on all links.

What you need is https://www.multipath-tcp.org/ . Or buy 10Gbps NICs,
they are relatively cheap these days.

Reco

[toc] | [prev] | [next] | [standalone]

#209227

also on a network card with 2 NIC's

srv-a nic ens2f0 ---- ens2f0 srv-b
          ens2f1 ---- ens2f1

Can I use a switch that only supoort static LAC to speedup my
connection? For example tp-link TL-SG108E ? Or must it support LACP?

On 27.05.19 15:49, Reco wrote:
> 	Hi.
> 
> On Mon, May 27, 2019 at 03:36:38PM +0200, basti wrote:
>> Hello sven,
>> hello reco,
>>
>> I want to speedup my network connection beween srv-a and srv-b. There is
>> only a 1:1 connection.
> 
> Any bonding mode will utilize a single link in such case.
> The 'catch 22' for active-active bonding is that you can utilize more
> that one link for egress traffic (assuming multiple receivers), but
> ingress traffic will be the same on all links.
> 
> What you need is https://www.multipath-tcp.org/ . Or buy 10Gbps NICs,
> they are relatively cheap these days.
> 
> Reco
> 

[toc] | [prev] | [next] | [standalone]

#209228

	Hi.

On Mon, May 27, 2019 at 04:36:10PM +0200, basti wrote:
> also on a network card with 2 NIC's
> 
> srv-a nic ens2f0 ---- ens2f0 srv-b
>           ens2f1 ---- ens2f1
> 
> Can I use a switch that only supoort static LAC to speedup my
> connection? For example tp-link TL-SG108E ?

They invented balance-alb and balance-tlb just for that.
But - neither of them will do you any good.

>  Or must it support LACP?

LACP is also unable to convert two Gigabit NICs to a single Two-Gigabit
one. You need TCP multipathing or its equivalent.

Reco

[toc] | [prev] | [next] | [standalone]

#209230

also on a network card with 2 NIC's

srv-a nic ens2f0 ---- ens2f0 srv-b
          ens2f1 ---- ens2f1

Can I use a switch that only supoort static LAC to speedup my
connection? For example tp-link TL-SG108E ? Or must it support LACP?



On 27.05.19 15:49, Reco wrote:
> 	Hi.
> 
> On Mon, May 27, 2019 at 03:36:38PM +0200, basti wrote:
>> Hello sven,
>> hello reco,
>>
>> I want to speedup my network connection beween srv-a and srv-b. There is
>> only a 1:1 connection.
> 
> Any bonding mode will utilize a single link in such case.
> The 'catch 22' for active-active bonding is that you can utilize more
> that one link for egress traffic (assuming multiple receivers), but
> ingress traffic will be the same on all links.
> 
> What you need is https://www.multipath-tcp.org/ . Or buy 10Gbps NICs,
> they are relatively cheap these days.
> 
> Reco
> 

[toc] | [prev] | [next] | [standalone]

#209234

basti <basti@unix-solution.de> wrote:

> also on a network card with 2 NIC's

> srv-a nic ens2f0 ---- ens2f0 srv-b
>           ens2f1 ---- ens2f1

> Can I use a switch that only supoort static LAC to speedup my
> connection? For example tp-link TL-SG108E ? Or must it support LACP?

For this direct connection you should use "balance-rr" or mode 0.
This will get you a true 2GBit connection even with only one active
flow.

All other modes will only use one connection per flow, limiting you to
1GBit.

Source: I've been doing bonding with Linux for as long as the bonding
driver exists. 

Grüße,
Sven.

-- 
Sigmentation fault. Core dumped.

[toc] | [prev] | [next] | [standalone]

#209254

Sven Hartge wrote:

>> also on a network card with 2 NIC's
> 
>> srv-a nic ens2f0 ---- ens2f0 srv-b
>> ens2f1 ---- ens2f1
> 
>> Can I use a switch that only supoort static LAC to speedup my
>> connection? For example tp-link TL-SG108E ? Or must it support LACP?
> 
> For this direct connection you should use "balance-rr" or mode 0.
> This will get you a true 2GBit connection even with only one active
> flow.
> 
> All other modes will only use one connection per flow, limiting you to
> 1GBit.

+1

[toc] | [prev] | [next] | [standalone]

#209363

On 27.05.19 17:32, Sven Hartge wrote:
> basti <basti@unix-solution.de> wrote:
> 
>> also on a network card with 2 NIC's
> 
>> srv-a nic ens2f0 ---- ens2f0 srv-b
>>           ens2f1 ---- ens2f1
> 
>> Can I use a switch that only supoort static LAC to speedup my
>> connection? For example tp-link TL-SG108E ? Or must it support LACP?
> 
> For this direct connection you should use "balance-rr" or mode 0.
> This will get you a true 2GBit connection even with only one active
> flow.
> 
> All other modes will only use one connection per flow, limiting you to
> 1GBit.
> 
> Source: I've been doing bonding with Linux for as long as the bonding
> driver exists. 
> 
> Grüße,
> Sven.
> 

I have try is and it works only in one direction (srv-a -> srv-b).
When I try to transfer files from b to a only some bytes are transmited
(seen in tcpdump). ssh from b to a is working.

the config looks like:

A:

auto ens2f0
iface ens2f0 inet manual

auto ens2f1
iface ens2f1 inet manual

auto bond0
iface bond0 inet static
     address 10.0.1.11
     netmask 255.255.255.0
     network 10.0.1.0
     slaves ens2f0 ens2f1
     bond-mode 0
     bond-miimon 100
     bond-downdelay 200
     bond-updelay 200


B:

auto ens2f0
iface ens2f0 inet manual

auto ens2f1
iface ens2f1 inet manual

auto bond0
iface bond0 inet static
     address 10.0.1.12
     netmask 255.255.255.0
     network 10.0.1.0
     slaves ens2f0 ens2f1
     bond-mode 0
     bond-miimon 100
     bond-downdelay 200
     bond-updelay 200


A -> B:
dd if=/dev/vg-01/somefile bs=4M | nc 10.0.1.12 19000
512+0 Datensätze ein
512+0 Datensätze aus
2147483648 Bytes (2,1 GB, 2,0 GiB) kopiert, 9,47551 s, 227 MB/s

B -> A:
dd bs=4M of=/dev/vg01/somefile | ssh root@10.0.1.11 "dd of=/dev/null"
0+0 Datensätze ein
0+0 Datensätze aus
0 Bytes kopiert, 3,8988e-05 s, 0,0 kB/s

SSH:
ssh root@10.0.1.11
Last login: Wed May 29 09:18:54 2019 from 10.0.1.12

[toc] | [prev] | [next] | [standalone]

#209365

basti <mailinglist@unix-solution.de> wrote:
> On 27.05.19 17:32, Sven Hartge wrote:
>> basti <basti@unix-solution.de> wrote:
>> 
>>> also on a network card with 2 NIC's
>> 
>>> srv-a nic ens2f0 ---- ens2f0 srv-b
>>>           ens2f1 ---- ens2f1
>> 
>>> Can I use a switch that only supoort static LAC to speedup my
>>> connection? For example tp-link TL-SG108E ? Or must it support LACP?
>> 
>> For this direct connection you should use "balance-rr" or mode 0.
>> This will get you a true 2GBit connection even with only one active
>> flow.

> I have try is and it works only in one direction (srv-a -> srv-b).
> When I try to transfer files from b to a only some bytes are transmited
> (seen in tcpdump). ssh from b to a is working.

> the config looks like:

> A:

> auto bond0
> iface bond0 inet static
>      address 10.0.1.11
>      netmask 255.255.255.0
>      network 10.0.1.0
>      slaves ens2f0 ens2f1
>      bond-mode 0
>      bond-miimon 100
>      bond-downdelay 200
>      bond-updelay 200

> B:

> auto bond0
> iface bond0 inet static
>      address 10.0.1.12
>      netmask 255.255.255.0
>      network 10.0.1.0
>      slaves ens2f0 ens2f1
>      bond-mode 0
>      bond-miimon 100
>      bond-downdelay 200
>      bond-updelay 200

The configuration is correct.

> A -> B:
> dd if=/dev/vg-01/somefile bs=4M | nc 10.0.1.12 19000
> 512+0 Datensätze ein
> 512+0 Datensätze aus
> 2147483648 Bytes (2,1 GB, 2,0 GiB) kopiert, 9,47551 s, 227 MB/s

227 MiB/s is very very close to the maximum achievable troughput here,
so it works correctly.

> B -> A:
> dd bs=4M of=/dev/vg01/somefile | ssh root@10.0.1.11 "dd of=/dev/null"
> 0+0 Datensätze ein
> 0+0 Datensätze aus
> 0 Bytes kopiert, 3,8988e-05 s, 0,0 kB/s

That command makes no sense here. You need to use "if=" instead of "of="
for the first dd command.

But instead of using dd for the bandwidth test, you'd rather use iperf3.
This get's you much more precise results because it does not depend on
disk or encryption speeds like your dd|ssh setup does.

Grüße,
Sven.

-- 
Sigmentation fault. Core dumped.

[toc] | [prev] | [next] | [standalone]

#209253

basti wrote:

> I want to speedup my network connection beween srv-a and srv-b. There is
> only a 1:1 connection.
> I have try to use balance-alb and copy some files from a to b with only
> 112 MB/s with dd and netcat.


In the RHEL Network Guide [1] it says that LACP is supported only with
switch as counterpart. I never tried this on Debian and without a switch,
but there are few other modes and ways to configure. 

LACP is mode 4 you need mode 0 or balancing

[1]
https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/networking_guide/sec-using_channel_bonding

[toc] | [prev] | [next] | [standalone]

#209233

Reco <recoverym4n@enotuniq.net> wrote:
> On Mon, May 27, 2019 at 01:48:39PM +0200, basti wrote:

>> Can this mode be used in this setup?

> AFAIK standard linux bonding can only use Passive LACP in 802.3ad.

No, it does active LACP.

>> How must I configure the other side?

> That's means you have to use openvswitch on either side as it can be
> configured to send LACPDUs (i.e. you can switch it to Active LACP).

Sorry, wrong.

S!

-- 
Sigmentation fault. Core dumped.

[toc] | [prev] | [standalone]

Back to top | Article view | linux.debian.user

csiph-web