Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.user > #228517 > unrolled thread

PCI-Express not mapping a card's memory

Back to article view | Back to linux.debian.user

Contents

  PCI-Express not mapping a card's memory Marc SCHAEFER <schaefer@alphanet.ch> - 2020-11-08 18:00 +0100
    Re: PCI-Express not mapping a card's memory Marc SCHAEFER <schaefer@alphanet.ch> - 2020-11-13 10:50 +0100

#228517 — PCI-Express not mapping a card's memory

Hello,

I have a Mellanox card, which is detected, however on one machine:

01:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]
        Subsystem: Mellanox Technologies MT27500 Family [ConnectX-3]
        Flags: fast devsel, IRQ 16
        Memory at dfb00000 (64-bit, non-prefetchable) [size=1M]
        Memory at <ignored> (64-bit, prefetchable)

and on another machine, it differs:

        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at cf800000 (64-bit, prefetchable) [size=8M]

Obviously on the machine with <ignored>, I get a driver error, where
it works on the other.

   [    1.257148] mlx4_core: Mellanox ConnectX core driver v4.0-0
   [    1.257163] mlx4_core: Initializing 0000:01:00.0
   [    1.257196] mlx4_core 0000:01:00.0: enabling device (0000 -> 0002)
   [    1.257303] mlx4_core 0000:01:00.0: Missing UAR, aborting
   
I tried to use another 16x slot on the failing machine, and
even to update the BIOS: no change.

dmesg says:

[    0.438011] pci 0000:01:00.0: [15b3:1003] type 00 class 0x028000
[    0.438414] pci 0000:01:00.0: reg 0x10: [mem 0xf7e00000-0xf7efffff 64bit]
[    0.438580] pci 0000:01:00.0: reg 0x18: [mem 0xf0000000-0xf07fffff 64bit pref]
[    0.440372] pci 0000:01:00.0: reg 0x134: [mem 0x00000000-0x007fffff 64bit pref]
[    0.440373] pci 0000:01:00.0: VF(n) BAR2 space: [mem 0x00000000-0x07ffffff 64bit pref] (contains BAR2 for 16 VFs)
[    0.458296] pci 0000:01:00.0: BAR 9: no space for [mem size 0x08000000 64bit pref]
[    0.458298] pci 0000:01:00.0: BAR 9: failed to assign [mem size 0x08000000 64bit pref]
[    0.458382] pci 0000:01:00.0: BAR 2: no space for [mem size 0x00800000 64bit pref]
[    0.458383] pci 0000:01:00.0: BAR 2: failed to assign [mem size 0x00800000 64bit pref]
[    0.458384] pci 0000:01:00.0: BAR 9: no space for [mem size 0x08000000 64bit pref]
[    0.458385] pci 0000:01:00.0: BAR 9: failed to assign [mem size 0x08000000 64bit pref]
[    0.458491] pci 0000:01:00.0: BAR 2: no space for [mem size 0x00800000 64bit pref]
[    0.458492] pci 0000:01:00.0: BAR 2: failed to assign [mem size 0x00800000 64bit pref]
[    0.458493] pci 0000:01:00.0: BAR 9: no space for [mem size 0x08000000 64bit pref]
[    0.458494] pci 0000:01:00.0: BAR 9: failed to assign [mem size 0x08000000 64bit pref]
[    0.458495] pci 0000:01:00.0: BAR 0: assigned [mem 0xdfb00000-0xdfbfffff 64bit]
[    0.458627] pci 0000:01:00.0: BAR 2: no space for [mem size 0x00800000 64bit pref]
[    0.458627] pci 0000:01:00.0: BAR 2: failed to assign [mem size 0x00800000 64bit pref]
[    0.458629] pci 0000:01:00.0: BAR 0: assigned [mem 0xdfb00000-0xdfbfffff 64bit]
[    0.458759] pci 0000:01:00.0: BAR 9: no space for [mem size 0x08000000 64bit pref]
[    0.458760] pci 0000:01:00.0: BAR 9: failed to assign [mem size 0x08000000 64bit pref]

I also tried to boot with an debian installer for testing and I had
similar PCI messages above.

What could I try to do?

Chipset on the failed machine is somewhat older than on the working
machine.

Thank you for any idea or pointer.

[toc] | [next] | [standalone]

#228621

On Sun, Nov 08, 2020 at 05:54:14PM +0100, Marc SCHAEFER wrote:
> What could I try to do?

Thanks to some people around here (private replies), I tried:
   - finding an option in the BIOS about 64 bit PCI addresses,
     none found
   - setpci -s 01:00.0 COMMAND=0x02
   - removing all cards, shuffling them around
   - upgrading the BIOS

Unfortunately, it does not work.

I thus replaced the mainboard from 2014 with one from 2017 and
it works.

[toc] | [prev] | [standalone]

Back to top | Article view | linux.debian.user

csiph-web