Bug 3594 - [Anolis8 ck-4.19][kernel-debug][aarch64][内部nightly] blktests测试套nvmeof-mp/001测试fail
Summary: [Anolis8 ck-4.19][kernel-debug][aarch64][内部nightly] blktests测试套nvmeof-mp/001测...
Status: NEW
Alias: None
Product: Anolis OS 8
Classification: Anolis OS
Component: kernel - anck-4.19 (show other bugs) kernel - anck-4.19
Version: 8.6
Hardware: All Linux
: P3-Medium S3-normal
Target Milestone: ---
Assignee: hobbit
QA Contact: shuming
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2022-12-30 17:30 UTC by anolislw
Modified: 2023-04-28 11:29 UTC (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description anolislw alibaba_cloud_group 2022-12-30 17:30:57 UTC
Description of problem:
在anolis8.6 ck-4.19 aarch64环境下,内部nightly测试,blktests测试执行nvmeof-mp/001测试fail


Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1.安装kernel-debug相关内核,然后重启环境
  curl http://ci-storage.alibaba.net/kernel/anolis8/ck-4.19/aarch64/20221229_584/|grep aarch64 | sed -e 's#\"# #' -e 's#\"># #' | xargs -n1 | grep rpm$ | xargs -i wget -c http://ci-storage.alibaba.net/kernel/anolis8/ck-4.19/aarch64/20221229_584/{}
2. rpm -ivh *.rpm && reboot
3. git clone @gitlab-sp.alibaba-inc.com/AKTF/blktests.git
   cd blktests/
   make && make install prefix=./run_blktests     
   wipefs -a -f /dev/nvme0n1             
   modprobe -n -q dm_multipath
   modprobe -n -q dm_queue_length
   modprobe -n -q dm_service_time
   modprobe -n -q null_blk
   modprobe -n -q rdma_cm
   modprobe -n -q ib_ipoib
   modprobe -n -q ib_umad
   modprobe -n -q rdma_rxe
   modprobe -n -q nvme-rdma
   modprobe -n -q nvmet-rdma
   modprobe -n -q scsi_dh_alua
   modprobe -n -q scsi_dh_emc
   modprobe -n -q scsi_dh_rdac
   cd blktests
   ./check nvmeof-mp/001

Actual results:
[root@l57h15217 blktests]# ./check nvmeof-mp/001
nvmeof-mp/001 (Log in and log out)                           [failed]
    runtime  13.370s  ...  12.971s
    --- tests/nvmeof-mp/001.out 2022-12-30 17:00:59.241580900 +0800
    +++ /root/blktests/run_blktests/blktests/results/nodev/nvmeof-mp/001.out.bad  2022-12-30 17:24:29.982009390 +0800
    @@ -1,3 +1,12 @@
    +error: Invalid argument
    +error: Invalid argument
    +error: Invalid argument
    +common/multipath-over-rdma: line 411: bonding_masters/addr_len: Not a directory
    +error: Invalid argument
    +error: Invalid argument
    +error: Invalid argument
    ...
    (Run 'diff -u tests/nvmeof-mp/001.out /root/blktests/run_blktests/blktests/results/nodev/nvmeof-mp/001.out.bad' to see the entire diff)
error: Invalid argument
error: Invalid argument


[root@l57h15217 blktests]# diff -u tests/nvmeof-mp/001.out /root/blktests/run_blktests/blktests/results/nodev/nvmeof-mp/001.out.bad
--- tests/nvmeof-mp/001.out 2022-12-30 17:00:59.241580900 +0800
+++ /root/blktests/run_blktests/blktests/results/nodev/nvmeof-mp/001.out.bad  2022-12-30 17:28:59.467393369 +0800
@@ -1,3 +1,12 @@
+error: Invalid argument
+error: Invalid argument
+error: Invalid argument
+common/multipath-over-rdma: line 411: bonding_masters/addr_len: Not a directory
+error: Invalid argument
+error: Invalid argument
+error: Invalid argument
+error: Invalid argument
+error: Invalid argument
+No NVMeOF target ports
 Configured NVMe target driver
-count_devices(): 1 <> 1
-Passed
+count_devices(): 0 <> 1
[root@l57h15217 blktests]#


[root@l57h15217 blktests]# uname -r
4.19.91-584.git.e680634f5.an8.aarch64+debug
[root@l57h15217 blktests]# cat /etc/anolis-release
Anolis OS release 8.6


Expected results:
case pass

Additional info:
[root@l57h15217 blktests]# uname -r
4.19.91-584.git.e680634f5.an8.aarch64+debug
[root@l57h15217 blktests]# cat /etc/redhat-release
Anolis OS release 8.6
[root@l57h15217 blktests]# df -h
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        329G     0  329G   0% /dev
tmpfs           329G     0  329G   0% /dev/shm
tmpfs           329G   27M  329G   1% /run
tmpfs           329G     0  329G   0% /sys/fs/cgroup
/dev/sda2        49G   13G   35G  27% /
/dev/sda1      1022M  6.7M 1016M   1% /boot/efi
tmpfs            66G     0   66G   0% /run/user/0
[root@l57h15217 blktests]# free -g
              total        used        free      shared  buff/cache   available
Mem:            657          25         630           0           1         629
Swap:             1           0           1
[root@l57h15217 blktests]# cat /proc/cmdline
BOOT_IMAGE=(hd1,gpt2)/boot/vmlinuz-4.19.91-584.git.e680634f5.an8.aarch64+debug root=UUID=cd8a344d-cafe-4ec7-b388-f146d1519121 ro console=tty0 console=ttyS0,115200 rd.driver.pre=ahci crashkernel=0M-2G:0M,2G-8G:192M,8G-:256M slub_debug=FPZU kmemleak=on
[root@l57h15217 blktests]# lscpu
Architecture:        aarch64
Byte Order:          Little Endian
CPU(s):              96
On-line CPU(s) list: 0-95
Thread(s) per core:  1
Core(s) per socket:  48
Socket(s):           2
NUMA node(s):        1
Vendor ID:           HiSilicon
BIOS Vendor ID:      HiSilicon
Model:               0
Model name:          Kunpeng-920
BIOS Model name:     HUAWEI Kunpeng 920 5250
Stepping:            0x1
CPU max MHz:         2600.0000
CPU min MHz:         200.0000
BogoMIPS:            200.00
L1d cache:           64K
L1i cache:           64K
L2 cache:            512K
L3 cache:            24576K
NUMA node0 CPU(s):   0-95
Flags:               fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma dcpop asimddp asimdfhm
[root@l57h15217 blktests]#

以下case有类似问题:
nvmeof-mp/002 nvmeof-mp/005 nvmeof-mp/006 nvmeof-mp/009 nvmeof-mp/010 nvmeof-mp/011 nvmeof-mp/012
Comment 1 anolislw alibaba_cloud_group 2023-01-03 14:36:15 UTC
case:srp/001,srp/002,srp/005,srp/006,srp/007,srp/008,srp/009,srp/010,srp/011,srp/012,srp/013,srp/014
也有类似的问题

Eorr log:
https://sam-autotest.oss-cn-hangzhou-zmf.aliyuncs.com/133471/srp_16727266648992658865/1/stdout.log?OSSAccessKeyId=LTAIV2q6AXNHBUnv&Expires=1672734571&Signature=ZJZ%2BeF0j6X9NNVWxB4UolnCY0xI%3D

-------------------
srp/001 (Create and remove LUNs)                             [failed]
    runtime    ...  10.994s
    --- tests/srp/001.out	2023-01-03 14:18:02.508188841 +0800
error: Invalid argument
error: Invalid argument
    +++ /tmp/tone/run/blktests/results/nodev/srp/001.out.bad	2023-01-03 14:18:21.212544204 +0800
    @@ -1,3 +1,11 @@
    +error: Invalid argument
    +error: Invalid argument
    +error: Invalid argument
    +common/multipath-over-rdma: line 411: bonding_masters/addr_len: Not a directory
    +error: Invalid argument
    +error: Invalid argument
    +error: Invalid argument
    ...
    (Run 'diff -u tests/srp/001.out /tmp/tone/run/blktests/results/nodev/srp/001.out.bad' to see the entire diff)
srp/002 (File I/O on top of multipath concurrently with logout and login (mq))
srp/002 (File I/O on top of multipath concurrently with logout and login (mq)) [failed]
    runtime    ...  10.817s


job link:
https://tone.aliyun-inc.com/ws/6yddz4ne/test_result/133471