Bug 3070 - [Anolis8][ck-4.19][aarch64][nightly社区版] ltp测试套case:route6-change-netlink-dst run失败TFAIL: route-change-netlink failed
Summary: [Anolis8][ck-4.19][aarch64][nightly社区版] ltp测试套case:route6-change-netlink-dst ...
Status: NEW
Alias: None
Product: Anolis OS 8
Classification: Anolis OS
Component: kernel - anck-4.19 (show other bugs) kernel - anck-4.19
Version: 8.6
Hardware: All Linux
: P3-Medium S3-normal
Target Milestone: ---
Assignee: XuanZhuo
QA Contact: shuming
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2022-11-15 10:48 UTC by anolislw
Modified: 2022-11-16 15:00 UTC (History)
2 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description anolislw alibaba_cloud_group 2022-11-15 10:48:11 UTC 
[问题简述]
社区版Anolis8 ck-4.19 aarch64 nightly，ltp测试中case:route6-change-netlink-dst run失败TFAIL: route-change-netlink failed
该case之前是skip的状态，昨晚的nightly开始测试run fail
相关问题fase还有：
route6-change-netlink-dst
route6-change-netlink-gw	
route6-change-netlink-if

[机器环境]
[root@qibo-anolis8-nightly-func-arm-1 ltp]# uname -r
4.19.91-209.git.02d097c7c673.an8.aarch64
[root@qibo-anolis8-nightly-func-arm-1 ltp]# cat /etc/redhat-release
Anolis OS release 8.6
[root@qibo-anolis8-nightly-func-arm-1 ltp]# cat /proc/cmdline
BOOT_IMAGE=(hd0,gpt2)/boot/vmlinuz-4.19.91-209.git.02d097c7c673.an8.aarch64 root=UUID=69f901e7-05b1-40ca-bff0-947d6f410fe7 ro cryptomgr.notests cgroup.memory=nokmem rcupdate.rcu_cpu_stall_timeout=300 vring_force_dma_api rhgb quiet console=tty0 biosdevname=0 net.ifnames=0 console=ttyAMA0,115200n8 noibrs nvme_core.io_timeout=4294967295 nvme_core.admin_timeout=4294967295 crashkernel=0M-2G:0M,2G-8G:192M,8G-:256M
[root@qibo-anolis8-nightly-func-arm-1 ltp]# free -g
              total        used        free      shared  buff/cache   available
Mem:             15           0           6           0           7          14
Swap:             0           0           0
[root@qibo-anolis8-nightly-func-arm-1 ltp]# df -h
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        7.5G     0  7.5G   0% /dev
tmpfs           7.6G     0  7.6G   0% /dev/shm
tmpfs           7.6G  608K  7.6G   1% /run
tmpfs           7.6G     0  7.6G   0% /sys/fs/cgroup
/dev/vda2        39G   32G  5.3G  86% /
/dev/vda1       500M  6.8M  494M   2% /boot/efi
tmpfs           1.6G     0  1.6G   0% /run/user/0
[root@qibo-anolis8-nightly-func-arm-1 ltp]# lscpu
Architecture:        aarch64
Byte Order:          Little Endian
CPU(s):              4
On-line CPU(s) list: 0-3
Thread(s) per core:  1
Core(s) per cluster: 4
Socket(s):           1
Cluster(s):          1
NUMA node(s):        1
Vendor ID:           ARM
BIOS Vendor ID:      Alibaba Cloud
Model:               1
Model name:          Neoverse-N1
BIOS Model name:     virt-rhel7.6.0
Stepping:            r3p1
BogoMIPS:            50.00
NUMA node0 CPU(s):   0-3
Flags:               fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp ssbs


[复现步骤]
git clone https://gitee.com/anolis/ltp.git
cd ltp
make autotools
./configure
make && make install
cd /opt/ltp/
./runltp -f net_stress.route -s route6-change-netlink-dst

[实际结果]
Running tests.......
<<<test_start>>>
tag=route6-change-netlink-dst stime=1668480366
cmdline="route-change-netlink-dst.sh -6"
contacts=""
analysis=exit
<<<test_output>>>
incrementing stop
route-change-netlink-dst 1 TINFO: initialize 'lhost' 'ltp_ns_veth2' interface
route-change-netlink-dst 1 TINFO: add local addr 10.0.0.2/24
route-change-netlink-dst 1 TINFO: add local addr fd00:1:1:1::2/64
route-change-netlink-dst 1 TINFO: initialize 'rhost' 'ltp_ns_veth1' interface
route-change-netlink-dst 1 TINFO: add remote addr 10.0.0.1/24
route-change-netlink-dst 1 TINFO: add remote addr fd00:1:1:1::1/64
route-change-netlink-dst 1 TINFO: Network config (local -- remote):
route-change-netlink-dst 1 TINFO: ltp_ns_veth2 -- ltp_ns_veth1
route-change-netlink-dst 1 TINFO: 10.0.0.2/24 -- 10.0.0.1/24
route-change-netlink-dst 1 TINFO: fd00:1:1:1::2/64 -- fd00:1:1:1::1/64
route-change-netlink-dst 1 TINFO: timeout per run is 0h 5m 0s
route-change-netlink-dst 1 TINFO: change IPv6 route destination 10000 times
route-change-netlink-dst 1 TINFO: running route-change-netlink -c 10000 -6 -p 65535 -d ltp_ns_veth2 -r 'fd00:23:4::1,fd00:23:3::1,fd00:23:2::1,fd00:23:1::1,fd00:23::1,'
tst_test.c:1528: TINFO: Timeout per run is 0h 00m 30s
route-change-netlink.c:284: TINFO: adding and deleting route 10000 times
route-change-netlink.c:277: TBROK: sendto(3, 0x420b28, 8, 2048, [fd00:23:2::1]:65535, 28) failed: ENETUNREACH (101)

Summary:
passed   0
failed   0
broken   1
skipped  0
warnings 0
route-change-netlink-dst 1 TFAIL: route-change-netlink failed
route-change-netlink-dst 1 TINFO: initialize 'lhost' 'ltp_ns_veth2' interface
route-change-netlink-dst 1 TINFO: add local addr 10.0.0.2/24
route-change-netlink-dst 1 TINFO: add local addr fd00:1:1:1::2/64
route-change-netlink-dst 1 TINFO: initialize 'rhost' 'ltp_ns_veth1' interface
route-change-netlink-dst 1 TINFO: add remote addr 10.0.0.1/24
route-change-netlink-dst 1 TINFO: add remote addr fd00:1:1:1::1/64

Summary:
passed   0
failed   1
broken   0
skipped  0
warnings 0
<<<execution_status>>>
initiation_status="ok"
duration=1 termination_type=exited termination_id=1 corefile=no
cutime=29 cstime=13
<<<test_end>>>
INFO: ltp-pan reported some tests FAIL
LTP Version: 20220527-36-ge080ec8e5

       ###############################################################

            Done executing testcases.
            LTP Version:  20220527-36-ge080ec8e5
       ###############################################################
Comment 1 Jacob alibaba_cloud_group 2022-11-15 15:29:11 UTC 
之前skip是由于缺少libmnl-devel包导致skip，安装libmnl-devel包之后，4.19在aarch64上失败，失败日志：
route-change-netlink.c:284: TINFO: adding and deleting route 10000 times
route-change-netlink.c:277: TBROK: sendto(3, 0x420b28, 8, 2048, [fd00:23::1]:65530, 28) failed: ENETUNREACH (101)

单独执行 ./testcases/bin/route-change-netlink -c 10000 -6 -p 65530 -d ltp_ns_veth2 -r 'fd00:23:4::1,fd00:23:3::1,fd00:23:2::1,fd00:23:1::1,fd00:23::1,'  
之后查看路由表：
# route -6 -n
Kernel IPv6 routing table
Destination                    Next Hop                   Flag Met Ref Use If
::1/128                        ::                         U    256 1      0 lo
fd00:1:1:1::/64                ::                         U    256 2      0 ltp_ns_veth2
fd00:23:4::/64                 ::                         U    1024 1      0 ltp_ns_veth2
fe80::/64                      ::                         U    256 2      0 eth0
fe80::/64                      ::                         U    256 1      0 ltp_ns_veth2
::/0                           ::                         !n   -1  1      0 lo
::1/128                        ::                         Un   0   2      0 lo
fd00:1:1:1::2/128              ::                         Un   0   2      0 ltp_ns_veth2
fe80::216:3eff:fe0c:88af/128   ::                         Un   0   5      0 eth0
fe80::cc3d:a5ff:feb5:eb40/128  ::                         Un   0   2      0 ltp_ns_veth2
ff00::/8                       ::                         U    256 1      0 eth0
ff00::/8                       ::                         U    256 3      0 ltp_ns_veth2
::/0                           ::                         !n   -1  1      0 lo

【补充说明】
当前问题在5.10内核上没有出现问题。在x86平台上多次执行有概率失败
Comment 2 wangpingping alibaba_cloud_group 2022-11-16 15:00:12 UTC 
anolis7.9 x86出现概率性失败，大概执行5次，成功1次或者2次
下载社区最新ltp代码，也是一样的；
# uname -r
4.19.91-199.git.02d097c.an7.x86_64
# cat /etc/os-release
NAME="Anolis OS"
VERSION="7.9"
ID="anolis"
ID_LIKE="rhel fedora centos"
VERSION_ID="7.9"
PRETTY_NAME="Anolis OS 7.9"
ANSI_COLOR="0;31"
HOME_URL="https://openanolis.cn/"
BUG_REPORT_URL="https://bugs.openanolis.cn/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

部分失败日志如下：
<<<test_start>>>
tag=route6-change-netlink-dst stime=1668581962
cmdline="route-change-netlink-dst.sh -6"
contacts=""
analysis=exit
<<<test_output>>>
incrementing stop
route-change-netlink-dst 1 TINFO: initialize 'lhost' 'ltp_ns_veth2' interface
route-change-netlink-dst 1 TINFO: add local addr 10.0.0.2/24
route-change-netlink-dst 1 TINFO: add local addr fd00:1:1:1::2/64
route-change-netlink-dst 1 TINFO: initialize 'rhost' 'ltp_ns_veth1' interface
route-change-netlink-dst 1 TINFO: add remote addr 10.0.0.1/24
route-change-netlink-dst 1 TINFO: add remote addr fd00:1:1:1::1/64
route-change-netlink-dst 1 TINFO: Network config (local -- remote):
route-change-netlink-dst 1 TINFO: ltp_ns_veth2 -- ltp_ns_veth1
route-change-netlink-dst 1 TINFO: 10.0.0.2/24 -- 10.0.0.1/24
route-change-netlink-dst 1 TINFO: fd00:1:1:1::2/64 -- fd00:1:1:1::1/64
route-change-netlink-dst 1 TINFO: timeout per run is 0h 5m 0s
route-change-netlink-dst 1 TINFO: change IPv6 route destination 10000 times
route-change-netlink-dst 1 TINFO: running route-change-netlink -c 10000 -6 -p 65535 -d ltp_ns_veth2 -r 'fd00:23:4::1,fd00:23:3::1,fd00:23:2::1,fd00:23:1::1,fd00:23::1,'
tst_test.c:1554: TINFO: Timeout per run is 0h 00m 30s
route-change-netlink.c:282: TINFO: adding and deleting route 10000 times
route-change-netlink.c:275: TBROK: sendto(3, 0x41f9e6, 8, 2048, [fd00:23:1::1]:65535, 28) failed: ENETUNREACH (101)

Summary:
passed   0
failed   0
broken   1
skipped  0
warnings 0
route-change-netlink-dst 1 TFAIL: route-change-netlink failed
route-change-netlink-dst 1 TINFO: initialize 'lhost' 'ltp_ns_veth2' interface
route-change-netlink-dst 1 TINFO: add local addr 10.0.0.2/24
route-change-netlink-dst 1 TINFO: add local addr fd00:1:1:1::2/64
route-change-netlink-dst 1 TINFO: initialize 'rhost' 'ltp_ns_veth1' interface
route-change-netlink-dst 1 TINFO: add remote addr 10.0.0.1/24
route-change-netlink-dst 1 TINFO: add remote addr fd00:1:1:1::1/64

Summary:
passed   0
failed   1
broken   0
skipped  0
warnings 0