Bug 6179 - [ANCK-5.10-16][x86_64][nightly] qos_check用例fail,报错TFAIL: mount resctrl without -o but some files missed
Summary: [ANCK-5.10-16][x86_64][nightly] qos_check用例fail,报错TFAIL: mount resctrl withou...
Status: RESOLVED WORKSFORME
Alias: None
Product: Antest
Classification: Infrastructures
Component: 测试用例 (show other bugs) 测试用例
Version: unspecified
Hardware: x86_64 Linux
: P3-Medium S3-normal
Target Milestone: ---
Assignee: yunmeng365524
QA Contact: shuming
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-08-17 11:51 UTC by shanxifanshi
Modified: 2023-10-18 14:53 UTC (History)
8 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description shanxifanshi alibaba_cloud_group 2023-08-17 11:51:36 UTC
[缺陷描述]:
qos_check用例fail,报错TFAIL: mount resctrl without -o but some files missed,更换了新的测试机器,该用例fail;目前发现在F51机型fail,原来的N49机型测试是pass的

测试日志:
<<<test_start>>>
tag=qos_check stime=1692066249
cmdline="qos_check.sh"
contacts=""
analysis=exit
<<<test_output>>>
qos_check 1 TINFO: CONFIG_X86_CPU_RESCTRL=y
qos_check 1 TPASS: CONFIG_INTEL_RDT or CONFIG_X86_CPU_RESCTRL is set
qos_check 1 TINFO: CAP: found cat_l3 or cat_l2
qos_check 1 TINFO: CDP: found cdp_l3 or cdp_l2
qos_check 1 TINFO: CQM: found cqm_llc or cqm_occup_llc
qos_check 1 TINFO: MBM: found cqm_mbm_total or cqm_mbm_local
qos_check 1 TINFO: MBA: found mba
qos_check 1 TPASS: cpuinfo exposure capabilities
qos_check 1 TPASS: the resctrl interface is registered
qos_check 1 TFAIL: mount resctrl without -o but some files missed
qos_check 1 TCONF: mount resctrl with cdp failed
qos_check 1 TCONF: mount resctrl with mba_MBps failed
qos_check 1 TCONF: mount resctrl failed

Summary:
passed   3
failed   1
skipped  3
warnings 0
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=33 corefile=no
cutime=3 cstime=3
<<<test_end>>>

复现环境:
anck 5.10 x86物理机 F51机型

复现概率:
必现

内核信息:
# uname -r
5.10.134-77.git.a73b26af8.an8.x86_64


操作系统信息:
# cat /etc/os-release
NAME="Anolis OS"
VERSION="8.8"
ID="anolis"
ID_LIKE="rhel fedora centos"
VERSION_ID="8.8"
PLATFORM_ID="platform:an8"
PRETTY_NAME="Anolis OS 8.8"
ANSI_COLOR="0;31"
HOME_URL="https://openanolis.cn/"

cpu信息:
# lscpu
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              96
On-line CPU(s) list: 0-95
Thread(s) per core:  2
Core(s) per socket:  24
Socket(s):           2
NUMA node(s):        1
Vendor ID:           GenuineIntel
BIOS Vendor ID:      Intel(R) Corporation
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
BIOS Model name:     Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
Stepping:            4
CPU MHz:             999.644
CPU max MHz:         3100.0000
CPU min MHz:         1000.0000
BogoMIPS:            5000.00
Virtualization:      VT-x
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            33792K
NUMA node0 CPU(s):   0-95
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke md_clear flush_l1d arch_capabilities

内存信息:
# free -h
              total        used        free      shared  buff/cache   available
Mem:          503Gi       3.1Gi       499Gi       2.0Mi       639Mi       497Gi
Swap:            0B          0B          0B

内核参数:
# cat /proc/cmdline
BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.10.134-77.git.a73b26af8.an8.x86_64 root=UUID=a5b37697-06a2-41c2-9345-b1aced9b8a70 ro cryptomgr.notests rcupdate.rcu_cpu_stall_timeout=300 vring_force_dma_api rhgb quiet biosdevname=0 net.ifnames=0 console=tty0 console=ttyS0,115200n8 noibrs nvme_core.io_timeout=4294967295 nvme_core.admin_timeout=4294967295 cgroup.memory=nokmem crashkernel=0M-2G:0M,2G-8G:192M,8G-:256M

[复现步骤]:
git clone git@gitlab-sp.alibaba-inc.com:alikernel/ltp.git
cd ltp
export BUILD_ALITESTS_ONLY=yes
export CFLAGS="${CFLAGS} -fcommon"  #  gcc 10 需要添加这个。
make autotools
./configure 
make && install
cd /opt/ltp
./runltp -f alitests -s qos_check

[期望结果]:
用例pass

[实际结果]:
用例fail

[测试分析]:
1. 手动简要复现步骤:
mount -t resctrl resctrl /sys/fs/resctrl

2. 依次查看如下目录是否存在
ll /sys/fs/resctrl/cpus
ll /sys/fs/resctrl/cpus_list
ll /sys/fs/resctrl/info
ll /sys/fs/resctrl/mode
ll /sys/fs/resctrl/mon_data
ll /sys/fs/resctrl/mon_groups
ll /sys/fs/resctrl/schemata
ll /sys/fs/resctrl/size
ll /sys/fs/resctrl/tasks

如上复现步骤,用例fail的原因是查询时发现/sys/fs/resctrl/mon_data和/sys/fs/resctrl/mon_groups目录不存在
Comment 1 shanxifanshi alibaba_cloud_group 2023-10-16 13:42:46 UTC
an8 016内核,该问题仍然存在

<<<test_start>>>
tag=qos_check stime=1697434815
cmdline="qos_check.sh"
contacts=""
analysis=exit
<<<test_output>>>
incrementing stop
qos_check 1 TINFO: CONFIG_X86_CPU_RESCTRL=y
qos_check 1 TPASS: CONFIG_INTEL_RDT or CONFIG_X86_CPU_RESCTRL is set
qos_check 1 TINFO: CAP: found cat_l3 or cat_l2
qos_check 1 TINFO: CDP: found cdp_l3 or cdp_l2
qos_check 1 TINFO: CQM: found cqm_llc or cqm_occup_llc
qos_check 1 TINFO: MBM: found cqm_mbm_total or cqm_mbm_local
qos_check 1 TINFO: MBA: found mba
qos_check 1 TPASS: cpuinfo exposure capabilities
qos_check 1 TPASS: the resctrl interface is registered
qos_check 1 TFAIL: mount resctrl without -o but some files missed
qos_check 1 TCONF: mount resctrl with cdp failed
qos_check 1 TCONF: mount resctrl with mba_MBps failed
qos_check 1 TCONF: mount resctrl failed

Summary:
passed   3
failed   1
skipped  3
warnings 0
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=33 corefile=no
cutime=3 cstime=3
<<<test_end>>>
INFO: ltp-pan reported some tests FAIL
LTP Version: 20180515

       ###############################################################

            Done executing testcases.
            LTP Version:  20180515
       ###############################################################

RUNLTP_END

# uname -r
5.10.134-16_rc1.an8.x86_64
Comment 2 shanxifanshi alibaba_cloud_group 2023-10-16 13:45:37 UTC
(In reply to shanxifanshi from comment #1)
> an8 016内核,该问题仍然存在
> 
> <<<test_start>>>
> tag=qos_check stime=1697434815
> cmdline="qos_check.sh"
> contacts=""
> analysis=exit
> <<<test_output>>>
> incrementing stop
> qos_check 1 TINFO: CONFIG_X86_CPU_RESCTRL=y
> qos_check 1 TPASS: CONFIG_INTEL_RDT or CONFIG_X86_CPU_RESCTRL is set
> qos_check 1 TINFO: CAP: found cat_l3 or cat_l2
> qos_check 1 TINFO: CDP: found cdp_l3 or cdp_l2
> qos_check 1 TINFO: CQM: found cqm_llc or cqm_occup_llc
> qos_check 1 TINFO: MBM: found cqm_mbm_total or cqm_mbm_local
> qos_check 1 TINFO: MBA: found mba
> qos_check 1 TPASS: cpuinfo exposure capabilities
> qos_check 1 TPASS: the resctrl interface is registered
> qos_check 1 TFAIL: mount resctrl without -o but some files missed
> qos_check 1 TCONF: mount resctrl with cdp failed
> qos_check 1 TCONF: mount resctrl with mba_MBps failed
> qos_check 1 TCONF: mount resctrl failed
> 
> Summary:
> passed   3
> failed   1
> skipped  3
> warnings 0
> <<<execution_status>>>
> initiation_status="ok"
> duration=0 termination_type=exited termination_id=33 corefile=no
> cutime=3 cstime=3
> <<<test_end>>>
> INFO: ltp-pan reported some tests FAIL
> LTP Version: 20180515
> 
>        ###############################################################
> 
>             Done executing testcases.
>             LTP Version:  20180515
>        ###############################################################
> 
> RUNLTP_END
> 
> # uname -r
> 5.10.134-16_rc1.an8.x86_64

---目前看,只在特定机型上存在问题,比如本次测试的F51机型
Comment 3 yunmeng365524 2023-10-18 14:53:12 UTC
016版本在内部跟踪