Description Janos 2023-06-07 11:54:25 UTC

Created attachment 754 [details]
namenode启动失败日志

[缺陷描述]：
  hadoop 3.3.5 版本启动服务时，启动 namenode 失败


[重现环境]：
环境信息：线上ecs
OS：Anolis 23 x86_64/aarch64

# cat /etc/os-release
NAME="Anolis OS"
VERSION="23"
ID="anolis"
VERSION_ID="23"
PLATFORM_ID="platform:an23"
PRETTY_NAME="Anolis OS 23"
ANSI_COLOR="0;31"
HOME_URL="https://openanolis.cn/"
BUG_REPORT_URL="https://bugzilla.openanolis.cn/"

KERNEL：
# uname -r
5.10.134-14.an23.x86_64


[重现步骤]：
参考SIG：https://openanolis.cn/sig/third_software_compatibility/doc/439243136273582211

yum install -y java-1.8.0-openjdk-devel

# 下载hadoop
# x86
wget https://mirrors.aliyun.com/apache/hadoop/common/hadoop-3.3.5/hadoop-3.3.5.tar.gz
# arm
wget https://mirrors.aliyun.com/apache/hadoop/common/hadoop-3.3.5/hadoop-3.3.5-aarch64.tar.gz

tar -xzf hadoop-3.3.5-aarch64.tar.gz
mv hadoop-3.3.5 /usr/local/hadoop

cd /usr/local/hadoop
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk

# 编写配置文件
cat <<- EOF > /usr/local/hadoop/etc/hadoop/core-site.xml
<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>
EOF

cat <<- EOF > /usr/local/hadoop/etc/hadoop/hdfs-site.xml
<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration>
EOF

# 配置env文件定义JAVA_HOME路径
sed -i 's!# export JAVA_HOME=!export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk!'  /usr/local/hadoop/etc/hadoop/hadoop-env.sh

# hadoop-3.x为了提升安全性，需要指定操作hadoop进程的用户
sed -i "2i HDFS_DATANODE_USER=root\nHDFS_DATANODE_SECURE_USER=hdfs\nHDFS_NAMENODE_USER=root\nHDFS_SECONDARYNAMENODE_USER=root"  /usr/local/hadoop/sbin/start-dfs.sh
sed -i "2i YARN_RESOURCEMANAGER_USER=root\nHADOOP_SECURE_DN_USER=yarn\nYARN_NODEMANAGER_USER=root"  /usr/local/hadoop/sbin/start-yarn.sh

# 格式化文件系统
cd /usr/local/hadoop/
bin/hdfs namenode -format

# 启动服务
# 启动dfs相关的进程
sbin/start-dfs.sh 


# 查看已启动的服务
jps

[期望结果]：
NameNode服务启动成功

[实际结果]：
NameNode服务启动失败，详细日志见附件
相同操作在下载相同版本的hadoop在an8上启动正常

# sbin/start-dfs.sh
Starting namenodes on [localhost]
localhost: Warning: Permanently added 'localhost' (ED25519) to the list of known hosts.
localhost: ERROR: Cannot set priority of namenode process 549735
Starting datanodes
Starting secondary namenodes [iZbp1f0r7cq40w7pws3kfpZ]
iZbp1f0r7cq40w7pws3kfpZ: Warning: Permanently added 'izbp1f0r7cq40w7pws3kfpz' (ED25519) to the list of known hosts.

# jps
549832 DataNode
550139 Jps
550001 SecondaryNameNode