使用 EMC ScaleIO 存储时 VxFEN 无法启动

问题

重新引导节点后，使用 EMC ScaleIO 时 VxFEN 服务无法启动。这可能会导致节点无法加入集群。

错误信息

Nov 22 08:21:35 server101 scini[6049]: Error (sftp): File /etc/emc/scaleio/scini_sync/scini_key must exist.
Nov 22 08:21:35 server101 scini[6051]: driver_sync.sh END - Wed Nov 22 08:21:35 EST 2023
Nov 22 08:21:35 server101 scini[5193]: driver_sync failed! Please check driver_sync.log
Nov 22 08:21:35 server101 scini[5193]: No match after driver_sync fetch attempt.
Nov 22 08:21:35 server101 scini[5193]: Attempting to find a best match...
Nov 22 08:21:35 server101 systemd[1]: Started Automounts filesystems on demand.

..

Nov 22 08:21:38 server101 vxvm-boot[18297]: Starting up VxVM:
...
Nov 22 08:21:39 server101 kernel: PowerFlex drvMain_Init:61 :Driver starting load process. HZ 1000...
Nov 22 08:21:39 server101 kernel: PowerFlex mosCpu_Init:80 :eax=00000960, ebx=00000dac, ecx=00000064, edx=00000000
Nov 22 08:21:39 server101 kernel: PowerFlex mosT10Dif_Init:933 :(T10DIF) T10DIF layer using CPU (PCLMUL) acceleration !!!
Nov 22 08:21:39 server101 kernel: PowerFlex drvMain_Init:63 :Load process done. Status SUCCESS
Nov 22 08:21:39 server101 scini[5163]: Success loading module /bin/emc/scaleio/scini.ko
Nov 22 08:21:39 server101 scini[5163]: Found device special file /dev/scini
Nov 22 08:21:39 server101 kernel: VxVM vxio V-5-0-1990 driver version 7.4.2.4300 installed
Nov 22 08:21:39 server101 kernel: VxVM vxspec V-5-0-1990 driver version 7.4.2.4300 installed
Nov 22 08:21:39 server101 vxvm-boot[30112]: cat: /proc/sys/kernel/hotplug: No such file or directory
Nov 22 08:21:39 server101 vxvm-boot[21946]: VxVM general startup...
Nov 22 08:21:39 server101 kernel: PowerFlex mapMdmLayer_SetIniGUID:6107 :No such SDC instance, allocate one..
Nov 22 08:21:39 server101 kernel: PowerFlex ioctl_HandleSetIniGuid:644 :Set GUID (35908BB8-9DD7-436D-B326-150093745E95) finished . status 65 (SUCCESS)
Nov 22 08:21:39 server101 scini[28737]: Loading MDMs from configuration file /etc/emc/scaleio/drv_cfg.txt
Nov 22 08:21:39 server101 scini[28737]: Loading MDMs from configuration file /etc/emc/scaleio/drv_cfg.txt
Nov 22 08:21:39 server101 scini[28737]: Successfully set GUID 35908BB8-9DD7-436D-B326-150093745E95
Nov 22 08:21:39 server101 scini[28737]: Successfully add mdm from cfg line 10
Nov 22 08:21:39 server101 kernel: PowerFlex ioctl_HandleAddMdm:469 :Create finish for MDM. First I

...

Nov 22 08:21:44 server101 scini[5163]: scinia is not ready yet...

原因

在 VxVM 进程完成并上线之前，ScaleIO 守护程序 (scini) 尚未完成启动和创建存储。然后，VxFEN 将启动并由于缺乏可用存储而失败。在本例中为隔离盘。

解决方案

此解决方案仅适用于 VxVM 不用于防护以外的任何用途的环境。正在继续与 EMC 合作，以实现 VxVM fo 与 ScaleIO 的功能。

 1. 停止 vxfen.service。

# systemctl stop vxfen.service

 2. 编辑文件/usr/lib/sysystemd/system/vxfen.service并将scini.service添加到 After 属性中。

After=rsyslog.service veki.service llt.service gab.service sdcd.service scini.service

 3. 复制pre_vxfenstart 的示例脚本。

# cp /opt/VRTSvcs/vxfen/sample_scripts/pre_vxfenstart /opt/VRTSvcs/vxfen/bin/
# chmod a+x /opt/VRTSvcs/vxfen/bin/pre_vxfenstart

 4. 修改脚本/opt/VRTSvcs/vxfen/bin/pre_vxfenstart， 将以下行附加到文件末尾

LC_ALL=C $VXDISK scandisks 2>/dev/null
LC_ALL=C $VXDISK -oalldgs list >$VCS_LOG_TMP/$VXFEN_TEMP_PRE.scandisks.$$ 2>/dev/null
RETVAL=0
return $RETVAL

 5. 重新启动 vxfen.service 或重启系统。

# systemctl start vxfen.service