Anomalie #5177
Mis à jour par Christian P. Momon il y a environ 3 ans
Le 02/02/2021, des problèmes ont bloqué le reboot du cluster Chapril.
Déroulement :
* procédure de redémarrage de maine, tout se passe bien :
<pre>
448 [2021-02-02 13:59] df | awk '/^\/dev/ {print $1}' | xargs -I {} sh -c 'echo {}; tune2fs -l {}' | awk '/^\/dev/ {print $1} /^Filesystem state/ {print $3, " ",$4}'
449 [2021-02-02 13:59] virsh list
450 [2021-02-02 13:59] cd /etc/libvirt/qemu
451 [2021-02-02 13:59] for host in $(ls *xml | sed -e 's/.xml//g') ; do virsh shutdown $host ; done; watch virsh list
452 [2021-02-02 14:01] umount /var/lib/libvirt/maine
453 [2021-02-02 14:01] drbdadm disconnect coon
454 [2021-02-02 14:01] drbdadm secondary maine
455 [2021-02-02 14:01] drbdadm disconnect maine
456 [2021-02-02 14:01] reboot
457 [2021-02-02 14:04] watch "systemctl status | grep State | head -1"
458 [2021-02-02 14:04] drbdadm primary maine
459 [2021-02-02 14:04] mount /var/lib/libvirt/maine
460 [2021-02-02 14:04] cd /etc/libvirt/qemu
461 [2021-02-02 14:04] for host in $(ls *xml | sed -e 's/.xml//g'| grep -v modele) ; do virsh start $host ; done
462 [2021-02-02 14:04] virsh list
</pre>
* procédure de redémarrage de coon :
<pre>
414 [2021-02-02 14:05] df | awk '/^\/dev/ {print $1}' | xargs -I {} sh -c 'echo {}; tune2fs -l {}' | awk '/^\/dev/ {print $1} /^Filesystem state/ {print $3, " ",$4}'
415 [2021-02-02 14:05] virsh list
416 [2021-02-02 14:05] cd /etc/libvirt/qemu
417 [2021-02-02 14:05] for host in $(ls *xml | sed -e 's/.xml//g') ; do virsh shutdown $host ; done; watch virsh list
418 [2021-02-02 14:07] umount /var/lib/libvirt/coon
419 [2021-02-02 14:07] drbdadm disconnect maine
420 [2021-02-02 14:07] drbdadm secondary coon
421 [2021-02-02 14:07] drbdadm disconnect coon
422 [2021-02-02 14:07] reboot
423 [2021-02-02 14:09] watch "systemctl status | grep State | head -1"
424 [2021-02-02 14:10] systemctl list-units
425 [2021-02-02 14:10] systemctl restart firehol.service
426 [2021-02-02 14:10] systemctl list-units
427 [2021-02-02 14:10] reboot
</pre>
* …
Déroulement :
* procédure de redémarrage de maine, tout se passe bien :
<pre>
448 [2021-02-02 13:59] df | awk '/^\/dev/ {print $1}' | xargs -I {} sh -c 'echo {}; tune2fs -l {}' | awk '/^\/dev/ {print $1} /^Filesystem state/ {print $3, " ",$4}'
449 [2021-02-02 13:59] virsh list
450 [2021-02-02 13:59] cd /etc/libvirt/qemu
451 [2021-02-02 13:59] for host in $(ls *xml | sed -e 's/.xml//g') ; do virsh shutdown $host ; done; watch virsh list
452 [2021-02-02 14:01] umount /var/lib/libvirt/maine
453 [2021-02-02 14:01] drbdadm disconnect coon
454 [2021-02-02 14:01] drbdadm secondary maine
455 [2021-02-02 14:01] drbdadm disconnect maine
456 [2021-02-02 14:01] reboot
457 [2021-02-02 14:04] watch "systemctl status | grep State | head -1"
458 [2021-02-02 14:04] drbdadm primary maine
459 [2021-02-02 14:04] mount /var/lib/libvirt/maine
460 [2021-02-02 14:04] cd /etc/libvirt/qemu
461 [2021-02-02 14:04] for host in $(ls *xml | sed -e 's/.xml//g'| grep -v modele) ; do virsh start $host ; done
462 [2021-02-02 14:04] virsh list
</pre>
* procédure de redémarrage de coon :
<pre>
414 [2021-02-02 14:05] df | awk '/^\/dev/ {print $1}' | xargs -I {} sh -c 'echo {}; tune2fs -l {}' | awk '/^\/dev/ {print $1} /^Filesystem state/ {print $3, " ",$4}'
415 [2021-02-02 14:05] virsh list
416 [2021-02-02 14:05] cd /etc/libvirt/qemu
417 [2021-02-02 14:05] for host in $(ls *xml | sed -e 's/.xml//g') ; do virsh shutdown $host ; done; watch virsh list
418 [2021-02-02 14:07] umount /var/lib/libvirt/coon
419 [2021-02-02 14:07] drbdadm disconnect maine
420 [2021-02-02 14:07] drbdadm secondary coon
421 [2021-02-02 14:07] drbdadm disconnect coon
422 [2021-02-02 14:07] reboot
423 [2021-02-02 14:09] watch "systemctl status | grep State | head -1"
424 [2021-02-02 14:10] systemctl list-units
425 [2021-02-02 14:10] systemctl restart firehol.service
426 [2021-02-02 14:10] systemctl list-units
427 [2021-02-02 14:10] reboot
</pre>
* …