Add watch-pcs-and-etcd helper for monitoring cluster status

[clobrano]

The script continuously monitors both Pacemaker (PCS) status and etcd member list by automatically switching between available cluster nodes when connectivity issues occur.

It includes intelligent node discovery from inventory files or virsh.

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: clobrano

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [clobrano]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[dhensel-rh]

@clobrano A quick note. Since this is a shell script, could the file be named to include the .sh extension please ?

[clobrano]

@clobrano A quick note. Since this is a shell script, could the file be named to include the .sh extension please ?

Sure, no problem

[clobrano]

I need to review the check that makes the script switch to the next node

/hold

[clobrano]

I fixed the problem

/unhold

[clobrano]

The automatic nodes recognition via virsh is a bit flaky

/hold

[fonta-rh]

I was creating another PR when I saw this one, and I was thinking, @clobrano want me to add an Ansible version that uses the inventory to access the VMs? They're added automatically in TNT after cluster installation

[clobrano]

Let me update the script, in case I added any fix meanwhile, then yes, it could be helpful to use a playbook