Skip to main content

zCenter Upgrade Procedure for High Availabilty (HA) Configuration

When upgrading zCenter appliances deployed in High Availability configuration, care must be taken to follow the sequence such that HA Failover is not triggered, and service downtime is minimized.

Requirements:

  • Access to zCenter admin portal as Service Admin 

  • SSH access to both servers with sudo privileges

  • zCLI enable password to both zCenters

  • Downloadable packages (https/sftp/scp) accessible by active and standby server for both (zgwd and zcli)

  • yum repository access for OS patching

Procedure:

  1. Login to zCenter portal

    • Verify Service domain name and version (verify version is lower than upgrade version

      • Advanced Management --> click on Zentera logo (may be private branded)

    • Verify HA status

      • Advanced Management --> Service Management --> HA Status

        • HA Status = Active

        • Counterpart IP = {standby server ip address}

        • Master DB Log File Position = Slave DB Log File Position

        • Seconds Behind Master = 0

    • Verify and/or notify nobody is logged into zCenter and Launcher

      • Advanced Management --> Portal Management --> Current Login Sessions

      • Advanced Management --> Project Management --> Current CoIP User Login Sessions

  2. Login to both servers and enter service controller section of zCLI

    • SSH to server

    • Always use screen to perform upgrade (in case of SSH session loss)

      • echo "termcapinfo xterm* ti@:te@" > ~/.screenrc

      • screen

    • sudo su ztu (to enter zcli)

    • zCLI@{server name}> enable (requires zcli enable password)

    • zCLI@{server name}# service

    • zCLI@{server name}(service)# controller

    • zCLI@{server name}(service-zgw)# show swversion (verify is older version than upgrade version)

      Network Switch Version: {switch version}
Web Portal Version: {ZGW current version}
zCLI Version: {zCLI current version}

    • zCLI@{server name}(service-zgw)# service status

      • If after upgrade and reboot you do not get the proper response try (sudo pkill keepalived && sudo systemctl start keepalived)

      • Active server response

        keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... Running
Checking zns ... Running

      • Standby server response

        keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... ZGW service not running
Checking zns ... Service is not running

    • zCLI@{server name}(service-zgw)# ha show

      • Active server response

        This system configured as ACTIVE server is in ACTIVE state now
Service IP: {active server IP address}
Peer IP: {standby server IP address}
Router ID: 241
Interface: em1

      • Standby server response

        This system configured as STANDBY server is in STANDBY state now
Service IP: {standby server IP address}
Peer IP: {active server IP address}
Router ID: 241
Interface: em1

  3. Pause HA on standby server

    • zCLI@{server name}(service-zgw)# ha pause (type "yes" when asked)

    • zCLI@{server name}(service-zgw)# service status

      keepalived is inactive and dead...
Checking MySQL... Running
Checking ZGW service... ZGW service not running
Checking zns ... Service is not running

    • zCLI@{server name}(service-zgw)# ha show

      This system configured as STANDBY server is in PAUSE state now.

  4. Upgrade active server

    1. Upgrade Zentera software

      • zCLI@{server name}(service-zgw)# upgrade download <zCLI upgrade download location> (if upgrading)

      • zCLI@{server name}(service-zgw)# upgrade download <ZGW upgrade download location>

      • zCLI@{server name}(service-zgw)# upgrade list (verify upgrade version and copy file name)

      • zCLI@{server name}(service-zgw)# upgrade deploy cli <zCLI upgrade file name> (if upgrading)

        Check response for errors

      • Restart zCLI if needed

      • zCLI@{server name}(service-zgw)# upgrade deploy gw <ZGW upgrade file name>

        Check response for errors

      • zCLI@{server name}(service-zgw)# show swversion (verify upgrade version as expected)

        Switch Version: {switch version}
Web Portal Version: {ZGW upgrade version}
zCLI Version: {zCLI upgrade version}

      • zCLI@{server name}(service-zgw)# service status

        • HA active server response

          keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... Running
Checking zns ... Running

        • HA standby server response

          keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... ZGW service not running
Checking zns ... Service is not running

    2. Upgrade yum packages

      • Exit to bash (input "top" then "exit" then "exit")

      • sudo yum update

      • sudo yum clean all

      • sudo rm -rf /var/cache/yum

      • Reboot server

        • Standby server (standby server must disable keepalived and zgwd before first reboot after upgrade, then re-enable after restart)

          • Log into standby server

          • sudo systemctl stop keepalived

          • sudo systemctl disable keepalived

          • sudo systemctl disable zgwd

          • sudo reboot now

          • sudo systemctl enable zgwd

          • sudo systemctl enable keepalived

          • sudo systemctl start keepalived

        • Active server

          • sudo reboot now

  5. Verify service status of upgraded server

    • zCLI@{server name}(service-zgw)# service status

      • Active server response

        keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... Running
Checking zns ... Running

      • Standby server response

        keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... ZGW service not running
Checking zns ... Service is not running

  6. Verify HA status of upgraded server

    • zCLI@{server name}(service-zgw)# ha show

      • Active server response

        This system configured as ACTIVE server is in ACTIVE state now
Service IP: {active server IP address}
Peer IP: {standby server IP address}
Router ID: 241
Interface: em1

      • Standby server response

        This system configured as STANDBY server is in PAUSE state now.

  7. Resume HA on standby server

    • zCLI@{server name}(service-zgw)# ha resume

    • zCLI@{server name}(service-zgw)# service status

      keepalived (pid {pid of service}) is active and running...
Checking MySQL... Running
Checking ZGW service... ZGW service not running
Checking zns ... Service is not running

    • zCLI@{server name}(service-zgw)# ha show

      This system configured as STANDBY server is in STANDBY state now
Service IP: {standby server IP address}
Peer IP: {active server IP address}
Router ID: 241
Interface: em1

  8. Upgrade standby server (use procedures from steps 4, 5, 6)

  9. Redo step 2 to verify all services are up and operational with new version

  10. Redo step 1 to verify zCenter is up and operational with new version

 

Related articles

Comments

0 comments

Please sign in to leave a comment.