Unable to access the PMK UI due to sunpike-kine issues

Problem

• PMK UI is failing and getting stuck on Loading region data.
• Not able to access the PMK clusters and hosts through UI.

Environment

• Platform9 Managed Kubernetes - All Versions

Cause

• The connection to MySQL (RDS) gets blocked due to connection errors observed by the Sunpike Kine service.
• This is observed when there are frequent errors observed when clients try to connect to MySQL.

time="[Timestamp]" level=fatal msg="building kine: Error 1129: Host '[IP]' is blocked because of many connection errors; unblock with 'mysqladmin flush-hosts'"

Resolution

• Manually execute _**mysqladmin flush-hosts**_ command to unblock the connection from Sunpike to MySQL.
• This is a known issue and is being tracked via JIRA internally.