Acronis Backup: backup fails with "Could not connect"

Symptoms

Backup or replication to Cloud Storage fails with the following error:

Could not connect: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond