It fixed part of it. Turns out that was not the extent of the issue. We noticed that file uploads were still failing. The actual root cause was that our bucket name contained a dot in it. This AWS forum post pointed us in the right direction:

That fixed it. Time to figure out what happened to the certs on this box.

I confirmed that disabling $useSSLValidation does work but I would prefer not to do that.