Could not add card "/usr/local/opt/opensc/lib/pkcs11/opensc-pkcs11.so": agent refused operation
For the lack of a proper diagnostic, run pkill ssh-agent and physically remove and re-enter the Yubikey.
pkill ssh-agent