SAML logons fail on replicated Storefront Server

SAML enabled logons via Storefront configured and working on one SF3.0 server. When trying to setup a second one and after joining it to the server group we get "cannot log on using smart card". If we uninstall SF from that server and reinstall and configure it manually do not add it to the serve...