Fossil first checks if ht e cert is valid and if it is not it does not take saved cert into account.

If you accept a cert which fossil thinks is invalid (which would be the reason to accept it manually in the first place) it does not look at it when validating the cert next time.