Sign problem of the fermionic shadow wave function