Generally flipping background and signal data does not work But you can remove the trivial difference from your data Then networks become invertible