Only show mismatch if there were expected results to begin with

Only show mismatch if there were expected results to begin with #3082