Studies have shown that negative schematic face targets embedded among neutral distractors are found faster and/or more efficiently compared to positive faces, supporting the hypothesis that emotional faces are processed automatically, and may guide allocation of attention. This effect should be disrupted when faces are inverted; however, this has not been consistently demonstrated. The present study investigated this inconsistency and examined whether a perceptual confound might explain previous findings. Experiments 1 and 2 replicated the speed advantage for negative emotion for upright and inverted negative faces. Critically, Experiment 3 showed the advantage persisted when faces were scrambled, but a salient perceptual characteristic remained. This suggested that the negative search advantage was due to a perceptual, not emotional, cause. The results suggest that visual search using schematic emotional face stimuli may not be a valid test of the relationship between automatic facial emotion processing and attention, and cast doubt on previous findings with this paradigm.