Knight: How do you know he's a secret agent?
Peasant: He looks like one!
It would seem to me that the logical way to dress as a Secret Agent is in a way that nobody would expect a Secret Agent to dress. Then people will be on the look out for a normally dressed person and no body would suspect the person dressed as a Secret Agent; as Secret Agents never actually dress as such.