Endermen ask for consent before being aggroed if you look at them.

Works server-side only. Endermen will ask the target player with a dialog for consent to become aggro.

Also check out Consent Creepers.