This mod makes it so if you hit a villager with an empty hand it will not damage the villager and make it upset.

There's also an option to only damage villagers when holding a tool, empty hands and any other item will not damage the villager.

Great for those who have bad trackpads which randomly left click when used.

Discord