Do I HAVE to give this guy his money back?

Sorry Chief, all I can think of are principles, morals, and ethics. Maybe I would look up his parents and send a cashier's check to them with a note. Maybe. This is something only you can do.