Wow. What a story! While I agree with you about not wanting to believe the best in people (I am the same), I think I'd have stopped handing him money after the first $1500 and his disappearing act. It was incredibly generous of you and your husband to give him the benefit of the doubt beyond that.
I learned a long time ago that you can't help anyone who refuses to help himself but sometimes it has taken me a while to understand that's what they were doing.
I hope you find someone GOOD and responsible to build your wall ASAP! Thanks for sharing your experience.