The panhandler because he's not holding himself up to a higher standard.
Businesses: Street people are notorious for shoplifting and leaving needles in restrooms, stairwells and urinating and defecating in doorways, etc.
Society at large: Because the culture mores' and laws aren't holding individuals up to a higher standard (being self sufficient).