As part of the Obama administration's effort to promote transparency and openness, HUD recently added the overall Physical Inspection Scores to the HUD USER website. Available results are for inspections conducted from 2001 through September 2009....
I haven't looked at this closely, but this should be an interesting project for someone. It's been years since I've worked with data sets like this, so I'm hoping to find someone willing to tackle this before I try to fiddle with it. Be aware the entire United States and terrorities are included in the data sets so you'll have to hunt for information if you're interested in finding something.
Unfortunately, this doesn't seem to give many details other than the score; they don't seem to say why the site received the score they did.