But what about the census data?

The census data is available in a lot of ways. Google will lead you easily to raw numbers and city web sites. This one will provide you with the census data for a particular neighborhood based on a property's address. Geocoding is what they call it.

http://www.ffiec.gov/Geocode/default.aspx

Minneapolis Neighborhood Services is pretty awesome for helping to find some of these materials.