Seems like they are very popular with Twitter, so does Google crawl it as bit.ly/ or does it actually give the points to the actual stie?

depends if they work as an SEO friendly redirect

if the site does a 301 or.. an seo friendly redirect.. yeah.