and if anyone's thinking it, the robots.txt file was originally without asterisks, i only added them after noticing it didn't like it. i also tried changing the order of allow/disallow (which canonically shouldn't matter) and twitter still thinks it's not allowed to load that url