Herdict

From Berkman Klein Google Summer of Code Wiki
Revision as of 14:02, 6 March 2012 by WikiSysop (talk | contribs) (New page: First, we are looking for someone who can help us create a program that will scour a microblogging site, like twitter, and identify when someone might be saying that a site that is down or...)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

First, we are looking for someone who can help us create a program that will scour a microblogging site, like twitter, and identify when someone might be saying that a site that is down or blocked. So something that would constantly look for things like URL within 3 words of "blocked" "censored" "inaccessible" "i can't get to" etc. We'd be looking for something north of 75% accuracy, but not perfection. Bonus points if we can do it for Sina Weibo instead of Twitter, but that will require some language skills.

Second, we are looking to make some changes to our downloadable toolbar. In particular, we want to automate the detection of blocked sites. When a browser throws a 504 error, we want the toolbar to catch it, and then report it. In addition, we have known blocking patterns from ONI, and we want the toolbar to be able to identify a match with a known blocking pattern and report that as a inaccessible page as well.