Monthly Archives: September 2012
Learn about weak ties, triadic closures, and personal pagerank, and how they all relate to the Twitter social graph from Aneesh Sharma: I especially enjoyed his fascinating and clear explanation of the Watts-Strogatz model, its link to Kleinberg’s model, and … Continue reading
Today we learned about an alternative software architecture for processing large data, getting the technical details from Splunk’s VP of Engineering, Stephen Sorkin. Splunk also has a really amazing GUI for analyzing Twitter and other data sources in real time; … Continue reading
Brian Larson gives a brilliant technical talk about how real-time search works at Twitter; He really knows what he’s talking about given that he’s the tech lead for search and relevance at Twitter! Follow him @larsonite to learn more. Thanks, … Continue reading
Have you ever wondered how Twitter computes its Trending Topics? Kostas T. is one of the wizards behind that, and today he shared some of the secrets with our class: See his lecture notes. Kostas, Rion and I are also … Continue reading
Today Rion Snow saved us huge amounts of time by giving us a primo introduction to the Twitter API. We learned about both the RESTful API and the streaming API for both Java and Python. After this intro, it looks … Continue reading
Jon Coveney gives an in-depth tutorial on Apache Pig, including how it interacts with Hadoop: His slides are a fantastic resource for learning much much more about Pig: (pdf) Thanks for a really illuminating lecture, Jon!