Category Archives: Uncategorized

Video Lecture: Twitter Recommendations by @alpa

Alpa Jain has great experience teaching from her time as a graduate student at Columbia University, and it shows in the clarity of her descriptions of SVD and other recommendation algorithms in today’s lecture: When I asked at the end … Continue reading

Posted in Uncategorized | 1 Comment

Lecture Notes: Fighting Spam At Twitter

On Thursday, Delip Rao electrified the class with a lecture on how Twitter combats the pervasive threat of tweet spam: (Lecture notes are not available.) UC Berkeley students are lucky to have gotten to hear @deliprao in person.  Thank you … Continue reading

Posted in Uncategorized | Comments Off on Lecture Notes: Fighting Spam At Twitter

Video Lecture: Big Learning with Graphs by Joey Gonzalez

For those of you who follow the latest developments in the Big Data technology stack, you’ll know that GraphLab is the hottest technology for processing huge graphs in fast time.  We got to hear the algorithms behind GraphLab 2 even … Continue reading

Posted in Uncategorized | 1 Comment

Video Lecture: Twitter Social Network by @aneeshs

Learn about weak ties, triadic closures, and personal pagerank, and how they all relate to the Twitter social graph from Aneesh Sharma: I especially enjoyed his fascinating and clear explanation of the Watts-Strogatz model, its link to Kleinberg’s model, and … Continue reading

Posted in Uncategorized | 1 Comment

Video Lecture: Splunk’s Software Architecture and GUI for Analyzing Twitter Data

Today we learned about an alternative software architecture for processing large data, getting the technical details from Splunk’s VP of Engineering, Stephen Sorkin. Splunk also has a really amazing GUI for analyzing Twitter and other data sources in real time; … Continue reading

Posted in Uncategorized | 1 Comment

Video Lecture: Real-Time Twitter Search by @larsonite

Brian Larson gives a brilliant technical talk about how real-time search works at Twitter; He really knows what he’s talking about given that he’s the tech lead for search and relevance at Twitter! Follow him @larsonite to learn more. Thanks, … Continue reading

Posted in Uncategorized | 1 Comment

Video Lecture: Kostas T. on How To Detect Twitter Trends

Have you ever wondered how Twitter computes its Trending Topics?  Kostas T. is one of the wizards behind that, and today he shared some of the secrets with our class: See his lecture notes.  Kostas, Rion and I are also … Continue reading

Posted in Uncategorized | 1 Comment

Slides Posted: Coding to the Twitter API

Today Rion Snow saved us huge amounts of time by giving us a primo introduction to the Twitter API.  We learned about both the RESTful API and the streaming API for both Java and Python. After this intro, it looks … Continue reading

Posted in Uncategorized | 1 Comment

Video Lecture: Jon Coveney (@jco) on Apache Pig

Jon Coveney gives an in-depth tutorial on Apache Pig, including how it interacts with Hadoop: His slides are a fantastic resource for learning much much more about Pig: (pdf) Thanks for a really illuminating lecture, Jon!

Posted in Uncategorized | Comments Off on Video Lecture: Jon Coveney (@jco) on Apache Pig

Video Lecture Posted: Intro to Hadoop

Bill Graham, who is active in the Hadoop community and a Pig contributor, gave a very clear and detailed intro to Hadoop and outlined how it is used at Twitter: His slides can be found here. Bill is a terrific instructor; … Continue reading

Posted in Uncategorized | 1 Comment