Hadoop World 2011: Leveraging Big Data in the Fight Against Spam and Other Security Threats


Wednesday, November 9th, 2011


In 2004, Bill Gates told a select group of participants in the World Economic Forum that “two years from now, the spam issue will be solved.” Eight years later, the spam problem is only getting worse, with no sign of relief. Big Data technologies such as Hadoop, MapReduce, Cassandra, and real-time stream processing can be leveraged to develop new approaches to fight spam, phishing, and other email-borne threats more effectively than ever before. This session will focus on the development of radical new “spam anomalytics” techniques whereby billions of messages and message-related events are analyzed daily to find statistical norms- and identify deviations from those norms- in order to better detect and defend against email threats as they emerge.

Next Steps

Presentation Video