Spark Meetup: Shark in Yahoo’s Advertising Data Platforms (Sunnyvale), Tu 8/27, 6:30p

8/27/13 6:30 pm - 8:30 pm

The next Spark user meetup features Yahoo! talking about their use of BDAS technologies started in the AMPLab.

RSVP Requried: More information at http://www.meetup.com/spark-users/events/134582432/

In Yahoo!’s advertising and data platforms, we instrument and mine vast amounts of data to come up with insights into advertising effectiveness, and measure and improve the effectiveness of advertising reach. Over the last couple of quarters we have been prototyping Shark for some of the use cases and enhancing Shark to work effectively with our datasets.

In this talk, we first discuss some of our contributions to the Spark and Shark open source ecosystem, including an in-memory columnar compression module, followed by what we are planning down the road. We then discuss some of our use cases that involve advanced algorithms and how we implement these algorithms on top of Spark and Shark to provide interactive, insightful analytics to our data scientists.