Publications

2012

Probabilistically Bounded Staleness for Practical Partial Quorums
Peter Bailis, Shivaram Venkataraman, Michael Franklin, Joseph M. Hellerstein, Ion Stoica
38th International Conference on Very Large Databases (VLDB 2012), Aug. 2012.

Understanding TCP Incast and Its Implications for Big Data Workloads
Yanpei Chen, Rean Griffith, David Zats, Anthony Joseph, Randy Katz
USENIX ;login: Magazine, Jun. 2012.

Shark: Fast Data Analysis Using Coarse-grained Distributed Memory (demonstration paper)
Cliff Engle, Antonio Lupher, Reynold Xin, Matei Zaharia, Michael Franklin, Scott Shenker, Ion Stoica
ACM SIGMOD Conference, May. 2012.

Recurring Job Optimization in Scope (Industrial Track)
Nicolas Bruno, Sameer Agarwal, Srikanth Kandula, Bing Shi, Ming-Chuan Wu, Jingren Zhou
ACM SIGMOD Conference, May. 2012.

We Don’t Know Enough to make a Big Data Benchmark Suite – An Academia-Industry View
Yanpei Chen
Workshop on Big Data Benchmarking, May. 2012.

Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing
Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Murphy McCauley, Michael Franklin, Scott Shenker, Ion Stoica
NSDI 2012, Apr. 2012.

Re-optimizing Data Parallel Computing
Sameer Agarwal, Srikanth Kandula, Nicolas Bruno, Ming-Chuan Wu, Ion Stoica, Jingren Zhou
9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 2012), Apr. 2012.

PACMan: Coordinated Memory Caching for Parallel Jobs
Ganesh Anantharayanan, Ali Ghodsi, Andrew Wang, Dhruba Borthakur, Srikanth Kandula, Scott Shenker, Ion Stoica
USENIX NSDI, Apr. 2012.

Energy Efficiency for Large-Scale MapReduce Workloads with Significant Interactive Analysis
Yanpei Chen, Sara Alspaugh, Dhruba Borthakur, Randy Katz
European Conference on Computer Systems (EuroSys) 2012, Apr. 2012.

Experiences Teaching MapReduce in the Cloud
Ariel Rabkin, Charles Reiss, Randy Katz, David Patterson
SIGCSE, Mar. 2012.

Combinatorial Clustering and the Beta Negative Binomial Process
Tamara Broderick, Lester Mackey, John Paisley, Michael Jordan
arXiv, Feb. 2012.

Matrix Concentration Inequalities via the Method of Exchangeable Pairs
Lester Mackey, Michael Jordan, Richard Y. Chen, Brendan Farrell, Joel A. Tropp
arXiv, Jan. 2012.

Divide-and-Conquer Matrix Factorization
Lester Mackey, Ameet Talwalkar, Michael Jordan
Neural Information Processing Systems (NIPS), Jan. 2012.

Tags: big data

Bayesian Bias Mitigation for Crowdsourcing
Fabian Wauthier, Michael Jordan
Neural Information Processing Systems (NIPS), Jan. 2012.

Distributed Delayed Stochastic Optimization
John Duchi, Alekh Agarwal
NIPS, Jan. 2012.

2011

A Scalable Bootstrap for Massive Data
Ariel Kleiner, Ameet Talwalkar, Purna Sarkar, Michael Jordan
arXiv, Dec. 2011.

Tags: big data

Challenges and Opportunities for Managing Data Systems Using Statistical Models
Yanpei Chen, Archana Ganapathi, Randy Katz
IEEE Data Engineering Bulletin, Dec. 2011.

Faster and More Accurate Sequence Alignment with SNAP
Matei Zaharia, William J. Bolosky, Kristal Curtis, Armando Fox, David Patterson, Scott Shenker, Ion Stoica, Richard M. Karp, Taylor Sittler
arXiv technical report 1111.5572v1, Nov. 2011.

Precomputing Possible Configuration Error Diagnoses
Ariel Rabkin, Randy Katz
IEEE/ACM Automated Software Engineering (ASE), Nov. 2011.

PIQL: Success-Tolerant Query Processing in the Cloud
Michael Armbrust, Kristal Curtis, Tim Kraska, Armando Fox, Michael Franklin, David Patterson
Proceedings of the VLDB Endowment 2012, Vol. 5, No. 3, pp 181-192, Nov. 2011.

Tags: PIQL, SCADS, scale independence

Improving Per-Node Efficiency in the Datacenter with New OS Abstractions
Barret Rhoden, Kevin Klues, David (Yu) Zhu, Eric Brewer
Symposium on Cloud Computing (SOCC '11), Oct. 2011.

Tags: Akaros, Datacenters, OS

Scaling the Mobile Millennium System in the Cloud
Timothy Hunter, Teodor Moldovan, Matei Zaharia, Justin Ma, Michael Franklin, Pieter Abbeel, Alexandre Bayen
Symposium on Cloud Computing (SOCC '11), Oct. 2011.

Design Implications for Enterprise Storage Systems via Multi-Dimensional Trace Analysis.
Yanpei Chen, Kiran Srinivasan, Garth Goodson, Randy Katz
SOSP 2011, Sep. 2011.

Crowdsourcing Applications and Platforms: A Data Management Perspective (Tutorial)
AnHai Doan, Michael Franklin, Donald Kossmann, Tim Kraska
VLDB 2011, Sep. 2011.

CrowdDB: Query Processing with the VLDB Crowd (demonstration paper)
Amber Feng, Michael Franklin, Donald Kossmann, Tim Kraska, Sam Madden, Sukriti Ramesh, Andrew Wang, Reynold Xin
VLDB 2011, Aug. 2011.

Managing Data Transfers in Computer Clusters with Orchestra
Mosharaf Chowdhury, Matei Zaharia, Justin Ma, Michael Jordan, Ion Stoica
SIGCOMM 2011, Aug. 2011.

Do You Know Where Your Data Are? Secure Data Capsules for Deployable Data Protection
Petros Maniatis, Devdatta Akhawe, Kevin Fall, Elaine Shi, Stephen McCamant, Dawn Song
Workshop on Hot Topics in Operating Systems (HotOS), Aug. 2011.

The Datacenter Needs an Operating System
Matei Zaharia, Ben Hindman, Andy Konwinski, Ali Ghodsi, Anthony Joseph, Randy Katz, Scott Shenker, Ion Stoica
HotCloud 2011, Aug. 2011.

Privacy-Preserving Aggregation of Time-Series Data
Elaine Shi, T-H. Hubert Chan, Eleanor Rieffel, Richard Chow, Dawn Song
NDSS Symposium 2011, Aug. 2011.

The Case for Evaluating MapReduce Performance Using Workload Suites
Yanpei Chen, Archana Ganapathi (Splunk), Rean Griffith (VMware), Randy Katz
19th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS) 2011, Jul. 2011.

Ergodic Subgradient Descent
John Duchi, Alekh Agarwal, Mikael Johansson, Michael Jordan
Allerton Conference on Communication, Control, and Computing, Jul. 2011.

ES-TeV: Efficient and Secure Threshold-based Event Validation for VANETs
Hsu-Chun Hsiao, Ahren Studer, Rituik Dubey, Elaine Shi, Adrian Perrig
ACM Conference on Wireless Network Security (WiSec), Jun. 2011.

Exploiting Heterogeneity in the Public Cloud for Cost-Effective Data Analytics
Gunho Lee, Byung-Gon Chun, Randy Katz
3rd Workshop on Hot Topics in Cloud Computing, Jun. 2011.

CrowdDB: Answering Queries with Crowdsourcing
Michael Franklin, Donald Kossmann, Tim Kraska, Sukriti Ramesh, Reynold Xin
ACM SIGMOD Conference, Jun. 2011.

Hybrid In-Database Inference for Declarative Information Extraction
Daisy Zhe Wang, Michael Franklin, Minos Garofalakis, Joseph Hellerstein, Michael Wick
ACM SIGMOD Conference, Jun. 2011.

Static Extraction of Program Configuration Options
Ariel Rabkin, Randy Katz
33rd International Conference on Software Engineering (ICSE 2011), May. 2011.

Disk-Locality in Datacenter Computing Considered Irrelevant
Ganesh Anantharayanan, Ali Ghodsi, Scott Shenker, Ion Stoica
USENIX HotOS, May. 2011.

Design and Evaluation of a Real-Time URL Spam Filtering Service
Kurt Thomas, Chris Grier, Justin Ma, Vern Paxson, Dawn Song
IEEE Symposium on Security and Privacy, May. 2011.

Scarlett: Coping with Skewed Popularity Content in MapReduce Clusters
Ganesh Anantharayanan, Sameer Agarwal, Srikanth Kandula, Albert Greenberg, Ion Stoica, Duke Harlan, Ed Harris
ACM EuroSys 2011, Apr. 2011.

Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center
Ben Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony Joseph, Randy Katz, Scott Shenker, Ion Stoica
NSDI 2011, Mar. 2011.

Dominant Resource Fairness: Fair Allocation of Multiple Resources Types
Ali Ghodsi, Matei Zaharia, Ben Hindman, Andy Konwinski, Scott Shenker, Ion Stoica
NSDI 2011, Mar. 2011.

Privacy Settings in Context: A Case Study using Google Buzz
Daisuke Mashima, Elaine Shi, Prateek Sarkar, Richard Chow, Chris Li, Dawn Song
IEEE International Workshop on SEcurity and SOCial Networking (SESOC), Mar. 2011.

Link Prediction by De-anonymization: How We Won the Kaggle Social Network Challenge
Elaine Shi, Arvind Narayanan, Benjamin I.P. Rubenstein
International Joint Conference on Neural Networks (IJCNN), Feb. 2011.

The SCADS Director: Scaling a Distributed Storage System Under Stringent Performance Requirements
Beth Trushkowsky, Peter Bodik, Armando Fox, Michael Franklin, Michael Jordan, David Patterson
9th USENIX Conference on File and Storage Technologies, Feb. 2011.

Topology-Aware Resource Allocation for Data-Intensive Workloads
Gunho Lee, Niraj Tolia, Parthasarathy Ranganathan, Randy Katz
ACM SIGCOMM Computer Communication Review, V. 41, N. 1, pp. 120-124, Jan. 2011.

2010

Reining in the Outliers in MapReduce Clusters using Mantri
Ganesh Anantharayanan, Srikanth Kandula, Albert Greenberg, Ion Stoica, Yi Lu, Bikas Saha, Ed Harris
USENIX OSDI, Oct. 2010.

Spark: Cluster Computing with Working Sets
Matei Zaharia, Mosharaf Chowdhury, Michael Franklin, Scott Shenker, Ion Stoica
HotCloud 2010, Jun. 2010.

Mixed Membership Matrix Factorization
Lester Mackey, David Weiss, Michael Jordan
International Conference on Machine Learning, Jun. 2010.

2009

Blue-Fi: Enhancing Wi-Fi Performance using Bluetooth Signals
Ganesh Anantharayanan, Ion Stoica
ACM MobiSys, Jun. 2009.

A Common Substrate for Cluster Computing
Ben Hindman, Andy Konwinski, Matei Zaharia, Ion Stoica
HotCloud, Mar. 2009.

2008

Greening the Switch
Ganesh Anantharayanan, Randy Katz
USENIX HotPower, Dec. 2008.

Improving MapReduce Performance in Heterogeneous Environments
Matei Zaharia, Andy Konwinski, Anthony Joseph, Randy Katz, Ion Stoica
OSDI, Dec. 2008.

Chukwa: A large-scale monitoring system
Jerome Boulon, Andy Konwinski, Runping Qi, Ariel Rabkin, Eric Yang, Mac Yang
Cloud Computing and its Applications (CCA ’08), Oct. 2008.

Above the Clouds: A berkeley view of Cloud Computing
UC Berkeley Technical Report,