COBE 2016


Crowdsourcing and Online Behavioral Experiments, Workshop at WWW 2016, Montreal, 11-13 Apr 2016; Deadline 22 Dec

CALL FOR PAPERS: Fourth Annual Workshop on Crowdsourcing and Online Behavioral Experiments (COBE 2016), a workshop at WWW 2016, Montreal, Canada


The World Wide Web has resulted in new and unanticipated avenues for conducting large-scale behavioral experiments. Crowdsourcing sites like Amazon Mechanical Turk, CrowdFlower, Upwork, TaskRabbit, among others, have given researchers access to a large participant pool that operates around the clock. As a result, behavioral researchers in academia have turned to crowdsourcing sites in large numbers. Moreover, websites like eBay, Yelp and Reddit have become places where researchers can conduct field experiments. Companies like Microsoft, Facebook, Google and Yahoo! conduct hundreds of randomized experiments on a daily basis. We may be rapidly reaching a point where most behavioral experiments will be done online.

The main purpose of this workshop is to bring together researchers conducting behavioral experiments online to share new results, methods and best practices.


Submission Deadline: December 22, 2015
Notification Date: February 2, 2016
Workshop Date: TBA but between April 11 and 13th, 2016.
Cocktails: At the Bar

Location: Montreal, Canada. A workshop before the 25th International World Wide Web Conference:

which takes place April 11-15, 2016.


Topics of interest for the workshop include but are not limited to:

  • Crowdsourcing
  • Online behavioral experiments
  • Online field experiments
  • Online natural or quasi-experiments
  • Online surveys
  • Human Computation


Submit papers electronically by visiting

logging in or creating an account, and clicking New Submission at the top left. Submissions are non-archival, meaning contributors are free to publish their results subsequently in archival journals or conferences. There will be no published proceedings. Submissions should be up to two (2) pages of text, with an optional extra page for figures and references only. The submission deadline is December 22, 2015


  • Siddharth Suri, Microsoft Research NYC
  • Winter A. Mason, Facebook
  • Daniel G. Goldstein, Microsoft Research NYC


  • Alessandro Acquisti, Carnegie Mellon University
  • Pavel Atanasov, Polly Portfolio
  • Laura Brandimarte, Carnegie Mellon University
  • Jesse J. Chandler, Mathematica
  • Yiling Chen, Harvard University
  • Nicolas Della Penna, Australian National University
  • Dean Eckles, MIT Sloan School of Business
  • Alice Gao, University of British Columbia
  • Sam Gosling, University of Texas at Austin
  • John Horton, NYU Stern
  • Eric Johnson, Columbia University
  • Brian Keegan, Northeastern University
  • Peter Krafft, MIT
  • Andrew Mao, Microsoft Research
  • Akitaka Matsuo, Nuffield College
  • Gabriele Paolacci, Erasmus University Rotterdam
  • Eyal Pe’Er, Bar-Ilan University
  • Ragan Petrie, George Mason University
  • Alexander Peysakhovich, Facebook
  • David Rand, Yale Unviersity
  • David Rothschild, Microsoft Research
  • Sven Seuken, University of Zurich
  • Sean Taylor, Facebook
  • Florian Teschner, Karlsruhe Institute of Technology
  • Jennifer Wortman Vaughan, Microsoft Research
  • Jens Witkowski, University of Freiburg
  • Georgios Zervas, Boston University School of Management
  • Peter Zubcsek, University of Florida Warrington College of Business