HumL 2018, the first international workshop on Augmenting Intelligence with Humans­-in-­the-­Loop
co-located with TheWebConf (WWW2018)
Deadline for contributions: 2 February 2018 (extended)
Workshop date: 24 April 2018
EasyChair: select "WWW2018Satellites", then "Augmenting Intelligence with Humans-in-the-Loop Workshop"

Human­-in-­the-­loop is a model of interaction where a machine process and one or more humans have an iterative interaction. In this paradigm the user has the ability to heavily influence the outcome of the process by providing feedback to the system as well as the opportunity to grab different perspectives about the underlying domain and understand the step by step machine process leading to a certain outcome. Amongst the current major concerns in Artificial Intelligence research are being able to explain and understand the results as well as avoiding bias in the underlying data that might lead to unfair or unethical conclusions. Typically, computers are fast and accurate in processing vast amounts of data. People, however, are creative and bring in their perspectives and interpretation power. Bringing humans and machines together creates a natural symbiosis for accurate interpretation of data at scale. The goal of this workshop is to bring together researchers and practitioners in various areas of AI (i.e., Machine Learning, NLP, Computational Advertising, etc.) to explore new pathways of the human­in­the­loop paradigm.

Call for Contributions


  • Human Factors:
    • Human­computer cooperative work
    • Mobile crowdsourcing applications
    • Human Factors in Crowdsourcing
    • Social computing
    • Ethics of Crowdsourcing
    • Gamification techniques
  • Data Collection:
    • Data annotations task design
    • Data collection for specific domains (e.g. with privacy constraints)
    • Data privacy
    • Multi­linguality aspects
  • Machine Learning:
    • Dealing with sparse and noisy annotated data
    • Crowdsourcing for Active Learning
    • Statistics and learning theory
  • Applications:
    • Healthcare
    • NLP technologies
    • Translation
    • Data quality control
    • Sentiment analysis

The proceedings of the workshop will be published online (open access) and through ACM Digital Library, as a companion volume of The Web Conf.
Papers must be submitted in PDF according to the new ACM format published in ACM guidelines, selecting the generic “sigconf” sample. Submissions should not exceed 8 pages including any diagrams or appendices and references. The PDF files must have all non-standard fonts embedded. Submissions must be self-contained and in English.
Please submit your contributions to EasyChair and select "Augmenting Intelligence with Humans-in-the-Loop Workshop".

Important Dates

All dates are 23:59 Hawaii Time
  • Abstract submission: 19 January 2018 23 January 2018
  • Paper submission deadline: 26 January 2018 2 February 2018
  • Author notification: 19 February 2018
  • Early-bird registrations deadline: 21 February 2018
  • Final version deadline: 4 March 2018
  • Workshop date: 24 April 2018


To be announced.


Lora Aroyo VU University Amsterdam

Gianluca Demartini STLab, University of Queensland

Anna Lisa Gentile IBM Research Almaden

Chris Welty Google

Program Committee (to be completed)

  • Michele Catasta, Stanford
  • Irene Celino, CEFRIEL
  • Alessandro Checco, University of Sheffield
  • Philippe Cudre-Mauroux, University of Fribourg
  • Djellel E. Difallah, NYU Center for Data Science
  • Anca Dumitrache, VU University Amsterdam
  • Oana Inel, VU University Amsterdam
  • Ujwal Gadiraju, L3S Research Center
  • Daniel F. Gruhl, IBM Research
  • Marta Sabou, Vienna University of Technology
  • Cristina Sarasua, University of Zurich
  • Maja Vukovic, IBM Research

Contact Us