Synthesis Lectures on Artificial Intelligence and Machine Learning: Eliciting Truthful Information

Faltings, Boi; Radanovic, Goran

Intelligent systems often depend on data provided by information agents, for example, sensor data or crowdsourced human computation. Providing accurate and relevant data requires costly effort that agents may not always be willing to provide. Thus, it becomes important not only to verify the correctness of data, but also to provide incentives so that agents that provide high-quality data are rewarded while those that do not are discouraged by low rewards.

We cover different settings and the assumptions they admit, including sensing, human computation, peer grading, reviews, and predictions. We survey different incentive mechanisms, including proper scoring rules, prediction markets and peer prediction, Bayesian Truth Serum, Peer Truth Serum, Correlated Agreement, and the settings where each of them would be suitable. As an alternative, we also consider reputation mechanisms. We complement the game-theoretic analysis with practical examples of applications in prediction platforms, community sensing, and peer grading.

Details

Published by: Springer

Publication Date: 2017-09-19

Format: Paperback

ISBN-13: 9783031004490

DOI: 10.1007/978-3-031-01577-9

Dimensions: 235cm x191cm

Pages: 135