Normal view MARC view ISBD view

Dark data: why what you don't know matters

By: Hand, David J.
Material type: materialTypeLabelBookPublisher: Princeton Princeton University Press 2020Description: xii, 330 p.; ill. Includes bibliographical references and index.ISBN: 9780691182377.Subject(s): Missing observations - Statistics | Big data | Dark dataDDC classification: 519.5 Summary: In the era of big data, it is easy to imagine that we have all the information we need to make good decisions. But in fact, the data we have are never complete and maybe only the tip of the iceberg. Just as much of the universe is composed of dark matter, invisible to us but nonetheless present, the universe of information is full of dark data that we overlook at our peril. In Dark Data, data expert David Hand takes us on a fascinating and enlightening journey into the world of the data we don’t see. Dark Data explores the many ways in which we can be blind to missing data and how that can lead us to conclusions and actions that are mistaken, dangerous, or even disastrous. Examining a wealth of real-life examples, from the Challenger shuttle explosion to complex financial frauds, Hand gives us a practical taxonomy of the types of dark data that exist and the situations in which they can arise, so that we can learn to recognize and control for them. In doing so, he teaches us not only to be alert to the problems presented by the things we don’t know but also shows how dark data can be used to our advantage, leading to greater understanding and better decisions. Today, we all make decisions using data. Dark Data shows us all how to reduce the risk of making bad ones. https://press.princeton.edu/books/hardcover/9780691182377/dark-data
Tags from this library: No tags from this library for this title. Log in to add tags.
    average rating: 0.0 (0 votes)
Item type Current location Item location Collection Call number Status Date due Barcode
Books Vikram Sarabhai Library
General Stacks
Slot 1412 (0 Floor, East Wing) Non-fiction 519.5 H2D2 (Browse shelf) Checked out 30/06/2020 201532

Table of Contents

pt. 1 DARK DATA: THEIR ORIGINS AND CONSEQUENCES

ch. 1 Dark Data: What We Don't See Shapes Our World
The Ghost of Data
So You Think You Have All the Data?
Nothing Happened, So We Ignored It
The Power of Dark Data
All around Us

ch. 2 Discovering Dark Data: What We Collect and What We Don't
Dark Data on All Sides
Data Exhaust, Selection, and Self-Selection
From the Few to the Many
Experimental Data
Beware Human Frailties

ch. 3 Definitions and Dark Data: What Do You Want to Know?
Different Definitions and Measuring the Wrong Thing
You Can't Measure Everything
Screening
Selection on the Basis of Past Performance

ch. 4 Unintentional Dark Data: Saying One Thing, Doing Another
The Big Picture
Summarizing
Human Error
Instrument Limitations
Linking Data Sets

ch. 5 Strategic Dark Data: Gaming, Feedback, and Information Asymmetry
Gaming
Feedback
Information Asymmetry
Contents note continued: Adverse Selection and Algorithms

ch. 6 Intentional Dark Data: Fraud and Deception
Fraud
Identity Theft and Internet Fraud
Personal Financial Fraud
Financial Market Fraud and Insider Trading
Insurance Fraud
And More

ch. 7 Science and Dark Data: The Nature of Discovery
The Nature of Science
If Only I'd Known That
Tripping over Dark Data
Dark Data and the Big Picture
Hiding the Facts
Retraction
Provenance and Trustworthiness: Who Told You That?

pt. II ILLUMINATING AND USING DARK DATA
ch. 8 Dealing with Dark Data: Shining a Light
Hope!
Linking Observed and Missing Data
Identifying the Missing Data Mechanism
Working with the Data We Have
Going Beyond the Data: What If You Die First?
Going Beyond the Data: Imputation
Iteration
Wrong Number!

ch. 9 Benefiting from Dark Data: Reframing the Question
Hiding Data
Hiding Data from Ourselves: Randomized Controlled Trials
Contents note continued: What Might Have Been
Replicated Data
Imaginary Data: The Bayesian Prior
Privacy and Confidentiality Preservation
Collecting Data in the Dark

ch. 10 Classifying Dark Data: A Route through the Maze
A Taxonomy of Dark Data.

In the era of big data, it is easy to imagine that we have all the information we need to make good decisions. But in fact, the data we have are never complete and maybe only the tip of the iceberg. Just as much of the universe is composed of dark matter, invisible to us but nonetheless present, the universe of information is full of dark data that we overlook at our peril. In Dark Data, data expert David Hand takes us on a fascinating and enlightening journey into the world of the data we don’t see.
Dark Data explores the many ways in which we can be blind to missing data and how that can lead us to conclusions and actions that are mistaken, dangerous, or even disastrous. Examining a wealth of real-life examples, from the Challenger shuttle explosion to complex financial frauds, Hand gives us a practical taxonomy of the types of dark data that exist and the situations in which they can arise, so that we can learn to recognize and control for them. In doing so, he teaches us not only to be alert to the problems presented by the things we don’t know but also shows how dark data can be used to our advantage, leading to greater understanding and better decisions.
Today, we all make decisions using data. Dark Data shows us all how to reduce the risk of making bad ones.

https://press.princeton.edu/books/hardcover/9780691182377/dark-data

There are no comments for this item.

Log in to your account to post a comment.

Powered by Koha