Contradict the Machine

Contradict the Machine is a hybrid approach for discovering the unknown unknowns of a black-box predictive model. It combines an algorithmic strategy for discovering unknown unknown candidates in a test set, with a crowdsourcing task in which humans can easily construct candidates.