Thanks for bringing up the issue of black box models.
The challenge of black box analytics is a real one. Without business owner commitment it is hard to get models adopted, no matter how predictive they are. Explicability, an appreciation of the business inputs, use of best-to-worst deciles, the ability to simulate the impact of a model - all these are important tools for letting business people get comfortable enough to adopt a model.
The only results that matter are business results. Data miners who produce really predictive models that don't get adopted have failed just as badly as those who cannot produce a predictive model. We are not done when we have a "black box" model but when we have persuaded the business to adopt the model and change their decision-making.