Страница 1 из 1

Idle Thoughts of an Idle Fellow

Добавлено: 17 окт 2015, 17:09
Groundhog
Задумалси читая измышления мерзких программистов пытающихся улучшить матрицу в которой мы обитаем:
Итак режу/клею для краткости из одного поста:
....
Among other things he mentioned that the bail system in US is broken in that it keeps of rich out of pre-trial incarceration while keeping the poor in. He goes on explaining that they've built a data model that predicts who is safe to let out and who is not. That way the money is kept out of the process.
....
let's assume that the software ... used by the local judge, is based on machine learning. Specifically, neural networks.
....
However, imagine someone collects the outputs from the machine and after a while realises that most of people ordered to be stay in jail are black. The white people, on the other hand, are mostly released. The damned box is a racist!
But the designers of the neural network certainly haven't put any prejudice against black people into the system! They've just assembled some neuron-like components into a mesh and that's it. Also, we have no way to find out what the neural network "thinks". There's no way to say whether it's driven by the colour of the skin or by some other, unknown, factors.