Cons of using AI

Using Artificial Intelligence solutions can create three risks.

Firstly, the machines may have hidden biases due to the data provided for training. For instance, if a system learns which job applicants to accept for an interview by using a data set of decisions made by human recruiters in the past, it may inadvertently learn to perpetuate their racial, gender, ethnic, or other biases. These biases are hard to detect as they won’t appear explicitly, but rather be embedded in the solution where other factors are considered.

The second risk is that, unlike traditional software engineered systems built on explicit logic rules, neural network systems deal with statistical truths rather than literal truths. Thus it much harder or sometimes impossible to prove that the system will work in all cases — especially in situations that weren’t represented in the training data. Lack of verifiability can be a concern in critical applications, such as controlling...