The limitations, risks, and challenges of adopting generative AI
As powerful as generative AI technology is, it comes with its own set of limitations and challenges across multiple dimensions. In this section, we will delve into some of these concerns.
As most generative AI technologies such as LLMs generate responses based on conditioned probabilities, the outputs can be factually inaccurate or self-contradictory. They can even generate factually inaccurate responses with fluency and convincing tones, leading to difficulty in detecting misinformation by humans. This can create a multitude of problems, including erroneous decision making and negative social influence from misinformation. Moreover, it’s challenging to determine the source documents for the responses generated by generative AI models, which leads to difficulties in verifying facts and providing proper attribution.
Despite their impressive performance on standardized tests like BAR or SAT, LLMs have limitations...
