Introduction

To set the right tone for 2024, we decided to start with hallucinations 😉 

With the rise of interest in foundation models (FMs) that are extraordinarily impressive at producing data across various modalities – text, images, video, and audio – another phenomenon has appeared: Hallucinations. Though the term anthropomorphizes the algorithms, it has become widely accepted in both the business and academic sectors.

In this article, we want to understand what causes them and how to deal with them, as well as provide you with some ideas on how hallucinations can be beneficial. Let's immerse ourselves in our first deep dive of this interesting year!

As most research and literature on hallucinations currently focus on text-based models – Large Language Models aka LLMs – we also center our article around this subset of foundation models.

Defining Hallucinations: What exactly are hallucinations in the context of foundation models?

In LLMs models, "hallucination" refers to instances where the model generates content that isn't based on real or accurate information. This can happen when a model produces text with details, facts, or claims that are fictional, misleading, or completely made up, instead of giving reliable and truthful information.

Hallucination cases in LLMs can be broken down into the following categories:

That’s a fun video to watch:

Thank you for reading, please feel free to share with your friends and colleagues. In the next couple of weeks, we are announcing our referral program 🤍

Previously in the FM/LLM series: