🤖 How does an AI chatbot write? Sample
It builds every answer one small piece at a time.
The mystery
An AI chatbot can write a poem, explain physics and fix code in seconds. Does it look the answers up somewhere?
The answer
A language model does not search a stored answer. It was trained on a huge amount of text and learned patterns, and while writing it repeatedly predicts the most fitting next small piece of text (a token) given everything before it.
Now think about this
If AI predicts the next word so well, is that the same as understanding — or something different?
