ChatGPT was released on 30th November 2022. • 1 million users in 5 days • 100 million users in 2 months This made it the fastest-growing consumer application to date. Beating TikTok (9 months) and Instagram (2.5 years). ![[Pasted image 20230219144203.png]] [[ChatGPT]] is a type of [[Large Language Model - LLMs]] LLMs consume vast amounts of text and **identify connections between words** in the text. > The goal is to **generate predictions** about the likelihood of a word occurring in the text, given the context of the surrounding words. ChatGPT is a spinoff of InstructGPT. InstructGPT was released in January 2022 from OpenAI by fine-tuning GPT-3 to follow instructions using human feedback. This better aligns the model's output with user intent. There is a billion-dollar opportunity right now to f**ine-tune large language models and use human feedback.** Ref: [[Recurrent Neural Networks - RNNs]] [[Transformers]] [[Artificial Intelligence]] > Bigger models ≠ better outcomes. However training huge models is useful: https://www.youtube.com/watch?v=9P_VAMyb-7k&ab_channel=WeCNLP The number of parameters has: - 10x from GPT-1→GPT-2 - 100x from GPT-2→GPT-3 But model size doesn’t matter. It’s about having better data which leads to **better outcomes.** Fine-tuning with human feedback **helps align language models with human intent.** Ref: [[Parameters]]