← All questions
LLM FoundationsEasy· Model Training· Instruction Tuning

What is the difference between a base model and an inst...

Base models interpret any input as a document to be continued, reflecting their training on raw text. Instruct models are fine-tuned on structured instruction-response pairs, which teaches them to treat user input as a task to be completed. Despite the difference in behavior, the underlying model architecture remains the same; the behavioral shift is solely a result of the fine-tuning data.

Code playground (Python)