From Scale to Capability Scaling Laws and Emergence
As large language models grow, so do their parameter counts, training data, and compute budgets. Performance generally improves with them. But saying that “bigger models are stronger” only describes the outcome. It does not explain whether the improvement follows a stable pattern, or how a fixed compute budget should be divided between model size and data. Scaling Law sdescribe the relationship between scale and loss. Emergent Abilities focus on a different layer of behavior: average loss may decrease smoothly, while performance on a specific task can rise sharply within a relatively narrow range of model scales. Together, they address two closely related questions: how large models improve as they scale, and why some capabilities appear to emerge suddenly.


