Training builds the model once; inference happens every time someone sends a prompt. Most AI costs for users are inference costs.
15
Beginner
In
Inference
Core Concepts
Inference
Running a trained model to get an answer.
Running a trained model to get an answer.
Training builds the model once; inference happens every time someone sends a prompt. Most AI costs for users are inference costs.