Back to Glossary
Inference
推論(すいろん)
IntermediateCore Concepts
The process of using a trained AI model to make predictions or generate outputs on new data.
Why It Matters
Inference speed and cost determine how practical and affordable it is to deploy AI in production applications.
Example in Practice
Every time you send a message to ChatGPT, the model runs inference to generate a response.