Data/ML/AI
Model Training vs Inference
Training is the process of teaching a model from data; inference is using the already-trained model to make a prediction on new input.
Think of it like
Training is sending a student to years of school; inference is that same person, now on the job, answering questions using what they learned — no more studying required.
Junior or senior?
Junior sounds like
Mixes up training and inference.
Senior sounds like
Clearly distinguishes them and can describe what's different about the infrastructure each needs.
Ask them
“What's different about the infrastructure needed for training a model versus serving it for inference?”