AI and LLMs · Senior · Question 55 of 75
Why should cost be part of an eval report?
- 1A small quality gain may not justify a large cost increase
- 2Cost is the only thing that matters for AI features
- 3Providers require cost reports for every eval run
Show the answer
Correct answer: A small quality gain may not justify a large cost increase
Explanation
Reporting quality, latency and cost together makes trade-offs explicit for product decisions.