AI and LLMs · Middle · Question 43 of 75

What is the trade-off of self-hosting open-weight models versus using an API?

Show the answer

Correct answer: More control and privacy, but you run the infrastructure

Explanation

Self-hosting needs GPUs, monitoring and updates. APIs are simpler but send data to a provider under its terms.

Further reading

Problem with a question

AI and LLMs · Middle · question 43

Test yourself

Take the AI and LLMs · Middle quiz: questions and options are shuffled, and you get a review of your mistakes at the end.

Take this quiz