Questions
Please try and see if you can come up with the answers to these questions from memory. If you are unsure about any of them, you might want to refer to the corresponding section in the chapter:
- In your opinion, what is the best term for describing the operationalization of language models, LLM apps, or apps that rely on generative models in general?
- What is a token and why should you know about token usage when querying LLMs?
- How can we evaluate LLM apps?
- Which tools can help to evaluate LLM apps?
- What are the considerations for the production deployment of agents?
- Name a few tools used for deployment.
- What are the important metrics for monitoring LLMs in production?
- How can we monitor LLM applications?
- What’s LangSmith?
