60. LLM Evaluation
LLM systems need evaluation at multiple levels.
Possible metrics include:
- accuracy
- retrieval precision
- retrieval recall
- answer quality
- hallucination rate
- latency
- throughput
Evaluation should use representative datasets and clearly defined criteria.