Large Language Models and Key Metrics

Skillsoft issued completion badges are earned based on viewing the percentage required or receiving a passing score when assessment is required. Large language models (LLMs) are revolutionizing the landscape of artificial intelligence by enhancing how machines understand and generate human language. Models like GPT and BERT can grasp context, meaning, and expression in ways never before possible. Use this course to deepen your understanding of evaluation metrics like HELM, BLEU, ROUGE, and F1 scores, and learn to distinguish between intrinsic and extrinsic evaluation methods. Explore practical examples of evaluating LLMs, reviewing both public and in-house models, and discover their pros and cons. You'll also learn key considerations for selecting an LLM, focusing on scalability and task-specific performance, and aligning evaluation metrics with business needs for effective model selection. Upon completion of this course, you will have a strong foundational understanding of large language models and the key metrics used to evaluate them.