Course Outline
Introduction to Generative AI
- What is generative AI and why is it important?
- Main types and techniques of generative AI
- Key challenges and limitations of generative AI
Transformer Architecture and LLMs
- What is a transformer and how does it work?
- Main components and features of a transformer
- Using transformers to build LLMs
Scaling Laws and Optimization
- What are scaling laws and why are they important for LLMs?
- How do scaling laws relate to the model size, data size, compute budget, and inference requirements?
- How can scaling laws help optimize the performance and efficiency of LLMs?
Training and Fine-Tuning LLMs
- Main steps and challenges of training LLMs from scratch
- Benefits and drawbacks of fine-tuning LLMs for specific tasks
- Best practices and tools for training and fine-tuning LLMs
Deploying and Using LLMs
- Main considerations and challenges of deploying LLMs in production
- Common use cases and applications of LLMs in various domains and industries
- Integrating LLMs with other AI systems and platforms
Ethics and Future of Generative AI
- Ethical and social implications of generative AI and LLMs
- Potential risks and harms of generative AI and LLMs, such as bias, misinformation, and manipulation
- Responsible and beneficial use of generative AI and LLMs
Summary and Next Steps
Requirements
- An understanding of machine learning concepts, such as supervised and unsupervised learning, loss functions, and data splitting
- Experience with Python programming and data manipulation
- Basic knowledge of neural networks and natural language processing
Audience
- Developers
- Machine learning enthusiasts
Testimonials (7)
Examples and links excel repository
Olga - GE HealthCare
Course - Generative AI with Large Language Models (LLMs)
a lot of examples and different tools to check
Bartosz - GE HealthCare
Course - Generative AI with Large Language Models (LLMs)
Custom GPTs, prompt engineering
Marcin Stezowski - GE HealthCare
Course - Generative AI with Large Language Models (LLMs)
Wide perspective
Artur - GE HealthCare
Course - Generative AI with Large Language Models (LLMs)
Technical examples in conjunction with theory.
Marcin - GE HealthCare
Course - Generative AI with Large Language Models (LLMs)
Mikołaj background outside IT enable presenting this topic from different angle - much needed for IT folks!
Grzegorz - GE HealthCare
Course - Generative AI with Large Language Models (LLMs)
Explanation form other than IT perspective. Adding value