Generative AI Specialization

Master generative models with hands-on projects in chatbots, API applications, and creative AI using LangChain, LlamaIndex, and more.

Course Plan

Week 1: Fundamentals of Generative Models

  • Introduction to Generative AI: GANs, VAEs, and diffusion models
  • Applications in text, image, and music generation

Week 2: Transformers and Attention Mechanisms

  • Deep dive into transformer architecture and self-attention
  • Hands-on: Building a simple transformer model with PyTorch

Week 3: Diffusion Models for Image Generation

  • Understanding diffusion models and their mechanics
  • Implementing image generation with Stable Diffusion

Week 4: Large Language Models (LLMs) - Part 1

  • Overview of LLMs: GPT, BERT, and LLaMA
  • Pre-training and fine-tuning techniques using Hugging Face

Week 5: Fine-Tuning LLMs

  • Fine-tuning GPT models on custom datasets with AWS SageMaker
  • Optimizing model performance for specific tasks

Week 6: Introduction to LangChain

  • Building generative AI applications with LangChain
  • Creating a simple text generation pipeline

Week 7: Retrieval-Augmented Generation (RAG)

  • Understanding RAG and its role in enhancing LLMs
  • Implementing RAG with LangChain and FAISS for knowledge retrieval

Week 8: LlamaIndex for Data-Augmented Generation

  • Using LlamaIndex to index and retrieve data for generative tasks
  • Building a Q&A system with LlamaIndex and LLaMA

Week 9: Text-to-Image Generation with CLIP

  • Combining CLIP with diffusion models for text-to-image generation
  • Creating a web app with Streamlit to showcase results

Week 10: Ethical Considerations in Generative AI

  • Addressing bias, fairness, and ethical issues in generative models
  • Case studies on responsible AI deployment

Week 11: Project - Chatbot Development

  • Build a conversational chatbot using LangChain and RAG
  • Integrate LlamaIndex for knowledge retrieval from custom documents
  • Deploy the chatbot as a web app using Flask API

Week 12: Generative AI with Vertex AI

  • Deploying generative models on Google Cloud with Vertex AI
  • Using Gemini models for advanced text generation

Week 13: API Development with Flask

  • Creating a Flask API to serve generative AI models
  • Building an endpoint for text generation with fine-tuned LLMs

Week 14: Project - Text-to-Image API Application

  • Develop a Flask API for text-to-image generation using Stable Diffusion
  • Integrate the API with a Streamlit frontend for user interaction
  • Deploy the application on AWS or GCP

Week 15: Capstone Project - Creative AI System

  • Design a generative AI system for art or music generation
  • Use diffusion models for art generation and LLMs for music lyrics
  • Deploy the system with a Flask API and Streamlit interface

Week 16: Final Review and Deployment

  • Optimize projects for production deployment
  • Review and present final solutions

We Will Cover Tools

AWS SageMaker Icon AWS SageMaker
Vertex AI Icon Vertex AI
Hugging Face Icon Hugging Face
Stable Diffusion Icon Dalle-OpenAI
PyTorch Icon PyTorch
TensorFlow Icon TensorFlow
OpenAI Models Icon OpenAI Models
Gemini Icon Gemini
Deepseek Icon Deepseek
LLaMA Icon LLaMA
LangChain Icon LangChain
LlamaIndex Icon LlamaIndex
FAISS Icon FAISS
ChromaDB Icon ChromaDB
Flask API Icon Flask API
Streamlit Icon Streamlit
Gemini Pro Icon Gemini Pro