EC467N Introduction to GenAI

Course Name: 

EC467N Introduction to GenAI

Category: 

Programme Specific Electives (PSE)

Credits (L-T-P): 

(2-0-2) 3

Content: 

Deep learning Review - MLP/CNN/RNN, self-attention, scaled-dot product attention, multi-head blocks, positional encoding, Transformer architecture, seq2seq task in Colab Text Understanding&Generation in Colab - Encoder-only (BERT) fine-tuning for classification & QA, Decoder-only (GPT-2) text generation, sampling strategies, Seq2seq (T5/BART) summarization & translation, ROUGE Scoring Audio & Music Generation - wav2vec 2.0 for ASR (self-supervised pre-training + fine-tuning), VQ-VAE tokenization for raw audio synthesis, Music Transformer for symbolic melody generation Vision & Video Vision Transformer (ViT) for image classification, CIFAR-10 in Colab; compare to ResNet baseline Latent Diffusion (Stable Diffusion) for text-to-image, Hugging Face Diffusers; generate 256×256 images Video Transformers (ViViT/TimeSformer), Simple Video Transformer for action recognition on short clips.

References: 

Deep Learning by Goodfellow, Bengio, and Courville, Hardcover Book on Artificial Intelligence, MIT Press 2016.
Natural Language Processing with Transformers, Revised Edition 1st Edition, Lewis Tunstall, Leandro von Werra, Thomas Wolf, O’Reilly 2022
Hands-On Generative AI with Transformers and Diffusion Models Omar Sanseviero, Pedro Cuenca, Apolinario Passos and Jonathan Whitaker, O’Reilly 2024

Department: 

Electronics and Communication Engineering(ECE)
 

Contact us

Prof. Ramesh Kini M.
Professor and Head,
Department of ECE, NITK, Surathkal,
P. O. Srinivasnagar,
Mangalore - 575 025 Karnataka, India.

Connect with us

We're on Social Networks. Follow us & get in touch.