EC888 Generative AI and Natural Language Processing

Course Name: 

EC888 Generative AI and Natural Language Processing

Programme: 

M.Tech(SPML)

Category: 

Elective (Ele)

Credits (L-T-P): 

(3-0-2) 4

Content: 

Background and Fundamentals: Review of RNNs, LSTM, GRU, Backpropagation through time, Automatic Differentiation, Log-linear modeling, NLP Feature Engineering, Softmax, MLE estimation, Probabilistic models of NLP. NLP Representation Learning: Word and Sentence Representations- Encoding Words, Pooling and n-grams, Word Embeddings, Unsupervised Word Repr, Skip-Gram, BERT, Contextualized Representation. Structured Prediction and Language Modeling: Neural n-gram models, Part-of-speech tagging, conditional language modeling, Neural probabilistic language models. Machine Translation and Language Generation: Translation task, Seq-to-Seq models, Attention mechanism, Self-Attention, Transformers, Decoding, Graph search, common strategies, real world application. Generative AI: Introduction to Generative AI Models, Explainable AI, Prompt Engineering, Fine-tuning GPT, develop a deep understanding of GPT, including its mechanisms, features, and limitations, Ethical Considerations in Generative AI Models & GPT, the Future of Generative AI, Security and Privacy Considerations.

References: 

Yaov Goldeberg, Neural Network Methods for Natural Language Processing, Springer Publisher.2017.
Aston Zhang, Zack C. Lipton, Mu Li, Alexander J. Smola, Deep Dive into Deep Learning (online: https://d2l.ai/)
Daniel Jurafsky and James H. Martin. Speech and Language Processing. 3rd Edition, 2020.
Christopher D. Manning and Hinrich Schütze. Foundations of Statistical Natural Language Processing. MIT Press.1999.
Jacob Eisenstein, Introduction to Natural Language Processing, MIT Press, 2018.
James Allen, Natural Language Understanding, 1984.
Sowmya Vajjala, Bodhisattwa Majumder, Anuj Gupta, Harshit Surana. Practical Natural Language Processing. O'Reilly, 2020.
Numa Dhamani and Maggie Engler, Introduction to Generative AI, Manning Publications, 2024.

Department: 

Electronics and Communication Engineering(ECE)
 

Contact us

Prof. Ramesh Kini M.
Professor and Head,
Department of ECE, NITK, Surathkal,
P. O. Srinivasnagar,
Mangalore - 575 025 Karnataka, India.

Connect with us

We're on Social Networks. Follow us & get in touch.