ORIE 5742

Info Theory, Probabilistic Modeling, and Deep Learning with Scientific and Financial Apps

Course Description

Course information provided by the 2024-2025 Catalog. Courses of Study 2024-2025 is scheduled to publish mid-June.

This course is about building and understanding machine learning models for scientific and financial applications. It will cover foundational aspects of information theory and probabilistic inference as they relate to model construction and deep learning. Topics include hamming codes, repetition codes, entropy, mutual information, Shannon information, channel capacity, likelihood functions, Bayesian inference, graphical models, and deep neural networks. The section on deep neural networks will consider fully connected, convolutional, recurrent, and LSTM networks, generative adversarial training, and variational autoencoders.

Prerequisites/Corequisites Prerequisite: ORIE 3500, MATH 2940 or equivalent, CS 2110 or equivalent, exposure to statistical machine learning at the level of ORIE 4740, ORIE 3741 or equivalent or permission of the instructor.

Last 4 Terms Offered 2025SP, 2024SP

When Offered Spring.

View Enrollment Information