Reinforcement Learning: An Introduction

From the book introduction:

The idea that we learn by interacting with our environment is probably the first to occur to us when we think about the nature of learning. When an infant plays...

Nyquist Stability Criterion

The Wikipedia article on Nyquist Stability Criterion.  This covers the Nyquist plot, the Cauchy argument principle, and the stability criterion itself.  A mathematical derivation is also...

Why multichannel beamforming is useful for wireless communication

Wireless communication systems like 5G and WiFi usually have to serve many users simultaneously and they have to deal with multiple paths between two radios when operating in a scattering...

The Linear Quadratic Regulator

In these notes, we will derive the solution to the finite-horizon linear quadratic regulator (LQR) problem in several different ways. Fundamentally, LQR can be viewed as a large least...

Neural Network Overview

This lecture gives an overview of neural networks, which play an important role in machine learning today.

Math Background for Machine Learning from Carnegie Melon University

This course provides a place for students to practice the necessary mathematical background for further study in machine learning — particularly for taking 10-601 and 10-701. Topics covered...

Control Systems in Practice, Part 1: What Control Systems Engineers Do

This video walks through the phases of a typical project and describes what it means to be a control systems engineer. It covers the concept formulation phase, in which your job is to help...

An Artificial Intelligence Primer

This blog post is a great primer providing definitions for basic terms used in AI and machine learning (ML) such as supervised learning, unsupervised learning, and transfer learning...

Advanced process control (APC): Theory & Applications in SAGD

This webinar is presented by Thiago Avila and covers what APC is, why we do it, examples of APC in the SAGD industry, what optimization opportunities are available, and where this technology...

Why Padé Approximations Are Great! | Control Systems in Practice

Watch an introduction to Padé approximations. Learn what Padé approximations are and how to calculate them, why they are important, and when to use them—specifically in the context of time...

A simple MEMS gyro model using MATLAB / Simulink

This video walks through how to model a simple MEMS gyroscope using MATLAB/Simulink. At the end I show you how to linearize this model to use in your linear control loop design and analysis.

Control Systems in Practice, Part 5: A Better Way to Think About a Notch Fil...

This video describes an intuitive way to approach notch filter design by thinking about the problem as an inverted, lightly damped, second-order low-pass filter. Then, two additional poles...

Introduction to Radar Systems: Target Radar Cross Section

This course is presented by Robert M. O'Donnell, a former researcher at MIT Lincoln Laboratory, and is designed to instill a basic working knowledge of radar systems.

The set of 10 lectures...

Model Reference Adaptive Control Fundamentals (Dr. Tansel Yucelen)

Forum on Robotics & Control Engineering (FoRCE, http://force.eng.usf.edu/) Seminar Series: "Model Reference Adaptive Control Fundamentals" (Dr. Tansel Yucelen)

Wind Tunnel Testing: Introduction and Data Acquisition

This is the first of our 3 part series on wind tunnel testing. In this video, we introduce the concept of wind tunnel testing as well as discuss the process for acquiring aerodynamic data in...

Autonomous Navigation, Part 6: Metrics for System Assessment

Take a systems engineering approach to verifying the autonomous navigation system end to end and learn how simulations and physical tests can complement each other. The video also covers a...

What are Transfer Functions? | Control Systems in Practice

This video introduces transfer functions - a compact way of representing the relationship between the input into a system and its output. It covers why transfer functions are so popular and...

Yann LeCun’s Deep Learning Course at CDS

This course concerns the latest techniques in deep learning and representation learning, focusing on supervised and unsupervised deep learning, embedding methods, metric learning...

Intro to Data Science: Historical Context

This lecture provides some historical context for data science and data-intensive scientific inquiry.

Process Dynamics and Control Course

This course focuses on a complete start to finish process of physics-based modeling, data driven methods, and controller design. Although some knowledge of computer programming is required...

Numerically Solving Partial Differential Equations

In this video we show how to numerically solve partial differential equations by numerically approximating partial derivatives using the finite difference me...

Discrete control #1: Introduction and overview

So far I have only addressed designing control systems using the frequency domain, and only with continuous systems. That is, we’ve been working in the S domain with transfer functions. We...

Understanding The Sensitivity Function

In this video I explain the sensitivity function and try to demystify the equation used to solve for the nominal sensitivity peak. Sensitivity describes how much process variations affect...

Resonant Frequency of a Dynamic System

In this video we discuss the resonant frequency of a dynamic system. We show how the resonant frequency, natural frequency, and damped natural frequency are...

Peter Ponders PID - Cascade Control Part1

I cover whether cascade control is necessary. Why there needs to be a feed back for every loop. How to calculate gains. Bode plots and ratio of the inner t...