Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 16 - Monte Ca...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

Expressing Vectors in Different Frames Using Rotation Matrices

In this video we develop notation to express a vector in different reference/coordinate frames. We then investigate how to use rotation matrices to translate from a vector expressed in one...

Manipulating Aerodynamic Coefficients

In this video we discuss some potential problems you may encounter when attempting to perform operations with dimensionless aerodynamic coefficients such as CL and CD.

Data-Driven Control: Balanced Truncation Example

In this lecture, we explore the balanced truncation procedure on an example in Matlab. In particular, we demonstrate the ability of a balancing transformation to make the controllability...

Discrete-Time Dynamical Systems

This video shows how discrete-time dynamical systems may be induced from continuous-time systems.

Singular Value Decomposition (SVD): Mathematical Overview

This video presents a mathematical overview of the singular value decomposition (SVD).

Unitary Transformations and the SVD [Python]

This video describes how the singular value decomposition (SVD) is related to unitary transformations, with Python code.

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 3 - Model-Fr...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

RL Course by David Silver - Lecture 4: Model-Free Prediction

An introduction to Monte-Carlo Learning and Temporal Difference Learning

Cascade Control

When and how to use cascade

Building a Matlab/Simulink Model of an Aircraft: the Research Civil Aircraf...

In this video we implement the RCAM model as a Matlab script that is called from a Simulink model. The result is a fully encapsulated Simulink model of a nonlinear, 6 DOF aircraft. Please...

Computing Euler Angles: The Euler Kinematical Equations and Poisson’s Kinema...

In this video we discuss how the time rate of change of the Euler angles are related to the angular velocity vector of the vehicle. This allows us to design an algorithm to consume...

Data-Driven Control: Change of Variables in Control Systems (Correction)

This video corrects a typo in the previous lecture.

Complex Fourier Series

This video will describe how the Fourier Series can be written efficiently in complex variables.

SVD: Eigenfaces 1 [Matlab]

This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Matlab code, part 1).

Sparse Identification of Nonlinear Dynamics for Model Predictive Control

This lecture shows how to use sparse identification of nonlinear dynamics with control (SINDYc) with model predictive control to control nonlinear systems purely from data.

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 13 - Fast Rei...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

RL Course by David Silver - Lecture 9: Exploration and Exploitation

An overview of multi-armed bandits, contextual bandits and Markov Decision Processes.

Derivation of Rodrigues’ Rotation Formula

In this video we explain and derive Rodrigues’ Rotation Formula. This functions describes how to rotate an arbitrary vector about another arbitrary axis of rotation. This has applications to...

Data-Driven Control: Error Bounds for Balanced Truncation

In this lecture, we derive error bounds for the balanced truncation.

Koopman Spectral Analysis (Overview)

In this video, we introduce Koopman operator theory for dynamical systems. The Koopman operator was introduced in 1931, but has experienced renewed interest recently because of the...

SVD: Eigenfaces 3 [Python]

This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Python code, part 3).

Simulating the Lorenz System in Matlab

This video shows how simple it is to simulate dynamical systems, such as the Lorenz system, in Matlab, using ode45.

Controls Engineering in the FIRST Robotics Competition

This guide is intended to make an advanced engineering topic approachable so it can be applied by those who aren’t experts in control theory. The intended audience is high school students...

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 7 - Imitation...

Professor Emma Brunskill

Assistant Professor, Computer Science

Stanford AI for Human Impact Lab

Stanford Artificial Intelligence Lab

Statistical Machine Learning Group