Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 9 - Policy Gr...

Professor Emma Brunskill

Assistant Professor, Computer Science

Stanford AI for Human Impact Lab

Stanford Artificial Intelligence Lab

Statistical Machine Learning Group

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 4 - Model Fre...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

RL Course by David Silver - Lecture 10: Classic Games

An overview of Game Theory, minimax search, self-play and imperfect information games.

Data-Driven Control: Eigensystem Realization Algorithm

In this lecture, we introduce the eigensystem realization algorithm (ERA), which is a purely data-driven algorithm to obtain balanced input—output models from impulse response data. ERA was...

Parseval's Theorem

Parseval's theorem is an important result in Fourier analysis that can be used to put guarantees on the accuracy of signal approximation in the Fourier domain.

SVD: Eigenfaces 1 [Python]

This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Python code, part 1).

Principal Component Analysis (PCA) [Matlab]

This video describes how the singular value decomposition (SVD) can be used for principal component analysis (PCA) in Matlab.

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 16 - Monte Ca...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

Velocity & Acceleration in Non-Inertial Reference Frames (Coriolis &...

In this video we derive a mathematical description of velocity and acceleration in non-inertial reference frame. We examine the effect of fictitious forces that are witnessed by observers on...

Expressing Vectors in Different Frames Using Rotation Matrices

In this video we develop notation to express a vector in different reference/coordinate frames. We then investigate how to use rotation matrices to translate from a vector expressed in one...

Virtual Laboratory for Vibrations and Control Theory

This virtual lab developed in Matlab Simscape provides an innovative tool for learning and teaching fundamentals of mechanical vibrations including mass-spring-damper systems. 

Data-Driven Control: Observer Kalman Filter Identification

In this lecture, we introduce the observer Kalman filter identification (OKID) algorithm. OKID takes natural input--output data from a system and estimates the impulse response, for later...

Koopman Spectral Analysis (Representations)

In this video, we explore how to obtain finite-dimensional representations of the Koopman operator from data, using regression.

SVD: Eigenfaces 4 [Matlab]

This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Matlab code, part 4).

Identifying Dominant Balance Physics from Data - Jared Callaham

This video illustrates a new algorithm to identify local dominant physical balance relations from multiscale spatiotemporal data.

RL Course by David Silver - Lecture 4: Model-Free Prediction

An introduction to Monte-Carlo Learning and Temporal Difference Learning

How the Flight Controller Code Works - dRehmFlight VTOL

This video will walk you through the flight controller code of dRehmFlight VTOL to give you a better understanding of the contents and structure. The hope is that it will cover almost...

Cascade Control

When and how to use cascade

Building a Matlab/Simulink Model of an Aircraft: the Research Civil Aircraf...

In this video we implement the RCAM model as a Matlab script that is called from a Simulink model. The result is a fully encapsulated Simulink model of a nonlinear, 6 DOF aircraft. Please...

Data-Driven Control: Balanced Truncation Example

In this lecture, we explore the balanced truncation procedure on an example in Matlab. In particular, we demonstrate the ability of a balancing transformation to make the controllability...

Discrete-Time Dynamical Systems

This video shows how discrete-time dynamical systems may be induced from continuous-time systems.

Singular Value Decomposition (SVD): Mathematical Overview

This video presents a mathematical overview of the singular value decomposition (SVD).

Unitary Transformations and the SVD [Python]

This video describes how the singular value decomposition (SVD) is related to unitary transformations, with Python code.

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 3 - Model-Fr...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 13 - Fast Rei...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group