
RL Course by David Silver - Lecture 10: Classic Games
An overview of Game Theory, minimax search, self-play and imperfect information games.
See MoreData-Driven Control: Eigensystem Realization Algorithm
In this lecture, we introduce the eigensystem realization algorithm (ERA), which is a purely data-driven algorithm to obtain balanced input—output models from impulse response data. ERA was...
See MoreParseval's Theorem
Parseval's theorem is an important result in Fourier analysis that can be used to put guarantees on the accuracy of signal approximation in the Fourier domain.
See MoreSVD: Eigenfaces 1 [Python]
This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Python code, part 1).
See MorePrincipal Component Analysis (PCA) [Matlab]
This video describes how the singular value decomposition (SVD) can be used for principal component analysis (PCA) in Matlab.
See MoreStanford CS234: Reinforcement Learning | Winter 2019 | Lecture 16 - Monte Ca...
Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group
Using a Homogeneous Transformation Matrix to Combine Rotation and Translatio...
In this video we discuss how to properly deal with coordinate frames that are both rotated and translated from one another. We develop a homogeneous transformation matrix which combines a...
See MoreVirtual Laboratory for Vibrations and Control Theory
This virtual lab developed in Matlab Simscape provides an innovative tool for learning and teaching fundamentals of mechanical vibrations including mass-spring-damper systems.
See MoreData-Driven Control: Observer Kalman Filter Identification
In this lecture, we introduce the observer Kalman filter identification (OKID) algorithm. OKID takes natural input--output data from a system and estimates the impulse response, for later...
See MoreKoopman Spectral Analysis (Representations)
In this video, we explore how to obtain finite-dimensional representations of the Koopman operator from data, using regression.
See MoreSVD: Eigenfaces 4 [Matlab]
This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Matlab code, part 4).
See MoreIdentifying Dominant Balance Physics from Data - Jared Callaham
This video illustrates a new algorithm to identify local dominant physical balance relations from multiscale spatiotemporal data.
See MoreStanford CS234: Reinforcement Learning | Winter 2019 | Lecture 3 - Model-Fr...
Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group
Simple Vector Mechanics: Inner Product, Scalar/Vector Projection, and Cross ...
In this video we discuss several simple vector operations such as: 1. Computing the magnitude of a vector 2. The inner/dot product 3. The scalar and vector projection 4. The cross product
See MoreRL Course by David Silver - Lecture 4: Model-Free Prediction
An introduction to Monte-Carlo Learning and Temporal Difference Learning
See MoreCoriolis Effect Demonstration (with Drones)
We demonstrate how rotating reference frames give rise to the Coriolis effect and centrifugal acceleration. In this video, we approach this as a simple physics demonstration and examine...
See MoreData-Driven Control: Balanced Truncation Example
In this lecture, we explore the balanced truncation procedure on an example in Matlab. In particular, we demonstrate the ability of a balancing transformation to make the controllability...
See MoreDiscrete-Time Dynamical Systems
This video shows how discrete-time dynamical systems may be induced from continuous-time systems.
See MoreSingular Value Decomposition (SVD): Mathematical Overview
This video presents a mathematical overview of the singular value decomposition (SVD).
See MoreUnitary Transformations and the SVD [Python]
This video describes how the singular value decomposition (SVD) is related to unitary transformations, with Python code.
See MoreStanford CS234: Reinforcement Learning | Winter 2019 | Lecture 13 - Fast Rei...
Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group
Trimming a Model of a Dynamic System Using Numerical Optimization
In this video we show how to find a trim point of a dynamic system using numerical optimization techniques. We generate a cost function that corresponds to a straight and level flight...
See MoreRL Course by David Silver - Lecture 9: Exploration and Exploitation
An overview of multi-armed bandits, contextual bandits and Markov Decision Processes.
See MoreData-Driven Control: Change of Variables in Control Systems (Correction)
This video corrects a typo in the previous lecture.
See More