Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 11 - Fast Rei...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

Data-Driven Control: Balanced Truncation

In this lecture, we describe the balanced truncation procedure for model reduction, where a handful of the most controllable and observable state directions are kept for the reduced-order...

Sliding Mode Control Design for Mass-Spring-Damper System

This MATLAB/Simulink example describes the fundamentals of sliding mode control (SMC) and uses SMC to control a mass-spring-damper system.

Randomized SVD: Power Iterations and Oversampling

This video discusses the randomized SVD and how to make it more accurate with power iterations (multiple passes through the data matrix) and oversampling.

The Frobenius Norm for Matrices

This video describes the Frobenius norm for matrices as related to the singular value decomposition (SVD).

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 8 - Policy Gr...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

RL Course by David Silver - Lecture 2: Markov Decision Process

Explores Markov Processes including reward processes, decision processes and extensions.

Feedforward Control

When and how to use feedforward control

Numerically Linearizing a Dynamic System

In this video we show how to linearize a dynamic system using numerical techniques. In other words, the linearization process does not require an analytical description of the system. This...

IIR Filters - Theory and Implementation (STM32)

Tutorial on IIR (Infinite Impulse Response) digital filters, including digital filtering overview, IIR filter theory, FIR vs IIR, Z-transform design/analysis, design using analogue...

Data-Driven Control: BPOD and Output Projection

In this lecture, we introduce the output projection for balancing proper orthogonal decomposition (BPOD), to reduce the number of adjoint simulations required when the number of measurements...

Gimbal Lock in reference to the Apollo missions

A gimbal is a pivoted support that permits rotation of an object about an axis. For this reason, a set of three axes gimbals are used in spacecrafts to help with orientation attitude control...

SVD and Optimal Truncation

This video describes how to truncate the singular value decomposition (SVD) for matrix approximation.

Linear Regression 2 [Python]

This video describes how the singular value decomposition (SVD) can be used for linear regression in Python (part 2).

Velocity & Acceleration in Non-Inertial Reference Frames (Coriolis &...

In this video we derive a mathematical description of velocity and acceleration in non-inertial reference frame. We examine the effect of fictitious forces that are witnessed by observers on...

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 1 - Introduct...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

RL Course by David Silver - Lecture 7: Policy Gradient Methods

Looks at different policy gradients, including Finite Difference, Monte-Carlo and Actor Critic.

Data-Driven Control: ERA and the Discrete-Time Impulse Response

In this lecture, we describe how the discrete-time impulse response is used in the eigensystem realization algorithm (ERA).

SVD: Eigenfaces 2 [Python]

This video describes how the singular value decomposition (SVD) can be used to efficiently represent human faces, in the so-called "eigenfaces" (Python code, part 2).

Using Antenna Toolbox with Phased Array Systems

When you create antenna arrays such as a uniform linear array (ULA), you can use antennas that are built into Phased Array System Toolbox™. Alternatively, you can use Antenna Toolbox™...

PID Tuner

Tuning a PID controller can be easily done using a systematic procedure. PID Tuner just put it in a web application. No more trial and error. 

Use the step response data from your system...

How the Flight Controller Code Works - dRehmFlight VTOL

This video will walk you through the flight controller code of dRehmFlight VTOL to give you a better understanding of the contents and structure. The hope is that it will cover almost...

Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 10 - Policy G...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

Smart Projectile State Estimation Using Evidence Theory

This journal article provides a very good practical understanding of Dempster-Shafer theory using sensor fusion and state estimation as the backdrop.

Data-Driven Control: Balanced Proper Orthogonal Decomposition

In this lecture, we introduce the balancing proper orthogonal decomposition (BPOD) to approximate balanced truncation for high-dimensional systems.