Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 8 - Policy Gr...

Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group

See More

Internal Model Control IMC Introduction

Internal Model Control IMC Introduction

See More

Inner Products in Hilbert Space

This video will show how the inner product of functions in Hilbert space is related to the standard inner product of vectors of data.

See More

Control Systems in Practice, Part 6: What Are Non-Minimum Phase Systems?

We like to categorize transfer functions into groups and label them because it helps us understand how a particular system will behave simply by knowing the group that it’s part of. We gain...

See More

RL Course by David Silver - Lecture 2: Markov Decision Process

Explores Markov Processes including reward processes, decision processes and extensions.

See More

First Order Dynamics in Process Control

An overview on the identification and behavior of first order dynamics in process control.

See More

Data-Driven Control: Error Bounds for Balanced Truncation

In this lecture, we derive error bounds for the balanced truncation.

See More

Numerically Linearizing a Dynamic System

In this video we show how to linearize a dynamic system using numerical techniques. In other words, the linearization process does not require an analytical...

See More

Humans, Robots, and Non-Prehensile Manipulation

This is a fun video that was inspired by a presentation I saw at the 2015 International Conference on Robotics and Automation (ICRA). I wanted to see if humans could duplicate the...

See More

Drone Simulation and Control, Part 3: How to Build the Flight Code

This video describes how to create quadcopter flight software from the control architecture developed in the last video. It covers how to process the raw sensor readings and use them with...

See More

Digital Twin Parameter Tuning

Learn how to tune the digital twin model of a pump system to its physical asset using Simulink Design Optimization™. You can use measured data collected from the physical system to tune the...

See More

Partial Fraction Expansion/Decomposition

In this video we discuss how to perform partial fraction expansion (PFE) to rewrite a ratio of polynomials as simpler expressions. Topics and time stamps:(0...

See More

Peter Ponders PID - KalmanFilters, Alpha-Beta-Gamma filters

A Kalman filter example with all the math is used to estimate the position, velocity and acceleration after corrupting perfect data with measurement and pro... See More

Control Bootcamp: Sensitivity and Complementary Sensitivity

Here we explore the sensitivity and complementary sensitivity functions, which are critical in understanding robustness and performance.

See More

Final Value Theorem and Steady State Error

This Final Value Theorem is a way we can determine what value the time domain function approaches at infinity but from the S-domain transfer function. This is very helpful when we're trying...

See More

Euler Angles and the Euler Rotation Sequence

 

In this video we discuss how Euler angles are used to define the relative orientation of one coordinate frame to another.

See More

Bode Plots of Complex Transfer Functions

In this video we discuss how to generate a bode plot of a complex transfer function by decomposing it into the individual components. We then show how one c...

See More

Peter Ponders PID - System Identification Advanced

System Identification of a more complex system with noise and truncation errors. This is the same open loop transfer function used in the root locus videohtt... See More

Identifying Dominant Balance Physics from Data - Jared Callaham

This video illustrates a new algorithm to identify local dominant physical balance relations from multiscale spatiotemporal data.

See More

The Discrete Fourier Transform (DFT)

This video introduces the Discrete Fourier Transform (DFT), which is how to numerically compute the Fourier Transform on a computer. The DFT, along with its fast FFT implementation, is one...

See More

SVD Method of Snapshots

This video describes how to compute the singular value decomposition (SVD) using the method of snapshots, by Sirovich 1987.

See More

Velocity & Acceleration in Non-Inertial Reference Frames (Coriolis &...

In this video we derive a mathematical description of velocity and acceleration in non-inertial reference frame. We examine the effect of fictitious forces ...

See More

Unitary Transformations

This video discusses unitary matrix transformations and how they relate to the geometry of the singular value decomposition (SVD).

See More

Posicast Control - 1 ( In English)

This video is an introduction to a learning journey about Posicast Control structured as follows: - Preface - Motivation - Introduction to Posicast Control - Half-Cycle Posicast

See More

Laplace domain – tutorial 1: Laplace transform

In this video, we learn about Laplace transform which enables us to travel from time to the Laplace domain. The following materials are covered:1) why we nee...

See More