
RL Course by David Silver - Lecture 5: Model Free Control
Dives into On Policy Monte-Carlo Control and Temporal Difference Learning, as well as Off-Policy Learning.
See MoreRL Course by David Silver - Lecture 10: Classic Games
An overview of Game Theory, minimax search, self-play and imperfect information games.
See MoreDirect Synthesis for PID Design Intro
Direct Synthesis for PID Design Intro
See MoreIntroduction to Ordinary Differential Equations
In this video we introduce the concept of ordinary differential equations (ODEs). We give examples of how these appear in science and engineering as well as...
See MoreCartesian, Polar, Cylindrical, and Spherical Coordinates
In this video we discuss Cartesian, Polar, Cylindrical, and Spherical coordinates as well as develop forward and reverse transformations to go from one coord...
See MoreData-Driven Control: Balanced Truncation
In this lecture, we describe the balanced truncation procedure for model reduction, where a handful of the most controllable and observable state directions are kept for the reduced-order...
See MoreUnderstanding Sensor Fusion and Tracking, Part 1: What Is Sensor Fusion?
This video provides an overview of what sensor fusion is and how it helps in the design of autonomous systems. It also covers a few scenarios that illustrate the various ways that sensor...
See MoreTime Domain Analysis with Matlab: Using the Linear System Analyzer
In this video we explore various Matlab functions and workflows to perform time domain analysis of a dynamic system. This includes the use of ‘tf’, ‘step’, ...
See MorePeter Ponders PID - Feed Forward Theory and Calculations
Control Bootcamp: Benefits of Feedback on Cruise Control Example (Part 2)
Here we investigate the benefits of feedback for systems with uncertain dynamics and disturbances, as illustrated on a cruise control example. (Part 2)
See MoreDerivation and Solution of Laplace’s Equation
In this video we show how the heat equation can be simplified to obtain Laplace’s equation. We investigate how to solve Laplace’s equation using separation ...
See MoreKoopman Spectral Analysis (Overview)
In this video, we introduce Koopman operator theory for dynamical systems. The Koopman operator was introduced in 1931, but has experienced renewed interest recently because of the...
See MoreThe Fourier Transform
This video will discuss the Fourier Transform, which is one of the most important coordinate transformations in all of science and engineering.
See MoreFrequency domain – tutorial 1: concept of frequency (with Chinese subtitle)
In this video, the following materials are covered:1) intuitive explanation on the frequency concept 2) what is the relation between time and frequency domai...
See MoreRandomized SVD: Power Iterations and Oversampling
This video discusses the randomized SVD and how to make it more accurate with power iterations (multiple passes through the data matrix) and oversampling.
See MoreLecture 29: State space representation
Frequency domain – tutorial 5: Fourier transform
In this video, we learn about Fourier transform which enables us to travel from time to frequency domain when a signal is not periodic. The learning objectiv...
See MoreControl Bootcamp: Three Equivalent Representations of Linear Systems
This video explores three equivalent representations of linear systems: State-space ODEs, Frequency domain transfer functions, and Time-domain impulse response convolution.
See MoreBode Stability Criterion in Frequency Response Analysis Intro
The Bode stability criterion allows us to quickly determine the stability and relative stability of a transfer function. It uses a graphical method that can ...
See MoreLecture 19: Lead and PD compensator Design using Root Locus
Stanford CS234: Reinforcement Learning | Winter 2019 | Lecture 4 - Model Fre...
Professor Emma Brunskill
Assistant Professor, Computer Science
Stanford AI for Human Impact Lab
Stanford Artificial Intelligence Lab
Statistical Machine Learning Group
Machine Learning Goals
This lecture discusses the high-level goals of machine learning, and what we want out of our models. Goals include speed and accuracy, along with interpretability, generalizability...
See MoreFeedforward Control Intro
If we know how a disturbance will affect an output, we can proactively change our manipulated variable to counteract it.
See MoreSmart Projectile State Estimation Using Evidence Theory
This journal article provides a very good practical understanding of Dempster-Shafer theory using sensor fusion and state estimation as the backdrop.
See MoreIntroduction to System Stability and Control
This video attempts to provide an intuitive understanding of concepts like stability and stability margin. I briefly describe both of these topics with examples and explain how you can...
See More