Reinforcement Learning for Engineers, Part 2: Understanding the Environment ...
13 min
Beginner
Video
Theory
In this video, we build on our basic understanding of reinforcement learning by exploring the workflow. We cover what an environment is and some of the benefits of training within a...
See More
Understanding Kalman Filters, Part 2: State Observers
8 min
Beginner
Video
Theory
Learn the working principles of state observers, and discover the math behind them. State observers are used for estimating the internal states of a system when you can’t directly measure...
See More
FMCW Radar for Autonomous Vehicles | Understanding Radar Principles
18 min
Beginner
Video
Theory
Watch an introduction to Frequency Modulated Continuous Wave (FMCW) radar and why it’s a good solution for autonomous vehicle applications. This demonstration will show how FMCW radar can...
See More
Understanding PID Control, Part 4: A PID Tuning Guide
12 min
Beginner
Video
Theory
It can be difficult to navigate all the resources that promise to explain the secrets of PID tuning. Some proclaim that PID tuning is an art that requires finesse and experience, while...
See More
Advances in feedforward control for measurable disturbances
35 min
Intermediate
Video
Theory
The efficient compensation of load disturbances is one of the most important tasks in any control system. Most industrial processes are affected by disturbances and only feedback is commonly...
See More
Using the Control System Designer in Matlab
53 min
Beginner
Video
Theory
In this video we show how to use the Control System Designer to quickly and effectively design control systems for a linear system. We show how to add multi...
See More
Control Systems in Practice, Part 9: The Step Response
15 min
Beginner
Video
Theory
This video covers a few interesting things about the step response. We’ll look at what a step response is and some of the ways it can be used to specify design requirements for closed loop...
See More
An Introduction to Multi-Agent Reinforcement Learning
Beginner
Video
Theory
Learn what multi-agent reinforcement learning is and some of the challenges it faces and overcomes. You will also learn what an agent is and how multi-agent systems can be both cooperative...
See More
The AVA Flight Computer
18 min
Beginner
Video
Application
This video describes the board design, hardware architecture, and software components of the All Vehicle Avionics (AVA) flight computer that was designed by Joe Barnard of BPS Space. This...
See More
Adaptive Control Basics: What Is Model Reference Adaptive Control?
17 min
Beginner
Video
Theory
Use an adaptive control method called model reference adaptive control (MRAC). This controller can adapt in real time to variations and uncertainty in the system that is being controlled...
See More
Control Systems in Practice, Part 7: 4 Ways to Implement a Transfer Function...
18 min
Beginner
Video
Theory
In some situations, it is easier to design a controller or a filter using continuous, s-domain transfer functions. We have a lot of mathematical tools that make analyzing and manipulating...
See More
Model Predictive Control
12 min
Beginner
Video
Theory
This lecture provides an overview of model predictive control (MPC), which is one of the most powerful and general control frameworks. MPC is used extensively in industrial control settings...
See More
Autonomous Navigation, Part 4: Path Planning with A* and RRT
18 min
Beginner
Video
Theory
This video explores some of the ways that we can use a map like a binary occupancy grid for motion and path planning. We briefly cover what motion planning means and how we can use a graph...
See More
Modeling Physical Systems, An Overview
7 min
Beginner
Video
Theory
This video sets the stage for the topics that I want to cover over the next month or two. This is an overview of how you go from a physical system to a linear model where you can design a...
See More
Understanding Kalman Filters, Part 4: An Optimal State Estimator Algorithm
9 min
Beginner
Video
Theory
Discover the set of equations you need to implement a Kalman filter algorithm. You’ll learn how to perform the prediction and update steps of the Kalman filter algorithm, and you’ll see how...
See More
Understanding PID Control, Part 6: Manual and Automatic Tuning Methods
13 min
Beginner
Video
Theory
The previous video showed three different approaches to developing a mathematical model of your physical system. Now that we have this model, we can use it to tune a PID controller that will...
See More
Machine Learning Control: Tuning a PID Controller with Genetic Algorithms (P...
9 min
Beginner
Video
Theory
This lecture shows how to use genetic algorithms to tune the parameters of a PID controller. Tuning a PID controller with genetic algorithms is not generally recommended, but is used to...
See More
Reinforcement Learning for Engineers, Part 3: Policies and Learning Algorith...
17 min
Beginner
Video
Theory
This video provides an introduction to the algorithms that reside within the agent. We’ll cover why we use neural networks to represent functions and why you may have to set up two neural...
See More
Understanding Kalman Filters, Part 3: An Optimal State Estimator
7 min
Beginner
Video
Theory
Watch this video for an explanation of how Kalman filters work. Kalman filters combine two sources of information, the predicted states and noisy measurements, to produce optimal, unbiased...
See More
The Radar Equation | Understanding Radar Principles
Beginner
Video
Theory
Learn how the radar equation combines several of the main parameters of a radar system in a way that gives you a general understanding of how the system will perform. The radar equation is a...
See More
System Identification Methods
17 min
Beginner
Video
Theory
System Identification is the process of determining the model or the equations of motion for your system. This is incredibly important because basing a control system design off of a bad...
See More
Control Bootcamp: Kalman Filter Example in Matlab
22 min
Beginner
Video
Application
This lecture explores the Kalman Filter in Matlab on an inverted pendulum on a cart.
See More
Discrete control #4: Discretize with the matched method
14 min
Beginner
Video
Theory
This is the fourth video on discrete control and in this video we are going to continue exploring the different techniques we can use to discretize a continuous system and talk about the...
See More
Resonance in Nature and Bioinspired Squid Robots
18 min
Beginner
Video
Demonstration
Bioinspired robots combine the best of both biology and engineering. Using tools learned from nature, we can build squid-like and other squishy robots to improve current capabilities in...
See More
Advances in feedforward control for measurable disturbances (in Spanish)
60 min
Intermediate
Video
Theory
The efficient compensation of load disturbances is one of the most important tasks in any control system. Most industrial processes are affected by disturbances and only feedback is commonly...
See More