An Introduction to Multi-Agent Reinforcement Learning

Learn what multi-agent reinforcement learning is and some of the challenges it faces and overcomes. You will also learn what an agent is and how multi-agent systems can be both cooperative...

Understanding PID Control, Part 4: A PID Tuning Guide

It can be difficult to navigate all the resources that promise to explain the secrets of PID tuning. Some proclaim that PID tuning is an art that requires finesse and experience, while...

Adaptive Control Basics: What Is Model Reference Adaptive Control?

Use an adaptive control method called model reference adaptive control (MRAC). This controller can adapt in real time to variations and uncertainty in the system that is being controlled...

Modeling Physical Systems, An Overview

This video sets the stage for the topics that I want to cover over the next month or two. This is an overview of how you go from a physical system to a linear model where you can design a...

DC Motor Speed: System Modeling

This examples walks through modeling a simple DC motor in MATLAB.

Control Systems in Practice, Part 9: The Step Response

This video covers a few interesting things about the step response. We’ll look at what a step response is and some of the ways it can be used to specify design requirements for closed loop...

Model Predictive Control

This lecture provides an overview of model predictive control (MPC), which is one of the most powerful and general control frameworks. MPC is used extensively in industrial control settings...

Introduction: PID Controller Design

In this tutorial we will introduce a simple, yet versatile, feedback compensator structure: the Proportional-Integral-Derivative (PID) controller. The PID controller is widely employed...

Reinforcement Learning for Engineers, Part 3: Policies and Learning Algorith...

This video provides an introduction to the algorithms that reside within the agent. We’ll cover why we use neural networks to represent functions and why you may have to set up two neural...

Intro to Data Science: The Nature of Data

This lecture discusses the types of data you might encounter, and how it determines which techniques to use.

What Is Fuzzy Logic | Fuzzy Logic Part 1

This video introduces fuzzy logic and explains how you can use it to design a fuzzy inference system (FIS), which is a powerful way to use human experience to design complex systems...

Systems modeling and representations (French)

Complete course on systems modeling. Includes examples, MATLAB code, and quizzes.

Trimming and Linearization, Part 1: What is Linearization?

Why go through the trouble of linearizing a model? To paraphrase Richard Feynman, it’s because we know how to solve linear systems. With a linear model we can more easily design a controller...

Nyquist Stability Criterion, Part 1

An explanation of the Nyquist Stability Criterion. This video steps through the importance of the criterion, how to interpret the Nyquist plot graphically, and why it is the way it is....

Understanding Control Systems: Open-Loop Control Systems

This video explores open-loop control systems by walking through some introductory examples.

Learn how open-loop systems are found in everyday appliances like toasters or showers, and...

Improving the Beginner's PID - Introduction

In conjunction with the release of the new Arduino PID Library Brett has released this series of posts that explain his PID code. He start's with what he call's “The Beginner’s PID.”  He...

Discrete control #6: z-plane warping and the bilinear transform

We’re continuing our journey through discrete control and in this video, we’re going to expand our understanding of the bilinear transform. Along the way, we’ll learn about how this...

A real control system - how to start designing

Let’s design a control system the way you might approach it in a real situation rather than an academic one. In this video, I step through a control problem and show how control theory is...

Control Systems in Practice, Part 4: Why Time Delay Matters

Time delays exist in two varieties: signal distorting delays, like phase lag, in which each frequency is delayed by a different amount of time, resulting in a distorted signal shape; and non...

How Kalman Filters Work, Part 1

This article looks at four popular estimation filter architectures: particle filter, sigma point filter, extended Kalman filter, and the Kalman filter. It discusses how all four of these...

ITSIE: An Interactive Software Tool for System Identification Education

ITSIE is an Interactive Tool for System Identification Education. The tool is developed using Sysquake, a Matlab-like language with fast execution and excellent facilities for interactive...

Learning From Data

This is an introductory course in machine learning (ML) that covers the basic theory, algorithms, and applications. ML is a key technology in Big Data, and in many financial, medical...

Understanding Closed-Loop Control

This lecture discusses the differences between open loop and closed loop control in a very easy and intuitive way. Daily examples, like a dishwasher, plant irrigation, and car speed systems...

But what is the Fourier Transform? A visual introduction.

An animated introduction to the Fourier Transform.

Introduction to System Identification

In this webinar, you will have a unique chance to learn about system identification from a world-renowned subject expert, Professor Lennart Ljung. Professor Ljung will explain the basic...