Reinforcement Learning with MATLAB.

This repository contains series of modules to get started with Reinforcement Learning with MATLAB.

It is divided into 4 stages.

In Stage 1, we start with learning RL concepts by manually...

DSP Related

Website with a lot of good content for any DSP scientists, researchers, and developers.

Improve SNR and Capacity of Wireless Communication Using Antenna Arrays

The goal of a wireless communication system is to serve as many users with the highest possible data rate given constraints such as radiation power limit and operating budget. To improve the...

Output Characterization to Linearize a Loop - Control valve application

This application paper explains how a control valve created nonlinearity in a loop and how output characterization solved the problem

Process Control is Inventory Control

You change the inventory of heat to change temperature.  You change the inventory of material to change level.  Understanding how the inventory relates to the controlled variable is...

MATLAB Command: goodnessOfFit

Goodness of fit between test and reference data for analysis and validation of identified models

Control Bootcamp: Observability Example in Matlab

This video explores observability in Matlab on the example system of an inverted pendulum on a cart.

Quanser QUBE-Servo 2: Low-cost Teaching Platform for Controls

The Quanser QUBE-Servo 2 is a fully integrated, modular servomotor lab experiment designed for teaching mechatronics and control concepts at the undergraduate level. Ideal for teaching speed...

Virtual Lab for a Two-tanks system

This is a virtual lab for a two-tank system that can be used for modelling and control learing/teaching purposes. Open-loop tests and closed-loop simulatons based on PI control or PI plus...

Use First-Principles Modeling to Get FOPDT Coefficient Values

Conventionally, we obtain model coefficient values by open-loop step-testing of the process; but this creates undesirable process upsets, and only reveals the local process behavior.  This...

Gain Scheduling (Pre-programmed Controller Parameter Adjustment)

Process gain and time-constants change with operating flow rate, tank levels, temperatures, etc.  This often requires re-tuning of the controller coefficient values.  However, once done...

Train Custom LQR Agent with MATLAB

This example shows how to train a custom linear quadratic regulation (LQR) agent to control a discrete-time linear system modeled in MATLAB®.

MATLAB Documentation page: nlarx command

This is the Mathworks documentation page for the nlarx MATLAB command.

Principal Component Analysis (PCA) 2 [Python]

This video describes how the singular value decomposition (SVD) can be used for principal component analysis (PCA) in Python (part 2).

Using ‘fminsearch’ to Minimize a Function Specified by a File with Extra Par...

In this video we show 4 different ways to use/call Matlab’s ‘fminsearch’ function to perform unconstrained optimization.Topics and timestamps:0:00 – Introduc...

Autodesk Tinkercad

Tinkercad is a free, easy-to-use web app that equips the next generation of designers and engineers with the foundational skills for innovation: 3D design, electronics, and coding!

Massive MIMO Hybrid Beamforming

This MATLAB example shows how hybrid beamforming is employed at the transmit end of a massive MIMO communications system, using techniques for both multi-user and single-user systems. The...

Min IAE Tuning

Procedure and Commentary on tuning for minimum Integral of the Absolute Error

Pulse Waveform Analyzer App

The Pulse Waveform Analyzer app lets you explore the properties of signals commonly used in radar. You can display 2-D and 3-D plots that let you visualize waveform time series and spectra.

Automotive Adaptive Cruise Control Using FMCW Technology

This MATLAB example shows how to model an automotive adaptive cruise control system using the frequency modulated continuous wave (FMCW) technique. This example performs range and Doppler...

Sprint - Test Flight 8 and Data Review

This video is part of a series that details the design, build, and test of Sprint - a thrust vector controlled model rocket by Joe Barnard of BPS Space.

Tuning PID Controllers

Tuning controllers is the procedure for choosing the coefficient values for the P, I and D modes.  It must be simple to execute, fast, and non-disruptive to the operating process.  Heuristic...

Decoding a Laplace Representation of a Controller

A how to relate the Laplace notation to the PID controller variation and features

MATLAB Command: resid

This MATLAB command is part of the system identification toolbox and provides a way to compute and test residuals.

Python Control Systems Library

The python-control package is a set of python classes and functions that implement common operations for the analysis and design of feedback control systems. The initial goal is to implement...