Machine Learning with Phil explores reinforcement learning with SARSA in this video.

While Q learning is a powerful algorithm, SARSA is equally powerful for many environments in the open AI gym. In this complete reinforcement learning tutorial, I’ll show you how to code an n Step SARSA agent from scratch.

n Step temporal difference learning is a sort of unifying theory of reinforcement learning that bridges the gap between Monte Carlo methods and temporal difference learning. We extend the agent’s horizon from a single step to n steps, and in the limit that n goes to the episode length we end up with Monte Carlo methods. For n = 1 we have vanilla temporal difference learning.

We’ll implement the n step SARSA algorithm directly from Sutton and Barto’s excellent reinforcement learning textbook, and use it to balance the cartpole from the Open AI gym 

The 5th Kind has a slightly alarmist, yet interesting, look at how AI will transform our lives, society, and the nature of what it means to be human.

As we become ever more reliant on cellular phones and devices to aid in our everyday tasks; rapid development into new technologies and Artificial Intelligence is underway at an alarming rate.

Modern devices are now specifically designed to interact with us in ways that mimic a real human being. Applications such as “siri” and “google-cast” are providing the user with a human-like interaction experience. These companies are Creating Artificially intelligent machines. Machines exhibiting cognitive behaviour, with human-like intelligence.

In this Documentary we explore the race to perfect AI machinery – researchers believe that very soon a “singularity” will be created. A machine that rises beyond human control. Something uncontrollable and irreversible, resulting in catastrophic changes to human civilization.  

It’s always fun to see what the “normies” think about what AI engineers are working on. Winking smile