Machine Learning with Phil has got another interesting look at Deep Q Learning as part of a preview of his course.

The two biggest innovations in deep Q learning were the introduction of the target network and the replay memory. One would think that simply bolting a deep neural network to the Q learning algorithm would be enough for a robust deep Q learning agent, but that isn’t the case. In this video I’ll show you how this naive implementation of the deep q learning agent fails, and spectacularly at that.

This is an excerpt from my new course, Deep Q Learning From Paper to Code which you can get on sale with this link

https://www.udemy.com/course/deep-q-learning-from-paper-to-code/?couponCode=CYBERMONDAY19

Microsoft Research marks its 100th episode with with Gurdeep Pall and Dr. Ashish Kapoor talking about autonomous systems.

There’s a lot of excitement around self-driving cars, delivery drones, and other intelligent, autonomous systems, but before they can be deployed at scale, they need to be both reliable and safe. That’s why Gurdeep Pall, CVP of Business AI at Microsoft, and Dr. Ashish Kapoor, who leads research in Aerial Informatics and Robotics, are using a simulated environment called AirSim to reduce the time, cost and risk of the testing necessary to get autonomous agents ready for the open world. 

See more on this and other Microsoft Research podcast episodes:
https://www.microsoft.com/en-us/research/blog/category/podcast/

Lex Fridman keeps landing the “big fish” on his podcast.

This time, he sits down with Noam Chomsky.

Noam Chomsky is one of the greatest minds of our time and is one of the most cited scholars in history. He is a linguist, philosopher, cognitive scientist, historian, social critic, and political activist. He has spent over 60 years at MIT and recently also joined the University of Arizona. This conversation is part of the Artificial Intelligence podcast. 

Here’s a great walkthrough of how to create a docker image that exclusively uses a custom model to run predictions and returns back the result.

This provides context isolation for the application running the model and avoids any non-reproducibility issue.

When dealing with python versioning you can easily get lost with all the possible combinations of your favorite library version, and the versions of the interpreter. Many different projects, specially the ones involving Tensorflow and Keras, require a very specific library version to run. Many other projects are not […]

As millions of Americans hit the roads today for Thanksgiving travel, I wonder how different it would be if self-driving cars were the norm.

CNBC explores the current state of self-driving cars.

More companies are trying to bring self-driving cars to the masses than ever before, but a truly autonomous vehicle still doesn’t exist. It’s not clear if, or when, our driverless future will arrive. Where exactly are we with self-driving cars, and when can we expect them to be a part of our daily lives? 

Learn how you can publish your SaaS solution and start generating revenue by making it available to potential buyers on Microsoft AppSource and Azure Marketplace.

Ercenk Keresteci joins Scott Hanselman to cover the technical details of integrating a solution with Microsoft’s commercial marketplace, including how to use scripts for provisioning and de-provisioning a customer.

Related Links: