Siraj Raval explores why does a computer algorithm classify an image the way that it does? This is a question that is critical when it comes to AI applied to diagnostics, driving, or any other form of critical decision making.

In this video, he raises awareness around one technique in particular that I found called “Grad-Cam” or Gradient Class Activation Mappings.

Siraj Raval has a video exploring a paper about genomics and creating reliable machine learning systems.

Deep learning classifiers make the ladies (and gentlemen) swoon, but they often classify novel data that’s not in the training set incorrectly with high confidence. This has serious real world consequences! In Medicine, this could mean misdiagnosing a patient. In autonomous vehicles, this could mean ignoring a stop sign. Machines are increasingly tasked with making life or death decisions like that, so it’s important that we figure out how to correct this problem! I found a new, relatively obscure yet extremely fascinating paper out of Google Research that tackles this problem head on. In this episode, I’ll explain the work of these researchers, we’ll write some code, do some math, do some visualizations, and by the end I’ll freestyle rap about AI and genomics. I had a lot of fun making this, so I hope you enjoy it!

Likelihood Ratios for Out-of-Distribution Detection paper: https://arxiv.org/pdf/1906.02845.pdf 

The researcher’s code: https://github.com/google-research/google-research/tree/master/genomics_ood

Siraj Raval gets back to inspiring people to get into AI and pokes fun at himself.

Almost exactly 4 years ago I decided to dedicate my life to helping educate the world on Artificial Intelligence. There were hardly any resources designed for absolute beginners and the field was dominated by PhDs. In 2020, thanks to the extraordinary contributions of everyone in this community, all that has changed. It’s easier than ever before to enter into this field, even without an IT background. We’ve seen brave entrepreneurs figure out how to deploy this technology to save lives (medical imaging, automated diagnosis) and accelerate Science (AlphaFold). We’ve seen algorithmic advances (deepfakes) and ethical controversies (automated surveillance) that shocked the world. The AI field is now a global, cross-cultural movement that’s not limited to academics alone. And that’s something all of us should be proud of, we’re all apart of this. I’ve packed a lot into this episode! I’ll give my annual lists of the best ML language and libraries to learn this year, how to learn ML in 2020, as well as 8 predictions about where this field is headed. I had a lot of fun making this, so I hope you enjoy it!

Siraj Raval shows off examples of machine learning apps from his students.

If you’re wondering about my stance on the recent controversies around Siraj, I recorded a Data Point about that.

Machine Learning powers almost every internet service we use these days, but it’s rare to find a full pipeline example of machine learning being deployed in a web app. In this episode, I’d like to present 5 full-stack machine learning demos submitted as midterm projects from the students of my current course. The midterm assignment was to create a paid machine learning web app, and after receiving countless incredible submissions, I’ve decided to share my favorite 5 publicly. I was surprised by how many students in the course had never coded before and to see them building a full-stack web app in a few weeks was a very fulfilling experience. Use these examples as a template to help you ideate on potential business ideas to make a positive impact in the world using machine learning. And if you’d like, be sure to reach out and support each of the students I’ve demoed here today in any way can you offer. They’ve been working their butts off. Enjoy!

Presentation notebook: https://colab.research.google.com/drive/1m5aLHPnwIhVX8zgMvZUtK4iG9xSaMbk8

Siraj Raval covers Google’s claim to have achieved Quantum Supremacy in a research paper that was briefly leaked on a NASA website.

The paper was taken down, but the Internet moves fast to recover data.

In this episode, Siraj explores what quantum supremacy means, what the applications of quantum computing will be, and how a quantum-resistant cryptographic technique called “A New Hope” works.

Related Links

Google’s Quantum Supremacy paper:
https://drive.google.com/file/d/19lv8p1fB47z1pEZVlfDXhop082Lc-kdD/view

D-Wave API:
https://www.dwavesys.com/take-leap

IBM Q:
https://www.ibm.com/quantum-computing/network/overview/

Quantum Machine Learning:
https://www.youtube.com/watch?v=DmzWsvb-Un4 

Quantum Computing with D-Wave:
https://www.youtube.com/watch?v=bSw-wcB6GZw

Quantum Machine Learning Live:
https://www.youtube.com/watch?v=AAO4oq2M_48

The Neural Qubit:
https://www.youtube.com/watch?v=h9jC_V7ojqo

An amazing blog by Scott Aaronson on Quantum Supremacy:
https://www.scottaaronson.com/blog/?p=4317

A curated list of quantum computing learning resources:
https://github.com/desireevl/awesome-quantum-computing

Ring Learning with Errors Blog post:
https://medium.com/asecuritysite-when-bob-met-alice/learning-with-errors-and-ring-learning-with-errors-23516a502406

Quantum Encryption:
https://pqcrypto.org/index.html

Siraj Raval  interviews Vinod Khosla in the latest edition of his podcast.

Vinod Khosla is an Entrepreneur, Venture Capitalist, and Philanthropist. It was an honor to have a conversation with the Silicon Valley legend that I’ve admired for many years. Vinod co-founded Sun Microsystems over 30 years ago, a company that grew to over 36,000 employees and invented so much foundational software technology like the Java programming language, NFS, and they pretty much mainstreamed the ‘idea’ of open source. After a successful exit, he’s been using his billionaire status to invest in ambitious technologists trying to improve human life. He’s got the coolest investment portfolio I’ve seen yet, and in this hour long interview we discuss everything from AI to education to startup culture. I know that my microphone volume should be higher in this one, I’ll fix that the next podcast. Enjoy!

Show Notes:

Time markers of our discussion topics below:

2:55 The Future of Education
4:36 Vinod’s Dream of an AI Tutor
5:50 Vinod Offers Siraj a Job
6:35 Choose your Teacher with DeepFakes
8:04 Mathematical Models
9:10 Books Vinod Loves
11:00 What is Learning?
14:00 The Flaws of Liberal Arts Degrees
16:10 Indian Culture
21:11 A Day in the Life of Vinod Khosla
23:50 Valuing Brutal Honesty
24:30 Distributed File Storage
30:30 Where are we Headed?
33:32 Vinod on Nick Bostrom
38:00 Vinod’s Rockstar Recruiting Ability
43:00 The Next Industries to Disrupt
49:00 Vinod Offers Siraj Funding for an AI Tutor
51:48 Virtual Reality
52:00 Contrarian Beliefs
54:00 Vinod’s Love of Learning
55:30 USA vs China

Vinod’s ‘Awesome’ Video:
https://www.youtube.com/watch?v=STtAsDCKEck

Khosla Ventures Blog posts:
https://www.khoslaventures.com/blog/all

Books we discussed:

Scale by Geoffrey West:
https://amzn.to/2rs7UV7

Factfulness by Hans Roesling:
https://amzn.to/2GHUlgg

Mindset by Carol Dwicke:
https://amzn.to/2icCNey

36 Dramatic Situations by Mike Figgis:
https://amzn.to/2ol14Vi

Sapiens by Yuval Noah Harari:
https://amzn.to/2amA7J5

21 Lessons for the 21st Century by Yuval Noah Harari:
https://amzn.to/2PKIJZY
 
The Third Pillar by Raghuram R:
https://bit.ly/2ASU98K

Zero to One by Peter Thiel:
https://amzn.to/2ae3NTM

Siraj Raval just posted this video on defending AI against adversarial attacks

Machine Learning technology isn’t perfect, it’s vulnerable to many different types of attacks! In this episode, I’ll explain 2 common types of attacks and 2 common types of defenses using various code demos from across the Web. There’s some really dope mathematics involved with adversarial attacks, and it was a lot of fun reading about the ‘cat and mouse’ game between new attack techniques, followed by new defense techniques. I encourage anyone new to the field who finds this stuff interesting to learn more about it. I definitely plan to. Let’s look into some math, code, and examples. Enjoy!

Slideshow for this video:
https://colab.research.google.com/drive/19N9VWTukXTPUj9eukeie55XIu3HKR5TT

Demo project:
https://github.com/jaxball/advis.js

 

Siraj Raval explores generative modeling technology.

This innovation is changing the face of the Internet as you read this. It’s now possible to design automated systems that can write novels, act as talking heads in videos, and compose music.

In this episode, Siraj explains how generative modeling works by demoing 3 examples that you can try yourself in your web browser.