Lex Fridman interviews Ilya Sutskever. co-founder of OpenAI.

Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic.

This conversation is part of the Artificial Intelligence podcast.

Time index:

  • 0:00 – Introduction
  • 2:23 – AlexNet paper and the ImageNet moment
  • 8:33 – Cost functions
  • 13:39 – Recurrent neural networks
  • 16:19 – Key ideas that led to success of deep learning
  • 19:57 – What’s harder to solve: language or vision?
  • 29:35 – We’re massively underestimating deep learning
  • 36:04 – Deep double descent
  • 41:20 – Backpropagation
  • 42:42 – Can neural networks be made to reason?
  • 50:35 – Long-term memory
  • 56:37 – Language models
  • 1:00:35 – GPT-2
  • 1:07:14 – Active learning
  • 1:08:52 – Staged release of AI systems
  • 1:13:41 – How to build AGI?
  • 1:25:00 – Question to AGI
  • 1:32:07 – Meaning of life

The powerful combination of NetCloud Edge Connector (https://aka.ms/iotshow/cradlepoint) and Microsoft Azure IoT Central enables customers to easily and confidently deploy IoT applications to drive business outcomes.

Optimizing operational efficiency, increasing customer satisfaction, and reducing CAPEX/OPEX for deployments are example benefits this solution can deliver.

NetCloud Edge Connector enables reliable and secure orchestration of IoT sensor data from Cradlepoint LTE edge routers to Microsoft Azure IoT Central. Now, Cradlepoint or Microsoft partners can easily build, deploy, and securely host IoT applications at scale for their customers driving IT/OT convergence.

Learn more reading Ken’s blog post at https://aka.ms/iotshow/cradlepoint