How far can you go with ONLY language modeling?

Can a large enough language model perform NLP task out of the box?

OpenAI take on these and other questions by training a transformer that is an order of magnitude larger than anything that has ever been built before and the results are astounding.

Yannic Kilcher explores.

Paper

Time index:

  • 0:00 – Intro & Overview
  • 1:20 – Language Models
  • 2:45 – Language Modeling Datasets
  • 3:20 – Model Size
  • 5:35 – Transformer Models
  • 7:25 – Fine Tuning
  • 10:15 – In-Context Learning
  • 17:15 – Start of Experimental Results
  • 19:10 – Question Answering
  • 23:10 – What I think is happening
  • 28:50 – Translation
  • 31:30 – Winograd Schemes
  • 33:00 – Commonsense Reasoning
  • 37:00 – Reading Comprehension
  • 37:30 – SuperGLUE
  • 40:40 – NLI
  • 41:40 – Arithmetic Expressions
  • 48:30 – Word Unscrambling
  • 50:30 – SAT Analogies
  • 52:10 – News Article Generation
  • 58:10 – Made-up Words
  • 1:01:10 – Training Set Contamination
  • 1:03:10 – Task Exampleshttps://arxiv.org/abs/2005.14165
    https://github.com/openai/gpt-3

In this video, Emily Lisa and Anna Hoffman discuss how to make a database zone redundant in Azure SQL, and the High Availability benefits of the zone redundant configuration.

Content index:

  • [00:47] What is an availability zone?
  • [01:25] How does it relate to Azure SQL?
  • [02:14] Regions that support Availability Zones
  • [03:10] Demo to Enable Zone Redundant Configuration
  • [04:10] How it affects SLAs

In the second part of this two-part video segment, Rohit Nayak dives deeper into the new capabilities for Azure SQL Database for Private Endpoints.

Be sure to watch the first episode to understand what Private Endpoint for Azure SQL Database.

Time index:

  • [01:09] Set-up
  • [02:00] Demo: How to connect from Public IP Address to Private Endpoint
  • [08:36] Connecting Client VM to SQL Database with a Private Endpoint
  • [10:45] How to check your deployment succeeded
  • [14:08] Now that you created a Private IP Address, can you login to the IP Address itself?
  • [15:50] Double-checking on another machine
  • [16:30] 3 key takeaways

Speaking of NVIDIA, Microsoft Developer takes a look at the latest device in the NVIDIA Jetson line of GPU-accelerated IoT devices, the Jetson Xavier NX.

A device which brings supercomputer-class performance to Edge applications in an ultra-compact form-factor.

To demonstrate this, we configure the device with Azure IoT Edge and deploy the NVIDIA DeepStream SDK Module from the Azure Marketplace to produce object detection telemetry with Azure Stream Analytics then push those results into Time Series Insights and Power BI.

Come see how the pairing of NVIDIA devices and Azure IoT Services make for a first-class solution of AI at the Edge!

Learn more about NVIDIA DeepStream on IoT Edge: https://aka.ms/iotshow/NVIDIADeepStream

In BlueGranite’s recent webinar, you will see several examples of Python in action for data modeling and visualization in Power BI. You will also learn where and how Python fits into a Power BI development workflow.

You’ll also see how to balance Python with native Power BI functionality and determine what limitations must be considered when using Python in Power BI.

The powerful combination of NetCloud Edge Connector (https://aka.ms/iotshow/cradlepoint) and Microsoft Azure IoT Central enables customers to easily and confidently deploy IoT applications to drive business outcomes.

Optimizing operational efficiency, increasing customer satisfaction, and reducing CAPEX/OPEX for deployments are example benefits this solution can deliver.

NetCloud Edge Connector enables reliable and secure orchestration of IoT sensor data from Cradlepoint LTE edge routers to Microsoft Azure IoT Central. Now, Cradlepoint or Microsoft partners can easily build, deploy, and securely host IoT applications at scale for their customers driving IT/OT convergence.

Learn more reading Ken’s blog post at https://aka.ms/iotshow/cradlepoint

In this episode, Robert is joined by Caity Buschlen and Aaron Mast, who show us the resources available as part of Visual Studio subscriptions, including developer tools, cloud services and training.

For more information, visit https://aka.ms/vssubstoolbox.

Additional resources: