In this video, Chris Seferlis continues discussing the Modern Data Platform in Azure with Part 3: Data Processing.

Tools Discusssed:

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs. All of this leverages our limitless Azure Data Lake Storage service for any type of data.

Microsoft Mechanics explains.

Data engineering is about 70% of any data pipeline today, and without having the experience to implement a data engineering pipeline well, there is no value to be accumulated from your data.
In this session from Microsoft Ignite we discuss the best practices and demonstrate how a data engineer can develop and orchestrate the big data pipeline, including: data ingestion and orchestration using Azure Data Factory; data curation, cleansing and transformation using Azure Databricks; data loading into Azure SQL Data Warehouse for serving your BI tools.
Watch and learn how to effectively do the ETL/ELT process combined with advanced capabilities such as monitoring the jobs, getting alerts, jobs retrial, set permissions, and much more.

The latest episode of Data Exposed welcomes Alan Yu, a PM in the SQL Server engineering group focusing on SQL Tools. He shows off the latest SQL Server Management Studio 17.3 update.

Alan starts off by highlighting two new features in the latest release: Import Flat File Wizard and XEvent Profiler. Import Flat File Wizard is a new tool that helps streamline the import experience for a user who wants to import .csv or .txt files without specialized domain knowledge. The XEvent profiler is a live viewer window of extended events that can be quickly launched. For the purpose of this demo, Alan chose to focus on showcasing the Import Flat File Wizard.

To learn more about SSMS 17.3, check out this blog post: https://blogs.technet.microsoft.com/dataplatforminsider/2017/10/10/whats-new-in-sql-server-management-studio-17-3/

 

Download the latest version of SSMS: https://docs.microsoft.com/en-us/sql/ssms/download-sql-server-management-studio-ssms

 

To learn more about PROSE, check out: https://microsoft.github.io/prose/