Azure Data Factory is an amazingly powerful tool that can accomplish just about every ETL/ELT task.
In this video, Frank Liu shows how to use the Get Metadata activity to get a list of file names.
Considering shifting gears into Spark Data Engineering? We have another fun session with Simon Whiteley and Denny Lee as they answer your questions from their last two tech talks.
In this Data Point, Andy catches up with Manohar Punna at Difinity 2020 to talk about self-service BI tools.
Press the play button below to listen here or visit the show page at DataDriven.tv.
Data Lake Storage Gen 2 is the best storage solution for big data analytics in Azure. With its Hadoop compatible access, it is a perfect fit for existing platforms like Databricks, Cloudera, Hortonworks, Hadoop, HDInsight and many more. Take advantage of both blob storage and data lake in one service!
In this video, Azure 4 Everyone introduces to what Azure Data Lake Storage is, how it works and how can you leverage it in your big data workloads. I will also explain the differences between Blob and ADLS.
Sample code from demo: https://pastebin.com/ee7ULpwx
Next steps for you after watching the video
1. Azure Data Lake Storage documentation
2. Transform data using Databricks and ADLS demo tutorial
3. More on multi-protocol access
4. Read more on ACL