Lambda Architecture in the Cloud with Azure Databricks

Lambda Architecture in the Cloud with Azure Databricks

In this talk, Andrei Varanoch demonstrates the blueprint for such a Lambda Architecture implementation in Microsoft Azure, with Azure Databricks — a PaaS Spark offering... Details
The What, Why & How of Azure Databricks

The What, Why & How of Azure Databricks

In this video, Dinesh Priyankara explains Azure Databricks, why and where it should be used and how to start with it. it speaks about modern... Details
Ingesting data with Azure Databricks & Azure SQL Data Warehouse

Ingesting data with Azure Databricks & Azure SQL Data Warehouse

In this video, learn how to ingest data using Azure Databricks in Azure SQL Data Warehouse to speed up your data pipeline and get more... Details
Leveraging HPC to Accelerate Virtual Drug Screening

Leveraging HPC to Accelerate Virtual Drug Screening

Here's another story of how big data and high performance computing and TensorFlow is reshaping medicine as we know it. Virtual drug screening has the... Details
LinkedIn Open Sources a Tool that Formats Big Data for TensorFlow

LinkedIn Open Sources a Tool that Formats Big Data for TensorFlow

LinkedIn has just open sourced a tool it created to convert Apache Spark-based big data into a format that can be readily consumed by TensorFlow.... Details
Apache Spark Turns 10: The Secret Sauce Behind One Of The World’s Most Popular Open Source Projects

Apache Spark Turns 10

As Apache Spark is 10 years old. This article in Analytics India Magazine explores what led to Spark's widespread adoption and what will keep it... Details
Microsoft: This is world's first automated DNA data storage, retrieval system

The World’s First Automated DNA Data Storage, Retrieval System

With data storage demands increasing every day, conventional storage will not be enough in the future. Enter DNA-based storage, with its ability to store information... Details
How Data Harvesting Really Works

How Data Harvesting Really Works

Here’s an interesting (and chilling) look at the business models of the big technology companies. If data is the new oil, then Big Tech is... Details
Data Science Is Now Bigger Than 'Big Data'

Data Science Is Now Bigger Than “Big Data”

Forbes points out that the term "Big Data" has been eclipsed by "Data Science" in the hype cycle. However, the Great Hype Cycle resembles Game... Details
Rerun Activities Inside Azure Data Factory Pipelines

Rerun Activities Inside Azure Data Factory Pipelines

Data integration is complex with many moving parts. It helps organizations to combine data and complex business processes in hybrid data environments. Failures are very... Details