Category: Big Data
Challenges in Modern Data Processing
PKApr 06, 2020
Having spent 5 years in the space of Data Analytics, I have come across a few challenges that might hamper an organization’s efforts to mature as a Data-Driven...
Why Databricks is gaining popularity?
PKApr 04, 2020
In February 2020, Gartner released its magic chart for Data Science. A pleasant surprise, however, was to see Databricks amongst the leaders. Interestingly, it made a...
A first look at Azure Synapse Analytics
PKDec 10, 2019
Strongly recommended reading: Azure Synapse Analytics: Azure SQL Data Warehouse revamped In the aforementioned article, we gave an introduction to Azure Synapse...
Introducing Azure Data Factory Data Flows
PKDec 04, 2019
They say that life comes full circle i.e. you start and end at the same point. However, in my humble opinion, that is not true. Life is like an unending spiral. You do...
Managed Identity between Azure Data Factory and Azure storage
PKNov 28, 2019
Last month Microsoft announced that Data Factory is now a ‘Trusted Service’ in Azure Storage and Azure Key Vault firewall. Accordingly, Data Factory can...
Azure Synapse Analytics: Azure SQL Data Warehouse revamped
PKNov 05, 2019
Prologue On 5th November 2019, I read an early morning announcement of Azure Synapse Analytics. It was formerly known as Azure SQL Data warehouse. This announcement took...
Lambda Architecture with Azure Databricks
PKOct 22, 2019
Introducing Lambda Architecture It is imperative to know what is a Lambda Architecture, before jumping into Azure Databricks. The greek symbol lambda(λ) signifies...