Category: Information Systems

Cumulative Distribution in Azure Databricks using Spark SQL

We can solve every problem in multiple ways. In our previous article, we motivated the need to fit cumulative distributions. Moreover, we demonstrated the same in Azure...

Azure Data Lake Gen2 Managed Identity using Access Control Lists

Firstly, we urge you to read this article of ours: Managed Identity between Azure Data Factory and Azure storage. In that article, we have extensively elaborated on...

Challenges in Modern Data Processing

Having spent 5 years in the space of Data Analytics, I have come across a few challenges that might hamper an organization’s efforts to mature as a Data-Driven...

Conditional formatting in PowerBI

It is a classic saying that a picture is better than thousand words. Therefore, an entire discipline of data visualization stands on this statement, since humans prefer...

A first look at Azure Synapse Analytics

Strongly recommended reading: Azure Synapse Analytics: Azure SQL Data Warehouse revamped In the aforementioned article, we gave an introduction to Azure Synapse...

Introducing Azure Data Factory Data Flows

They say that life comes full circle i.e. you start and end at the same point. However, in my humble opinion, that is not true. Life is like an unending spiral. You do...

Managed Identity between Azure Data Factory and Azure storage

Last month Microsoft announced that Data Factory is now a ‘Trusted Service’ in Azure Storage and Azure Key Vault firewall. Accordingly, Data Factory can...

Introduction to SSIS and making it metadata independent

Introducing SSIS In the Microsoft Sql Server Integration services (SSIS), we have a variety of tasks to perform ETL. However, with changing data landscape and newer...

Azure Synapse Analytics: Azure SQL Data Warehouse revamped

Prologue On 5th November 2019, I read an early morning announcement of Azure Synapse Analytics. It was formerly known as Azure SQL Data warehouse. This announcement took...

Lambda Architecture with Azure Databricks

Introducing Lambda Architecture It is imperative to know what is a Lambda Architecture, before jumping into Azure Databricks. The greek symbol lambda(λ) signifies...