Category: Big Data
Running SQL queries in Azure Data Factory
PKDec 30, 2020
SQL is the backbone information science/technology. From a transactional database to data warehouse systems to modern big data analytics, none can escape SQL. Hence,...
Building Analytical System on Azure Data Lake Gen2
PKAug 31, 2020
We live in the world of Big Data and Analytics. It’s a fast-changing world with new technologies emerging at a fast pace. This pace has increased considerably with...
Why Process management is the need of the day
PKJun 18, 2020
Every problem brings an opportunity with it. The current times of COVID-19 pandemic are no exception to this. However, as far as organizations are concerned, it is a...
Azure Data Lake Gen2 and Azure Databricks
PKJun 13, 2020
Before Azure Data Lake Gen2 and Azure Databricks, In our previous articles, we elaborated about two aspects of Azure Data Lake Gen2 migration i.e. governance and...
Managing Azure Data Lake Gen2 with Powershell
PKMay 28, 2020
In the fast-moving world of data and technology in general, addressing tech debts is an integral part of any organization. It is important not only to stay ahead in the...
Cumulative Distribution in Azure Databricks using Spark SQL
PKMay 24, 2020
We can solve every problem in multiple ways. In our previous article, we motivated the need to fit cumulative distributions. Moreover, we demonstrated the same in Azure...
Cumulative Distribution in Azure Databricks
PKMay 03, 2020
Imagine that you receive a requirement to calculate the aggregations like average on a range of percentiles and quartiles, for a given dataset. There are two ways to...
Azure Data Lake Gen2 Managed Identity using Access Control Lists
PKApr 19, 2020
Firstly, we urge you to read this article of ours: Managed Identity between Azure Data Factory and Azure storage. In that article, we have extensively elaborated on...