PK
Who are ML Engineers?
The Harvard Business Review article ‘Data Scientist: The Sexiest Job of the 21st Century‘ created a ripple across the industry. Naturally, everyone began...
Databricks Koalas: bridge between pandas and spark
Imagine that you are an ML engineer. You have a massive task of operationalizing a model trained and tested by your Data Scientists. It is working perfectly well for the...
Conditional formatting in PowerBI
It is a classic saying that a picture is better than thousand words. Therefore, an entire discipline of data visualization stands on this statement, since humans prefer...
Knowing when to consider Machine Learning
A Data Scientist is the one who not only knows how to use machine learning but the one who knows when to avoid it. Today, I will stand on the shoulder of a giant i.e....
Python Numpy array: Matrix Multiplication, copies and views
It is always beautiful to see similarities in different programming/ query languages. But, it is intuitive, since the fundamentals remain the same. In this article, we...
Nuances of identifying Palindrome with Python Strings
One of the introductory examples in the world of programming the algorithm to identify Palindrome strings. Being the most widely used language, python is no exception to...
How to read mismatched schema in apache spark
In today’s world, python dominates the data analysis space, while apache-spark rules the big data paradigm. The former contains a plethora of libraries like pandas...
A first look at Azure Synapse Analytics
Strongly recommended reading: Azure Synapse Analytics: Azure SQL Data Warehouse revamped In the aforementioned article, we gave an introduction to Azure Synapse...
Introducing Azure Data Factory Data Flows
They say that life comes full circle i.e. you start and end at the same point. However, in my humble opinion, that is not true. Life is like an unending spiral. You do...
Managed Identity between Azure Data Factory and Azure storage
Last month Microsoft announced that Data Factory is now a ‘Trusted Service’ in Azure Storage and Azure Key Vault firewall. Accordingly, Data Factory can...