Inside Bill’s Brain: revisiting the documentary
Prasad KulkarniOct 31, 2019
What’s Inside Bill’s Brain? One such winner is Bill Gates. ‘Inside Bill’s Brain: Decoding Bill Gates’ is a Netflix docuseries which brings...
Lambda Architecture with Azure Databricks
Prasad KulkarniOct 22, 2019
Introducing Lambda Architecture It is imperative to know what is a Lambda Architecture, before jumping into Azure Databricks. The greek symbol lambda(λ) signifies...
Comparing SSIS Lookup and SQL Joins
Prasad KulkarniOct 09, 2019
Motivating SSIS lookups Denormalization is the most important step to create a Data warehouse. Fundamentally, we do so to populate surrogate key of a dimension in a fact...
Is Artificial Intelligence a threat to Software Engineers?
Prasad KulkarniSep 25, 2019
The fear of the singularity Every threat is an opportunity The Forbes magazine article Software Ate The World, Now AI Is Eating Software reminded me of the movie...
Log Analytics with Python Pandas Explode
Prasad KulkarniSep 18, 2019
Prologue to Analytics with Python I strongly recommend reading this article before you go ahead with this article: Log Analytics using STRING_SPLIT function. This...
What is a Data Hub: Concepts and Guidelines
Prasad KulkarniSep 08, 2019
The V’s of Big Data: Before Data Hub Life was simple when we restricted ourselves to spreadsheets and relational data stores. Data was structured, databases were...
Azure Logic App deployment process with Powershell
Prasad KulkarniAug 21, 2019
Prologue A software product goes through three broad phases viz. development, testing and deployment. The last phase can be approached in multiple ways. One of the ways...
Making ADF Web activity synchronous with Logic App
Prasad KulkarniAug 18, 2019
Prologue It is a common scenario in ETL jobs to send Email Notifications. With Azure Data Factory, such an example can be found in this article. Accordingly, we use web...
Log Analytics using STRING_SPLIT function
Prasad KulkarniAug 14, 2019
Motivating Log Analytics Being a Data Engineer comes with its own set of challenges and opportunities since 80 per cent time is spent on cleaning and munging the raw...
Move Files with Azure Data Factory- End to End
Prasad KulkarniAug 06, 2019
Pre-requisite In the first part of this series, we focused on moving a single file from one blob location to another using ADF. Here is the link for the first part: Move...