Category: Big Data

Motivating Entity Resolution for Data Science

Why Entity Resolution? Data is the new oil. Thus, analytical models are the new combustion engines. A combustion engine functions efficiently with good fuel. Similarly,...

An Introduction to Azure Synapse SQL

Evolution of Azure Synapse SQL Azure Synapse was previously known as Azure SQL Datawarehouse. With the re-branding to Synapse, Microsoft added many more layers on top of...

Azure Databricks source in PowerBI

Microsoft PowerBI isĀ  a great tool for Data Visualization. It can connect to a variety of sources. However, databases remain a popular data source. But, what if you...

Overview of the exam DP-900 : Azure Data Fundamentals

Motivating DP-900 : Azure Data Fundamentals Data Engineering is one of the fastest growing career opportunity for people aspiring a career in machine learning and AI....

Motivating Databricks Delta in Azure

Exploratory data analysis entails a lot of ad-hoc analysis. To do so, either they have to rely on databases or file systems like data lakes. Now, to analyze these...

Tutorial: Hierarchical Clustering in Spark with Bisecting K-Means

In the previous article, we covered the standard K-Means Clustering technique on Spark. Read that article here: Tutorial : K-Means Clustering on Spark. In this article,...

Tutorial : K-Means Clustering on Spark

Analytics is discovering insights using data. Traditionally, statistical and visual techniques dominated the field. But, with advances in Machine Learning and AI,...

Migrating from Azure Databricks to Azure Synapse Analytics

In the changing landscape of technology, new tools emerge. Azure Databricks has been a prominent option for end-to-end analytics in the Microsoft Azure stack. In 2019,...

Connect to Azure Storage from Azure Data Factory Integration runtime within Managed Virtual Network

We wrote an article introducing this feature when it was newly announced last year. In case you haven’t read it, here is the article link: Azure Data Factory...

Migrating from Azure Data Factory to Azure Synapse Integration

Did you think that it’s straightforward? I mean, did you think you can simply export the ARM template from Azure Data Factory and import it into Azure Synapse?...