Tag: Apache Spark, azure databricks, pyspark, Python Pandas
Databricks Koalas: bridge between pandas and spark
Imagine that you are an ML engineer. You have a massive task of operationalizing a model trained and tested by your Data Scientists. It is working perfectly well for the...
Log Analytics with Python Pandas Explode
Prologue to Analytics with Python I strongly recommend reading this article before you go ahead with this article: Log Analytics using STRING_SPLIT function. This...
Spark Dataframe performance benefits
Before we move to Spark Dataframes and its benefits, it is imperative to look at the concept of Dataframe. A Dataframe is based on the concept of a statistical table. It...