Kashif Sohail – Medium

Kashif Sohail

Kashif Sohail

Real-time Airflow Alerts to Google Chat

Integrate airflow with Google Chat to send task status via callbacks

Jun 6, 2023

Real-time Airflow Alerts to Google Chat

Jun 6, 2023

Kashif Sohail

ETL Jobs Made Easy: Using Meltano to Extract from GitHub and Load into BigQuery

Meltano is an open-source platform that simplifies ETL jobs and provides an easy-to-use interface for data extraction, transformation, and…

Mar 6, 2023

ETL Jobs Made Easy: Using Meltano to Extract from GitHub and Load into BigQuery

Mar 6, 2023

Kashif Sohail

Export Query Result from BigQuery to Google Cloud Storage using Python

This tutorial guides you to programmatically export your query results to Google Cloud Storage.

Mar 2, 2023

Export Query Result from BigQuery to Google Cloud Storage using Python

Mar 2, 2023

Kashif Sohail

Dagster vs Airflow: Choosing the Right Workflow Management System

Workflow management systems are essential for data engineering and machine learning projects.

Feb 28, 2023

Dagster vs Airflow: Choosing the Right Workflow Management System

Feb 28, 2023

Kashif Sohail

Choosing the Right Data Management Tool: Comparing Apache Hudi and Delta Lake

Apache Hudi and Delta Lake are two open-source technologies designed to improve the performance and reliability of data lakes. While both…

Feb 25, 2023

Choosing the Right Data Management Tool: Comparing Apache Hudi and Delta Lake

Feb 25, 2023

Kashif Sohail

Get Free Microsoft Azure Certifications 2021

This post has discussed the easiest and hassle-free way to get free vouchers to attempt Microsoft Azure Certification and add credentials…

May 17, 2021

Get Free Microsoft Azure Certifications 2021

May 17, 2021

Kashif Sohail

Read files from Google Cloud Storage Bucket using local PySpark and Jupyter Notebooks

This tutorial is a step by step guide for reading files from google cloud storage bucket in locally hosted spark instance using PySpark…

Jun 28, 2020

Read files from Google Cloud Storage Bucket using local PySpark and Jupyter Notebooks

Jun 28, 2020

Kashif Sohail

How to read Compressed CSV files from S3 using local PySpark and Jupyter notebook

This tutorial is a step by step guide for configuring your Spark instance deployed on EC2 instance, virtual machine hosted in cloud or in…

Dec 9, 2019

How to read Compressed CSV files from S3 using local PySpark and Jupyter notebook

Dec 9, 2019

Kashif Sohail

Kashif Sohail

Data Engineer with more than 7 years of experience having exposure to fintech, contact center, music streaming, and ride-hail/delivery industries.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams