Applied Python Data Engineering Specialization

About Course

Applied Python Data Engineering Specialization, Learn how to use data engineering to leverage big data for business strategy, data analysis, or machine learning and AI. By completing this course series, you’ll empower yourself with the knowledge and proficiency required to build efficient data pipelines, manage cutting-edge platforms like Hadoop, Spark, Snowflake, Databricks, and Kubernetes, and tell stories with data through visualization. You will delve into foundational big data concepts, distributed computing with Spark, Snowflake’s architecture, Databricks’ machine learning capabilities, Python techniques for data visualization, and critical methodologies like DataOps.

This course series is designed for software engineers, developers, researchers, and data scientists who want to strengthen their specialization in data science or machine learning, as well as for professionals who are interested in pursuing a career as a data-focused software engineer, data scientist, or a data engineer working in cloud, machine learning, business intelligence, or other field. The Specialization features a capstone project focused on using Databricks’ API to replicate an existing project. This provides hands-on experience working with Databricks to build a portfolio-ready data solution. You will apply Python to a variety of data engineering tasks.

Create scalable big data pipelines (Hadoop, Spark, Snowflake, Databricks) for efficient data handling.
Build machine learning workflows (PySpark, MLFlow) on Databricks for seamless model development and deployment.
Implement DataOps/DevOps to streamline data engineering processes.
Formulate and communicate data-driven insights and narratives through impactful visualizations with Python and data storytelling

Course Content

01. Spark, Hadoop, and Snowflake for Data Engineering

001 01_welcome-to-data-engineering-platforms-with-python_instructions.html

00:00
004 02_meet-your-co-instructor-kennedy-behrman.mp4

00:00
007 03_meet-your-co-instructor-noah-gift.mp4

00:00
010 01_overview-of-big-data-platforms.mp4

00:00
011 02_big-data-platforms_quiz.html

00:00
014 03_getting-started-with-hadoop.mp4

00:00
015 04_what-is-apache-hadoop_instructions.html

00:00
016 05_apache-hadoop-concepts_quiz.html

00:00
019 06_getting-started-with-spark.mp4

00:00
020 07_what-is-apache-spark_cluster-overview.html

00:00
022 08_use-apache-spark-in-azure-databricks-optional_instructions.html

00:00
023 09_apache-spark-concepts_quiz.html

00:00
024 10_choosing-between-hadoop-and-spark_instructions.html

00:00
027 01_introduction-to-resilient-distributed-datasets-rdd.mp4

00:00
029 02_what-are-rdds_instructions.html

00:00
030 03_rdd-concepts_quiz.html

00:00
033 04_resilient-distributed-datasets-rdd-demo.mp4

00:00
034 05_getting-started-creating-rdd-s-with-pyspark_instructions.html

00:00
037 01_introduction-to-spark-sql.mp4

00:00
038 02_spark-sql-dataframes-and-datasets_instructions.html

00:00
041 03_spark-sql-concepts_quiz.html

00:00
042 04_pyspark-and-spark-sql_instructions.html

00:00
045 05_pyspark-dataframe-demo-part-1.mp4

00:00
048 06_pyspark-dataframe-demo-part-2.mp4

00:00
049 07_pyspark-dataframe-concepts_quiz.html

00:00
053 01_what-is-snowflake.mp4

00:00
054 02_accessing-snowflake_instructions.html

00:00
055 03_detailed-view-inside-snowflake_instructions.html

00:00
056 04_snowflake-architecture_quiz.html

00:00
059 05_snowflake-layers.mp4

00:00
060 06_snowflake-layers_quiz.html

00:00
063 07_snowflake-web-ui.mp4

00:00
066 01_navigating-snowflake.mp4

00:00
067 02_navigating-snowflake_quiz.html

00:00
068 03_snowsight-the-snowflake-web-interface_instructions.html

00:00
071 04_creating-a-table-in-snowflake.mp4

00:00
072 05_creating-a-table_quiz.html

00:00
073 06_working-with-warehouses_instructions.html

00:00
076 07_snowflake-warehouses.mp4

00:00
079 01_writing-to-snowflake.mp4

00:00
080 02_writing-to-snowflake_quiz.html

00:00
083 03_reading-from-snowflake.mp4

00:00
084 04_python-connector-documentation_instructions.html

00:00
085 01_snowflake_exam.html

00:00
089 02_accessing-databricks.mp4

00:00
092 03_spark-notebooks-with-databricks.mp4

00:00
095 04_using-data-with-databricks.mp4

00:00
098 05_working-with-workspaces-in-databricks.mp4

00:00
101 06_advanced-capabilities-of-databricks.mp4

00:00
102 07_pyspark-sql_quiz.html

00:00
103 01_introduction-to-databricks-machine-learning_instructions.html

00:00
106 02_pyspark-introduction-on-databricks.mp4

00:00
109 03_exploring-databricks-azure-features.mp4

00:00
110 04_what-is-the-databricks-file-system-dbfs_instructions.html

00:00
113 05_using-the-dbfs-to-automl-workflow.mp4

00:00
116 06_load-register-and-deploy-ml-models.mp4

00:00
117 07_serverless-compute-with-databricks_instructions.html

00:00
120 08_databricks-model-registry.mp4

00:00
123 09_model-serving-on-databricks.mp4

00:00
124 10_pyspark-dataframes_quiz.html

00:00
127 01_what-is-mlops.mp4

00:00
128 02_mlops-workflow-on-azure-databricks_instructions.html

00:00
131 03_exploring-open-source-mlflow-frameworks.mp4

00:00
134 04_running-mlflow-with-databricks.mp4

00:00
135 05_run-mlflow-projects-on-azure-databricks_instructions.html

00:00
138 06_end-to-end-databricks-mlflow.mp4

00:00
141 07_databricks-autologging-with-mlflow.mp4

00:00
142 08_databricks-autologging_instructions.html

00:00
143 09_mlflow-with-databricks_quiz.html

00:00
147 01_kaizen-methodology-for-data.mp4

00:00
148 02_kaizen-methodology_quiz.html

00:00
151 03_introducing-github-codespaces.mp4

00:00
152 04_github-codespaces-overview_instructions.html

00:00
155 05_compiling-python-in-github-codespaces.mp4

00:00
156 06_getting-started-with-amazon-sagemaker-studio-lab_instructions.html

00:00
159 07_walking-through-sagemaker-studio-lab.mp4

00:00
160 08_teaching-mlops-at-scale-with-github-optional_instructions.html

00:00
163 09_pytest-master-class-optional.mp4

00:00
166 01_what-is-devops.mp4

00:00
169 02_devops-key-concepts.mp4

00:00
170 03_getting-started-with-devops-and-cloud-computing_instructions.html

00:00
171 04_devops_quiz.html

00:00
174 05_continuous-integration-overview.mp4

00:00
177 06_build-an-nlp-in-cloud9-with-python.mp4

00:00
180 07_build-a-continuously-deployed-containerized-fastapi-microservice.mp4

00:00
183 08_hugo-continuous-deploy-on-aws.mp4

00:00
186 09_container-based-continuous-delivery.mp4

00:00
189 01_what-is-dataops.mp4

00:00
192 02_dataops-and-mlops-with-snowflake.mp4

00:00
193 03_dataops_quiz.html

00:00
196 04_building-cloud-pipelines-with-step-functions-and-lambda.mp4

00:00
199 05_what-is-a-data-lake.mp4

00:00
202 06_data-warehouse-vs-feature-store.mp4

00:00
205 07_big-data-challenges.mp4

00:00
208 08_types-of-big-data-processing.mp4

00:00
211 09_real-world-data-engineering-pipeline.mp4

00:00
214 10_data-feedback-loop.mp4

00:00
215 11_benefits-of-serverless-etl-technologies_instructions.html

00:00
216 01_dataops-and-operations-methodologies_exam.html

00:00
A-Detailed-View-Inside-Snowflake.pdf

00:00

02. Virtualization, Docker, and Kubernetes for Data Engineering

001 01_welcome-to-kubernetes-for-data-engineering-with-python_instructions.html

00:00
002 02_meet-your-instructors-noah-gift-and-kennedy-behrman_instructions.html

00:00
003 03_tools-and-platforms_instructions.html

00:00
004 01_what-is-virtualization_instructions.html

00:00
007 02_virtualization.mp4

00:00
008 03_virtualization_quiz.html

00:00
011 04_scaling-applications.mp4

00:00
012 05_scaling-applications_quiz.html

00:00
015 06_hardware-utilization.mp4

00:00
016 01_what-is-a-virtual-machine_instructions.html

00:00
019 02_introduction-to-virtual-machines.mp4

00:00
020 03_introduction-to-virtual-machines_quiz.html

00:00
023 04_virtual-box-demo.mp4

00:00
024 05_virtual-box_quiz.html

00:00
025 01_introduction-to-containers_instructions.html

00:00
028 02_container-concepts.mp4

00:00
029 03_containers_quiz.html

00:00
032 04_introduction-to-docker.mp4

00:00
033 05_docker-the-container-platform_instructions.html

00:00
034 06_introduction-to-docker_quiz.html

00:00
037 07_docker-architecture.mp4

00:00
038 08_docker-architecture_quiz.html

00:00
039 09_spin-up-a-local-docker-container_instructions.html

00:00
043 01_docker-client.mp4

00:00
044 02_use-the-docker-command-line_instructions.html

00:00
045 03_docker-client_quiz.html

00:00
048 04_creating-a-volume.mp4

00:00
049 05_volumes_quiz.html

00:00
052 06_running-a-database-in-a-container.mp4

00:00
053 07_running-a-database-in-a-container_quiz.html

00:00
056 01_building-an-image.mp4

00:00
057 02_building-an-image_quiz.html

00:00
060 03_dockerfiles.mp4

00:00
061 04_dockerfiles_quiz.html

00:00
062 05_creating-a-docker-image-step-by-step_instructions.html

00:00
065 06_dockerfile-examples.mp4

00:00
066 01_getting-started-with-docker-compose_instructions.html

00:00
069 02_orchestration-with-docker-compose.mp4

00:00
070 03_compose_quiz.html

00:00
073 04_introduction-to-airflow.mp4

00:00
074 05_getting-started-with-apache-airflow_instructions.html

00:00
076 06_airflow_quiz.html

00:00
079 07_airflow-demonstration-using-compose.mp4

00:00
080 08_docker-vs-kubernetes-a-primer_instructions.html

00:00
081 09_use-docker-to-spin-up-airflow_index.html

00:00
084 01_docker_exam.html

00:00
088 02_kubernetes-key-concepts.mp4

00:00
089 03_kubernetes-key-concepts_quiz.html

00:00
092 04_kubernetes-clusters.mp4

00:00
093 05_kubernetes-clusters_quiz.html

00:00
096 06_kubernetes-nodes.mp4

00:00
097 07_kubernetes-nodes_quiz.html

00:00
100 08_kubernetes-service-deployments.mp4

00:00
101 09_kubernetes-service-deployments_quiz.html

00:00
104 10_cloud-developer-workspace-advantage.mp4

00:00
105 11_virtualization-containerization-and-elasticity_instructions.html

00:00
108 01_key-concepts-in-the-github-ecosystem.mp4

00:00
111 02_using-github-templates.mp4

00:00
114 03_using-github-codespaces.mp4

00:00
117 04_using-openai-codewhisper.mp4

00:00
120 05_fine-tuning-a-model-with-hugging-face.mp4

00:00
121 06_fine-tune-a-pretrained-model_instructions.html

00:00
122 07_getting-started-with-github-copilot_instructions.html

00:00
125 08_using-github-copilot.mp4

00:00
128 09_github-actions.mp4

00:00
129 10_key-concepts-in-the-github-ecosystem_quiz.html

00:00
130 01_hello-minikube_instructions.html

00:00
133 02_running-minikube-in-github-codespaces.mp4

00:00
134 03_running-minikube-in-github-codespaces_quiz.html

00:00
137 04_deploying-a-service-with-minikube.mp4

00:00
138 05_deploying-a-service-with-minikube_quiz.html

00:00
139 06_minikube-kubernetes-a-recap_instructions.html

00:00
140 07_deploying-fastapi-to-aws-with-ecr-and-app-runner_instructions.html

00:00
144 01_build-a-tiny-bash-container-using-github-codespaces.mp4

00:00
145 02_build-a-tiny-bash-container-using-github-codespaces_quiz.html

00:00
148 03_build-fastapi-microservice-in-cloud9-in-python.mp4

00:00
149 04_build-fastapi-microservice-in-cloud9-in-python_quiz.html

00:00
152 05_deploy-a-fastapi-pytorch-containerized-application-to-aws-app-runner.mp4

00:00
153 06_deploying-a-fastapi-pytorch-containerized-application-to-aws-app-runner_quiz.html

00:00
154 07_using-container-registries-with-kubernetes-azure-container-registry-and-amazon_instructions.html

00:00
158 01_options-for-container-orchestration.mp4

00:00
159 02_options-for-container-orchestration_quiz.html

00:00
162 03_gcp-cloud-run.mp4

00:00
163 04_kubernetes-and-google-cloud_instructions.html

00:00
164 05_gcp-cloud-run_quiz.html

00:00
167 06_build-microservice-in-cloud9-in-c.mp4

00:00
168 07_build-microservice-in-cloud9-in-c_quiz.html

00:00
171 08_aws-copilot-command-line-interface-for-containerized-applications.mp4

00:00
172 09_deploying-containerized-applications-and-kubernetes-in-the-cloud-with-aws_getting-started-aws-copilot-cli.html

00:00
175 10_aws-copilot_quiz.html

00:00
178 01_load-testing-with-locust.mp4

00:00
179 02_load-testing-with-locust_quiz.html

00:00
182 03_monitoring-systems.mp4

00:00
183 04_monitoring-systems_quiz.html

00:00
186 05_sre-mindset-for-mlops.mp4

00:00
187 06_getting-started-with-site-reliability-engineering-sre_instructions.html

00:00
188 07_sre-mindset-for-mlops_quiz.html

00:00
191 08_operationalize-microservices.mp4

00:00
192 09_operationalize-microservices_quiz.html

00:00
195 10_ci-for-microservices.mp4

00:00
196 11_ci-for-microservices_quiz.html

00:00
199 12_what-is-continuous-delivery.mp4

00:00
200 13_continuous-delivery_quiz.html

00:00
201 14_continuous-delivery-of-fastapi-app-to-aws-app-runner_instructions.html

00:00
202 15_final-project-explained_instructions.html

00:00
203 01_kubernetes-data-engineering-solutions_exam.html

00:00
links.txt

00:00

03. Data Visualization with Python

001 01_course-structure_instructions.html

00:00
002 02_meet-your-instructor-matt-harrison_instructions.html

00:00
005 03_getting-started-with-data-visualization.mp4

00:00
006 04_common-plots-refresher_instructions.html

00:00
007 01_getting-ready-accessing-microsoft-excel_instructions.html

00:00
010 02_introduction-to-excel-for-visualization.mp4

00:00
013 03_creating-a-line-plot-in-excel.mp4

00:00
016 04_creating-a-histogram-in-excel.mp4

00:00
019 05_creating-a-scatterplot-in-excel.mp4

00:00
022 06_creating-a-bar-plot-in-excel.mp4

00:00
025 07_minimizing-clutter-in-visualizations.mp4

00:00
027 08_plotting-exercise-excel_instructions.html

00:00
028 01_getting-ready-accessing-google-sheets_instructions.html

00:00
031 02_introduction-to-sheets-for-visualization.mp4

00:00
034 03_creating-a-line-graph-in-sheets.mp4

00:00
037 04_creating-a-histogram-in-sheets.mp4

00:00
040 05_creating-a-scatterplot-in-sheets.mp4

00:00
043 06_creating-bar-plot-in-sheets.mp4

00:00
046 07_optimizing-color-for-visualizations.mp4

00:00
048 08_plotting-exercise-google-sheets_instructions.html

00:00
049 01_data-visualization-fundamentals-with-excel-and-sheets_exam.html

00:00
054 02_exploring-basic-plots.mp4

00:00
057 03_cleaning-your-data.mp4

00:00
060 04_creating-a-line-plot-with-pandas.mp4

00:00
063 05_creating-a-bar-plot-with-pandas.mp4

00:00
066 06_creating-a-scatterplot-with-pandas.mp4

00:00
069 07_creating-more-complicated-plots-with-pandas.mp4

00:00
072 08_creating-a-heatmap-with-pandas.mp4

00:00
075 09_creating-a-slope-graph-with-pandas.mp4

00:00
078 10_chaining-methods-with-pandas.mp4

00:00
079 11_pandas-resample-groupby-and-rolling-optional_instructions.html

00:00
081 12_plotting-exercise-pandas_install.html

00:00
083 01_getting-ready-installing-seaborn_instructions.html

00:00
086 02_introduction-to-the-seaborn-library.mp4

00:00
089 03_creating-a-line-plot-with-seaborn.mp4

00:00
092 04_creating-a-bar-plot-with-seaborn.mp4

00:00
095 05_creating-a-scatterplot-with-seaborn.mp4

00:00
098 06_creating-a-heatmap-with-seaborn.mp4

00:00
101 07_creating-a-slope-graph-with-seaborn.mp4

00:00
103 08_plotting-exercise-seaborn_installing.html

00:00
105 01_getting-ready-installing-matplotlib-libraries_instructions.html

00:00
108 02_introduction-to-matplotlib-in-python.mp4

00:00
111 03_customizing-text-with-matplotlib.mp4

00:00
114 04_customizing-color-with-matplotlib.mp4

00:00
117 05_customizing-axes-with-matplotlib.mp4

00:00
119 06_plotting-exercise-matplotlib_index.html

00:00
121 01_data-visualization-with-pandas-seaborn-and-matplotlib_exam.html

00:00
125 02_introduction-to-plotly.mp4

00:00
128 03_creating-a-line-plot-with-plotly.mp4

00:00
131 04_creating-a-bar-plot-with-plotly.mp4

00:00
134 05_creating-a-scatterplot-with-plotly.mp4

00:00
137 06_creating-a-heatmap-with-plotly.mp4

00:00
140 07_creating-a-slope-graph-with-plotly.mp4

00:00
142 08_plotting-exercise-plotly_instructions.html

00:00
143 01_getting-ready-accessing-dash_instructions.html

00:00
146 02_introduction-to-dash.mp4

00:00
149 03_creating-a-line-plot-with-dash.mp4

00:00
152 04_creating-a-bar-plot-with-dash.mp4

00:00
155 05_creating-a-scatterplot-with-dash.mp4

00:00
157 06_plotting-exercise-dash_instructions.html

00:00
158 01_getting-ready-accessing-streamlit_instructions.html

00:00
161 02_introduction-to-streamlit.mp4

00:00
164 03_creating-a-line-plot-with-streamlit.mp4

00:00
167 04_creating-a-bar-plot-with-streamlit.mp4

00:00
170 05_connecting-a-widget-to-a-plot-in-streamlit.mp4

00:00
173 06_creating-a-scatterplot-with-streamlit.mp4

00:00
175 07_plotting-exercise-streamlit_instructions.html

00:00
176 01_data-visualization-with-plotly-dash-and-streamlit_exam.html

00:00
180 02_introduction-to-tableau.mp4

00:00
183 03_creating-a-line-plot-with-tableau.mp4

00:00
186 04_creating-a-histogram-with-tableau.mp4

00:00
189 05_creating-a-scatterplot-with-tableau.mp4

00:00
192 06_creating-a-bar-plot-with-tableau.mp4

00:00
195 07_creating-a-plot-dashboard-in-tableau.mp4

00:00
198 08_tableau-summary.mp4

00:00
200 09_plotting-exercise-tableau_instructions.html

00:00
201 01_getting-ready-accessing-amazon-quicksight_instructions.html

00:00
204 02_introduction-to-quicksight.mp4

00:00
207 03_creating-a-new-dataset-in-quicksight.mp4

00:00
210 04_creating-a-line-plot-with-quicksight.mp4

00:00
213 05_creating-a-histogram-with-quicksight.mp4

00:00
216 06_creating-a-scatterplot-with-quicksight.mp4

00:00
219 07_creating-a-bar-plot-with-quicksight.mp4

00:00
222 08_sharing-your-plots-with-quicksight.mp4

00:00
224 09_plotting-exercise-quicksight_getting-started.html

00:00
226 01_visualization-with-cloud-based-tools-tableau-and-amazon-quicksight_exam.html

00:00
links.txt

00:00

Add this certificate to your resume to demonstrate your skills & increase your chances of getting noticed.

Student Ratings & Reviews

No Review Yet

About Course

What Will You Learn?

Course Content

01. Spark, Hadoop, and Snowflake for Data Engineering

001 01_welcome-to-data-engineering-platforms-with-python_instructions.html

004 02_meet-your-co-instructor-kennedy-behrman.mp4

007 03_meet-your-co-instructor-noah-gift.mp4

010 01_overview-of-big-data-platforms.mp4

011 02_big-data-platforms_quiz.html

014 03_getting-started-with-hadoop.mp4

015 04_what-is-apache-hadoop_instructions.html

016 05_apache-hadoop-concepts_quiz.html

019 06_getting-started-with-spark.mp4

020 07_what-is-apache-spark_cluster-overview.html

022 08_use-apache-spark-in-azure-databricks-optional_instructions.html

023 09_apache-spark-concepts_quiz.html

024 10_choosing-between-hadoop-and-spark_instructions.html

027 01_introduction-to-resilient-distributed-datasets-rdd.mp4

029 02_what-are-rdds_instructions.html

030 03_rdd-concepts_quiz.html

033 04_resilient-distributed-datasets-rdd-demo.mp4

034 05_getting-started-creating-rdd-s-with-pyspark_instructions.html

037 01_introduction-to-spark-sql.mp4

038 02_spark-sql-dataframes-and-datasets_instructions.html

041 03_spark-sql-concepts_quiz.html

042 04_pyspark-and-spark-sql_instructions.html

045 05_pyspark-dataframe-demo-part-1.mp4

048 06_pyspark-dataframe-demo-part-2.mp4

049 07_pyspark-dataframe-concepts_quiz.html

053 01_what-is-snowflake.mp4

054 02_accessing-snowflake_instructions.html

055 03_detailed-view-inside-snowflake_instructions.html

056 04_snowflake-architecture_quiz.html

059 05_snowflake-layers.mp4

060 06_snowflake-layers_quiz.html

063 07_snowflake-web-ui.mp4

066 01_navigating-snowflake.mp4

067 02_navigating-snowflake_quiz.html

068 03_snowsight-the-snowflake-web-interface_instructions.html

071 04_creating-a-table-in-snowflake.mp4

072 05_creating-a-table_quiz.html

073 06_working-with-warehouses_instructions.html

076 07_snowflake-warehouses.mp4

079 01_writing-to-snowflake.mp4

080 02_writing-to-snowflake_quiz.html

083 03_reading-from-snowflake.mp4

084 04_python-connector-documentation_instructions.html

085 01_snowflake_exam.html

089 02_accessing-databricks.mp4

092 03_spark-notebooks-with-databricks.mp4

095 04_using-data-with-databricks.mp4

098 05_working-with-workspaces-in-databricks.mp4

101 06_advanced-capabilities-of-databricks.mp4

102 07_pyspark-sql_quiz.html

103 01_introduction-to-databricks-machine-learning_instructions.html

106 02_pyspark-introduction-on-databricks.mp4

109 03_exploring-databricks-azure-features.mp4

110 04_what-is-the-databricks-file-system-dbfs_instructions.html

113 05_using-the-dbfs-to-automl-workflow.mp4

116 06_load-register-and-deploy-ml-models.mp4

117 07_serverless-compute-with-databricks_instructions.html

120 08_databricks-model-registry.mp4

123 09_model-serving-on-databricks.mp4

124 10_pyspark-dataframes_quiz.html

127 01_what-is-mlops.mp4

128 02_mlops-workflow-on-azure-databricks_instructions.html

131 03_exploring-open-source-mlflow-frameworks.mp4

134 04_running-mlflow-with-databricks.mp4

135 05_run-mlflow-projects-on-azure-databricks_instructions.html

138 06_end-to-end-databricks-mlflow.mp4

141 07_databricks-autologging-with-mlflow.mp4

142 08_databricks-autologging_instructions.html

143 09_mlflow-with-databricks_quiz.html

147 01_kaizen-methodology-for-data.mp4

148 02_kaizen-methodology_quiz.html

151 03_introducing-github-codespaces.mp4

152 04_github-codespaces-overview_instructions.html

155 05_compiling-python-in-github-codespaces.mp4

156 06_getting-started-with-amazon-sagemaker-studio-lab_instructions.html

159 07_walking-through-sagemaker-studio-lab.mp4