Python, Bash and SQL Essentials for Data Engineering Specialization

About Course

Python, Bash and SQL Essentials for Data Engineering Specialization, If you are interested in developing the skills needed to be a data engineer, the Python, Bash and SQL Essentials for Data Engineering Specialization is a great place to start. We live in a world that is driven by big data – from what we search online to the route we take to our favorite restaurant, and everything in between. Businesses and organizations use this data to make decisions that impact the ways in which we navigate our lives. How do engineers collect this data? How can this data be organized so that it can be appropriately analyzed? A data engineer is specialized in this initial step of accessing, cleaning and managing big data.

Data engineers today need a solid foundation in a few essential areas: Python, Bash and SQL. In Python, Bash and SQL Essentials for Data Engineering, we provide a nuts and bolts overview of these fundamental skills needed for entering the world of data engineering. Led by three professional data engineers, this Specialization will provide quick and accessible ways to learn data engineering strategies, give you a chance to practice what you’ve learned in integrated lab exercises, and then immediately apply these techniques in your professional or academic life.

Each course includes integrated lab exercises using Visual Studio Code or Jupyter notebooks that give you an opportunity to practice the Python, Bash and SQL skills with real-world applications covered in each course. For each data engineering solution that you explore, you are also encouraged to create a demo video and GitHub repository of code that can be showcased in your digital portfolio for employers. By the end of this Specialization, you will have the foundational skills necessary to begin tackling more complex data engineering solutions.

Course Content

01. Python and Pandas for Data Engineering

003 01_overview-of-python-bash-and-sql-essentials-for-data-engineering.mp4

00:00
007 02_meet-your-supporting-instructors-alfredo-deza-and-noah-gift_instructions.html

00:00
008 03_course-structure-and-discussion-etiquette_instructions.html

00:00
011 04_overview-of-key-concepts.mp4

00:00
012 05_getting-started-and-best-practices_instructions.html

00:00
015 01_introduction-to-setting-up-your-python-environment.mp4

00:00
018 02_installing-packages-with-pip-in-python.mp4

00:00
021 03_saving-requirements-file-in-python.mp4

00:00
024 04_creating-and-using-a-python-virtual-environment.mp4

00:00
027 01_expression-statements-in-python.mp4

00:00
030 02_assignment-statements-in-python.mp4

00:00
031 03_assignment-statements_quiz.html

00:00
034 04_import-statements-in-python.mp4

00:00
035 05_import-statements_quiz.html

00:00
038 06_other-simple-statements-in-python.mp4

00:00
041 01_compound-statements-in-python.mp4

00:00
042 02_evaluating-to-true-or-false_instructions.html

00:00
045 03_if-statements-in-python.mp4

00:00
046 04_if-statements_quiz.html

00:00
049 05_while-loops-in-python.mp4

00:00
050 06_while-loops_quiz.html

00:00
053 07_functions-in-python.mp4

00:00
057 01_introduction-to-python-essentials.mp4

00:00
060 02_sequences-in-python.mp4

00:00
061 03_sequence-operations_quiz.html

00:00
064 04_lists-and-tuples-in-python.mp4

00:00
065 05_lists-and-tuples_quiz.html

00:00
068 06_strings-in-python.mp4

00:00
071 07_creating-range-objects-in-python.mp4

00:00
072 08_range-objects_quiz.html

00:00
075 01_creating-dictionaries-in-python.mp4

00:00
078 02_accessing-dictionary-data-in-python.mp4

00:00
079 03_accessing-data-in-dictionaries_quiz.html

00:00
082 04_dictionary-views-in-python.mp4

00:00
085 05_sets-and-set-operations-in-python.mp4

00:00
086 06_sets-and-set-operations_quiz.html

00:00
089 01_list-comprehensions-in-python.mp4

00:00
090 02_list-comprehensions_quiz.html

00:00
093 03_generator-expressions-in-python.mp4

00:00
094 04_generator-expressions_quiz.html

00:00
097 05_generator-functions-in-python.mp4

00:00
101 01_introduction-to-data-in-python-pandas-and-alternatives.mp4

00:00
104 02_creating-pandas-dataframes-in-python.mp4

00:00
107 03_investigating-data-in-a-pandas-dataframe.mp4

00:00
110 04_selecting-data-in-a-pandas-dataframe.mp4

00:00
113 01_manipulating-pandas-dataframes.mp4

00:00
116 02_updating-pandas-dataframe-data.mp4

00:00
119 03_applying-functions-in-a-pandas-dataframe.mp4

00:00
122 01_creating-numpy-arrays-in-python.mp4

00:00
123 02_numpy_quiz.html

00:00
126 03_spark-and-pyspark-dataframes-in-python.mp4

00:00
127 04_pyspark_quiz.html

00:00
130 05_creating-dask-dataframes-in-python.mp4

00:00
131 06_dask_quiz.html

00:00
135 01_introduction-to-python-development-environments.mp4

00:00
138 02_introduction-to-vim-normal-mode.mp4

00:00
141 03_switching-from-normal-to-insert-and-visual-modes-in-vim.mp4

00:00
142 04_insert-and-visual-modes_quiz.html

00:00
145 05_working-with-the-vim-command-line.mp4

00:00
146 06_vim-command-line-mode_quiz.html

00:00
149 07_vim-configuration.mp4

00:00
152 01_introduction-to-visual-studio-code.mp4

00:00
153 02_features-of-visual-studio-code_quiz.html

00:00
156 03_setting-up-visual-studio-code.mp4

00:00
159 04_debugging-visual-studio-code.mp4

00:00
162 01_what-is-version-control.mp4

00:00
163 02_version-control_quiz.html

00:00
166 03_introduction-to-git-and-git-concepts.mp4

00:00
167 04_git-commands_quiz.html

00:00
170 05_version-control-with-github.mp4

00:00
171 06_hosted-git_quiz.html

00:00
172 01_cumulative-python-and-pandas-for-data-engineering-quiz_exam.html

00:00
175 02_summary-of-python-and-pandas-for-data-engineering.mp4

00:00
176 03_next-steps_instructions.html

00:00

02. Linux and Bash for Data Engineering

003 01_welcome-to-linux-and-bash-for-data-engineering.mp4

00:00
006 02_meet-your-course-instructor-noah-gift.mp4

00:00
007 03_meet-your-supporting-instructors-kennedy-behrman-and-alfredo-deza_instructions.html

00:00
008 04_course-structure-and-discussion-etiquette_instructions.html

00:00
011 05_overview-of-key-concepts.mp4

00:00
014 01_introduction-to-working-with-linux.mp4

00:00
017 02_introduction-to-the-linux-shell.mp4

00:00
020 03_installing-and-accessing-linux.mp4

00:00
023 04_getting-started-with-github-codespaces.mp4

00:00
026 05_comparing-linux-shell-environments.mp4

00:00
029 06_writing-hello-world-bash-script.mp4

00:00
032 07_popular-terminal-commands-in-linux.mp4

00:00
035 01_introduction-to-shell-piping.mp4

00:00
038 02_what-is-shell-piping.mp4

00:00
041 03_walkthrough-of-shell-pipeline-examples.mp4

00:00
044 01_introduction-to-ssh.mp4

00:00
047 02_what-is-ssh.mp4

00:00
050 03_creating-ssh-keys-and-using-with-github.mp4

00:00
053 04_using-ssh-to-connect-to-remote-server-in-aws-cloud.mp4

00:00
056 05_walkthrough-of-ssh-tunneling-example.mp4

00:00
060 01_introduction-to-working-with-bash.mp4

00:00
063 02_introduction-to-configuring-your-bash-shell-environment.mp4

00:00
066 03_what-are-shell-configuration-files.mp4

00:00
069 04_configuring-bashrc.mp4

00:00
072 05_configuring-zshrc-and-third-party-tool-oh-my-zsh.mp4

00:00
075 01_introduction-to-working-with-shell-variables.mp4

00:00
078 02_what-are-shell-variables.mp4

00:00
081 03_exporting-shell-variables-in-an-interactive-prompt.mp4

00:00
084 04_using-shell-variables-in-a-bash-script.mp4

00:00
087 01_introduction-to-standard-streams.mp4

00:00
090 02_what-are-standard-streams.mp4

00:00
093 03_using-standard-out.mp4

00:00
096 04_using-standard-in.mp4

00:00
099 05_using-standard-error.mp4

00:00
103 01_introduction-to-building-bash-scripts.mp4

00:00
106 02_introduction-to-shell-logic-and-control-flow.mp4

00:00
109 03_what-is-shell-control-flow.mp4

00:00
112 04_using-shell-control-flow-to-solve-problems-in-bash.mp4

00:00
115 05_using-shell-loops-in-bash.mp4

00:00
118 06_evaluating-conditions-in-bash.mp4

00:00
121 01_introduction-to-manipulating-data-in-the-bash-shell.mp4

00:00
124 02_shell-techniques-for-data-in-the-bash-shell.mp4

00:00
127 03_truncating-data-in-bash.mp4

00:00
130 04_filtering-data-in-bash.mp4

00:00
133 05_searching-data-in-bash.mp4

00:00
136 01_introduction-to-writing-scripts-and-command-line-tools-in-bash.mp4

00:00
139 02_what-are-scripts-and-command-line-tools.mp4

00:00
142 03_building-a-bash-script.mp4

00:00
145 04_building-a-bash-function.mp4

00:00
148 05_building-a-bash-command-line-tool.mp4

00:00
151 06_bash-adjacent-tools-makefiles-and-dockerfiles.mp4

00:00
154 07_data-structures-in-bash.mp4

00:00
158 01_introduction-to-composing-file-and-data-management-solutions-in-linux.mp4

00:00
161 02_introduction-to-searching-a-filesystem-in-linux.mp4

00:00
164 03_methods-for-searching-a-filesystem-in-linux.mp4

00:00
167 04_using-the-locate-command-to-find-files-in-linux.mp4

00:00
170 05_using-the-find-command-to-find-files-in-linux.mp4

00:00
173 06_using-xargs-to-extend-search-capabilities-in-linux.mp4

00:00
176 07_using-mdfind-on-os-x.mp4

00:00
179 01_introduction-to-modifying-files-directories-permissions-and-archiving-in-linux.mp4

00:00
182 02_overview-of-modifying-the-filesystem-in-linux.mp4

00:00
185 03_moving-files-and-directories-in-linux.mp4

00:00
188 04_setting-permissions-on-files-and-directories-in-linux.mp4

00:00
191 05_archiving-data-in-linux.mp4

00:00
194 01_introduction-to-processing-text-in-linux.mp4

00:00
197 02_benefits-of-processing-text-in-linux.mp4

00:00
200 03_using-grep-cut-sort-and-unique-in-linux.mp4

00:00
203 04_editing-with-truncation-awk-and-sed-in-linux.mp4

00:00
206 05_using-regular-expressions-regex-in-linux.mp4

00:00
207 01_composing-file-and-data-management-solutions-with-linux_exam.html

00:00

03. Scripting with Python and SQL for Data Engineering

006 02_meet-your-course-instructor-alfredo-deza.mp4

00:00
007 03_meet-your-supporting-instructors-kennedy-behrman-and-noah-gift_instructions.html

00:00
008 04_course-structure-and-discussion-etiquette_instructions.html

00:00
011 05_overview-of-key-concepts.mp4

00:00
014 01_introduction-to-working-with-data-in-python.mp4

00:00
017 02_introduction-to-python-data-structures.mp4

00:00
020 03_using-lists-to-save-and-retrieve-data-in-python.mp4

00:00
023 04_using-dictionaries-to-save-and-retrieve-data-in-python.mp4

00:00
026 05_overview-of-less-common-data-structures-in-python.mp4

00:00
027 06_python-lists-and-dictionaries_instructions.html

00:00
030 07_recap-of-data-structures-in-python.mp4

00:00
031 08_using-data-structures-in-python_exam.html

00:00
034 01_introduction-to-choosing-data-structures-in-python.mp4

00:00
037 02_iterating-over-lists-and-dictionaries-in-python.mp4

00:00
040 03_iterating-over-other-data-structures-in-python.mp4

00:00
043 04_storing-data-between-data-structures-in-python.mp4

00:00
046 05_recap-of-mapping-data-structures-in-python.mp4

00:00
049 01_introduction-to-data-sources-and-formats-in-python.mp4

00:00
052 02_loading-data-from-files-and-file-paths-in-python.mp4

00:00
055 03_working-with-json-in-python.mp4

00:00
058 04_saving-data-from-python-to-disk.mp4

00:00
061 05_recap-of-persisting-and-loading-data-in-python.mp4

00:00
062 01_build-a-notebook-that-reformats-data-into-json_instructions.html

00:00
064 02_working-with-data-in-python_exam.html

00:00
067 01_introduction-to-python-scripting-and-sql.mp4

00:00
070 02_introduction-to-scripting-in-python.mp4

00:00
073 03_creating-a-script-as-a-module-in-python.mp4

00:00
076 04_traversing-the-file-system-with-a-script-in-python.mp4

00:00
077 05_minimal-python-chapter-2-learn-to-store-data_instructions.html

00:00
080 06_recap-of-python-scripting-basics.mp4

00:00
083 01_introduction-to-embedded-databases.mp4

00:00
086 02_what-is-sqlite.mp4

00:00
089 03_creating-and-connecting-to-a-sqlite-database-in-python.mp4

00:00
092 04_saving-and-querying-from-a-sqlite-database-in-python.mp4

00:00
095 05_recap-of-sqlite-and-python.mp4

00:00
098 01_introduction-to-querying-with-sql-in-python.mp4

00:00
101 02_basic-sql-commands-in-python.mp4

00:00
104 03_extracting-distinct-data-using-sql-in-python.mp4

00:00
107 04_searching-with-sql-in-python.mp4

00:00
110 05_recap-of-querying-with-sql-in-python.mp4

00:00
111 01_create-a-reporting-script-for-file-sizes_instructions.html

00:00
114 02_python-scripting-and-sql_exam.html

00:00
117 01_introduction-to-web-scraping-using-python.mp4

00:00
120 02_introduction-to-extracting-data-from-unstructured-html.mp4

00:00
123 03_challenges-with-web-data.mp4

00:00
124 04_parsing-techniques-with-htmlparser_instructions.html

00:00
127 05_parsing-html-with-htmlparser-in-python.mp4

00:00
130 06_recap-of-web-scraping-techniques-in-python.mp4

00:00
133 01_introduction-to-scrapy-and-xpath-in-python.mp4

00:00
136 02_creating-a-web-scraping-project-with-scrapy-in-python.mp4

00:00
139 03_parsing-data-with-xpath-and-scrapy-shell.mp4

00:00
142 04_using-scrapy-spider-for-web-scraping.mp4

00:00
143 05_codespaces-lab-parse-html-with-scrapy-and-xpath_instructions.html

00:00
147 06_recap-of-scrapy-and-xpath-in-python.mp4

00:00
150 01_overview-of-challenges-with-web-scraping.mp4

00:00
153 02_scraping-locally.mp4

00:00
156 03_persisting-data-in-csv-and-json-formats.mp4

00:00
159 04_persisting-data-to-a-sqlite-database.mp4

00:00
160 05_efficient-scraping-techniques_instructions.html

00:00
163 06_recap-of-persistence-and-efficacy-with-web-scraping.mp4

00:00
164 01_build-a-web-scraping-tool_instructions.html

00:00
165 02_web-scraping-using-python_exam.html

00:00
168 01_introduction-to-working-with-mysql.mp4

00:00
171 02_introduction-to-vscode-with-mysql.mp4

00:00
174 03_connecting-to-a-mysql-server.mp4

00:00
177 04_recap-of-vscode-with-mysql.mp4

00:00
180 01_challenges-of-running-mysql-queries.mp4

00:00
183 02_using-vscode-to-execute-mysql-queries.mp4

00:00
184 03_working-with-vscode-and-mysql_instructions.html

00:00
187 04_recap-of-running-mysql-queries.mp4

00:00
190 01_challenges-with-importing-to-databases.mp4

00:00
193 02_importing-csv-data-into-mysql.mp4

00:00
196 03_exporting-data-from-mysql.mp4

00:00
199 04_recap-of-importing-and-exporting-data-in-mysql.mp4

00:00
201 01_loading-and-exporting-data-using-mysql_instructions.html

00:00
205 02_working-with-mysql_exam.html

00:00
003 01_welcome-to-scripting-with-python-and-sql-for-data-engineering.mp4

00:00

04. Web Applications and Command-Line Tools for Data Engineering

004 02_meet-your-instructors_instructions.html

00:00
005 03_course-structure-and-etiquette_instructions.html

00:00
008 04_overview-of-key-concepts.mp4

00:00
011 01_introduction-to-jupyter-notebooks.mp4

00:00
014 02_getting-started-with-jupyter.mp4

00:00
015 03_introduction-to-jupyter_exam.html

00:00
018 04_code-cells-in-jupyter.mp4

00:00
021 05_text-cells-in-jupyter.mp4

00:00
024 06_magics-in-jupyter.mp4

00:00
027 07_overview-of-jupyter-lab.mp4

00:00
030 01_introduction-to-colab.mp4

00:00
031 02_introduction-to-colab_exam.html

00:00
034 03_tour-of-colab-features.mp4

00:00
035 04_colab-features_exam.html

00:00
038 05_data-and-documents-in-colab.mp4

00:00
039 06_data-and-documents-in-colab_exam.html

00:00
040 07_important-notebook-links_instructions.html

00:00
043 01_introduction-to-sagemaker.mp4

00:00
044 02_introduction-to-sagemaker_exam.html

00:00
047 03_tour-of-sagemaker-studio.mp4

00:00
048 04_sagemaker-studio_exam.html

00:00
051 05_overview-of-sagemaker-pipelines.mp4

00:00
052 06_sagemaker-pipelines_exam.html

00:00
056 01_introduction-to-building-python-microservices.mp4

00:00
059 02_what-are-the-benefits-of-microservices.mp4

00:00
062 03_setting-up-python-project-structure-for-continuous-integration.mp4

00:00
065 04_building-a-random-fruit-web-app-with-python.mp4

00:00
068 01_introduction-to-python-microservices-with-fastapi.mp4

00:00
071 02_building-fastapi-microservices-for-machine-learning-predictions.mp4

00:00
074 03_deploying-a-python-lambda-microservice.mp4

00:00
077 01_introduction-to-building-containerized-microservices.mp4

00:00
080 02_why-use-containers-for-microservices.mp4

00:00
083 03_deploying-a-containerized-net-6-api.mp4

00:00
086 04_deploying-a-containerized-machine-learning-microservice.mp4

00:00
090 01_introduction-to-python-packaging-and-command-line-tools.mp4

00:00
093 02_introduction-to-building-command-line-tools.mp4

00:00
096 03_getting-started-with-python-projects.mp4

00:00
099 04_overview-of-command-line-tool-frameworks.mp4

00:00
102 05_using-click-to-build-a-command-line-tool.mp4

00:00
105 06_exploring-advanced-command-line-tool-features.mp4

00:00
108 07_building-c-nlp-cli.mp4

00:00
111 08_recap-of-building-command-line-tools.mp4

00:00
112 09_building-command-line-tools_instructions.html

00:00
115 01_introduction-to-packaging-and-distributing-your-python-project.mp4

00:00
118 02_introduction-to-python-packaging.mp4

00:00
121 03_working-with-python-setup-tools.mp4

00:00
124 04_uploading-to-a-python-registry.mp4

00:00
127 05_recap-of-packaging-and-distributing-your-python-project.mp4

00:00
130 01_introduction-to-continuous-integration-for-command-line-tools.mp4

00:00
133 02_introduction-to-linting.mp4

00:00
136 03_automating-testing-with-github-actions.mp4

00:00
139 04_automating-publishing-of-your-python-project.mp4

00:00
142 05_recap-of-continuous-integration-for-command-line-tools.mp4

00:00
143 01_command-line-tools-and-packaging_exam.html

00:00

Add this certificate to your resume to demonstrate your skills & increase your chances of getting noticed.

Student Ratings & Reviews

No Review Yet

About Course

What Will You Learn?

Course Content

01. Python and Pandas for Data Engineering

003 01_overview-of-python-bash-and-sql-essentials-for-data-engineering.mp4

007 02_meet-your-supporting-instructors-alfredo-deza-and-noah-gift_instructions.html

008 03_course-structure-and-discussion-etiquette_instructions.html

011 04_overview-of-key-concepts.mp4

012 05_getting-started-and-best-practices_instructions.html

015 01_introduction-to-setting-up-your-python-environment.mp4

018 02_installing-packages-with-pip-in-python.mp4

021 03_saving-requirements-file-in-python.mp4

024 04_creating-and-using-a-python-virtual-environment.mp4

027 01_expression-statements-in-python.mp4

030 02_assignment-statements-in-python.mp4

031 03_assignment-statements_quiz.html

034 04_import-statements-in-python.mp4

035 05_import-statements_quiz.html

038 06_other-simple-statements-in-python.mp4

041 01_compound-statements-in-python.mp4

042 02_evaluating-to-true-or-false_instructions.html

045 03_if-statements-in-python.mp4

046 04_if-statements_quiz.html

049 05_while-loops-in-python.mp4

050 06_while-loops_quiz.html

053 07_functions-in-python.mp4

057 01_introduction-to-python-essentials.mp4

060 02_sequences-in-python.mp4

061 03_sequence-operations_quiz.html

064 04_lists-and-tuples-in-python.mp4

065 05_lists-and-tuples_quiz.html

068 06_strings-in-python.mp4

071 07_creating-range-objects-in-python.mp4

072 08_range-objects_quiz.html

075 01_creating-dictionaries-in-python.mp4

078 02_accessing-dictionary-data-in-python.mp4

079 03_accessing-data-in-dictionaries_quiz.html

082 04_dictionary-views-in-python.mp4

085 05_sets-and-set-operations-in-python.mp4

086 06_sets-and-set-operations_quiz.html

089 01_list-comprehensions-in-python.mp4

090 02_list-comprehensions_quiz.html

093 03_generator-expressions-in-python.mp4

094 04_generator-expressions_quiz.html

097 05_generator-functions-in-python.mp4

101 01_introduction-to-data-in-python-pandas-and-alternatives.mp4

104 02_creating-pandas-dataframes-in-python.mp4

107 03_investigating-data-in-a-pandas-dataframe.mp4

110 04_selecting-data-in-a-pandas-dataframe.mp4

113 01_manipulating-pandas-dataframes.mp4

116 02_updating-pandas-dataframe-data.mp4

119 03_applying-functions-in-a-pandas-dataframe.mp4

122 01_creating-numpy-arrays-in-python.mp4

123 02_numpy_quiz.html

126 03_spark-and-pyspark-dataframes-in-python.mp4

127 04_pyspark_quiz.html

130 05_creating-dask-dataframes-in-python.mp4

131 06_dask_quiz.html

135 01_introduction-to-python-development-environments.mp4

138 02_introduction-to-vim-normal-mode.mp4

141 03_switching-from-normal-to-insert-and-visual-modes-in-vim.mp4

142 04_insert-and-visual-modes_quiz.html

145 05_working-with-the-vim-command-line.mp4

146 06_vim-command-line-mode_quiz.html

149 07_vim-configuration.mp4

152 01_introduction-to-visual-studio-code.mp4

153 02_features-of-visual-studio-code_quiz.html

156 03_setting-up-visual-studio-code.mp4

159 04_debugging-visual-studio-code.mp4

162 01_what-is-version-control.mp4

163 02_version-control_quiz.html

166 03_introduction-to-git-and-git-concepts.mp4

167 04_git-commands_quiz.html

170 05_version-control-with-github.mp4

171 06_hosted-git_quiz.html

172 01_cumulative-python-and-pandas-for-data-engineering-quiz_exam.html

175 02_summary-of-python-and-pandas-for-data-engineering.mp4

176 03_next-steps_instructions.html

02. Linux and Bash for Data Engineering

003 01_welcome-to-linux-and-bash-for-data-engineering.mp4