Use the UNIX shell to wrangle log data

  • Module
  • 9 Units
Beginner
Student
Data Scientist
Data Engineer
Developer
Azure

Learn how to use the UNIX shell to wrangle data and inspect data files.

Learning objectives

In this module, you'll learn how to:

  • Do basic file inspection with commands such as head, tail, wc, less, and sort.
  • Use the cat command to create, append, display, and concatenate files.
  • Write and use regex (regular expressions) for text pattern matching.
  • Use the grep command to search files, or stdin content for pattern matching along with regex.
  • Do basic text transformations on input streams by using sed and regex.
  • Use pipes and filters for data wrangling.

Prerequisites

  • Basic knowledge of the command line and basic shell commands