AWS Glue feature exploration

[siddhant3030]

1. Data Exploration

Once we upload the dataset it gives us basic information about the data like Distinct, Unique, and Total. It even shows the basic charts. This is a really nice way to give the information on the dataset.

Screen.Recording.2024-01-16.at.5.21.25.PM.mov

2. Column rename, Creating duplicate column values

Screen.Recording.2024-01-16.at.5.38.05.PM.mov

• Move column position
• Change the data type
• delete and duplicate the column

4. JOIN function.

So we open a project using a particular dataset which we want to work with so let's suppose I selected table A then in th video I have shown that we can select different tables to join on. Not only that

• It has multiple keys which you can choose
• Preview the dataset once you made the changes and before applying it

Screen.Recording.2024-01-16.at.11.45.16.PM.mov

5. Missing Values and duplicate values

• It has info about it
• Few options like this

• What I liked the most is the preview feature so I made some changes in the particular column and it shows the source data and preview data.
• In similar way we can remove duplicate values

6. Functions and Conditions

     Functions have follow things 
     a. Math functions - FLOOR, IS EVEN, IS ODD etc
     b. Average function - ANY, AVERAGE, COUNT etc
     c. text function - CHAR, Remove white space, Remove symbols
     d. Date function - Date, Time, datetime 
     e. window function - row number, rolling sum, rolling min 
     f. Other function - COALESCE 
   

COALESCE function

7. Conditions (IF and CASE )

here's a detailed video on it

Screen.Recording.2024-01-17.at.12.19.35.AM.mov