Data Analysis and Machine Learning Approach to Reveal Workplace Employment Landscape of Wales

Learning Outcomes

This assessment is designed to demonstrate a student’s completion of the following Learning Outcomes:

• Critically analyse and evaluate various statistical and computational techniques for analysing datasets and determine the most appropriate technique for a business problem;
• Critically evaluate, develop and implement solutions for processing datasets and solving complex problems in various environments using relevant programming paradigms;
• Evaluate and apply key steps and issues involved in data preparation, cleaning, exploring, creating, optimizing and evaluating models;
• Evaluate and apply aspects of data science applications and their use.

Edge

The Cardiff Met EDGE supports students in graduating with the knowledge, skills, and attributes that allow them to contribute positively and effectively to the communities in which they live and work.

This module assessment provides opportunities for students to demonstrate development of the following EDGE Competencies:

Assessment Requirements / Tasks (include all guidance notes)

This assignment will use employment data of Wales from the StatsWales data source.  This dataset provides workplace employment estimates, or estimates of total jobs, for Wales and its NUTS2 areas, along with comparable UK data disaggregated by industry section.

For this assignment students will undertake a data analysis and machine learning approach to reveal the workplace employment landscape of Wales.  

Data processing

1.1. Download the dataset for the period 2001 – 2010 and create a dataframe that concatenates Wales (total) employment value only.

1.2. Check for any null value or outlier. If found replace that with mean value.  

1.3. Change the name of the industries as bellow

The final dataframe should look like following

Data analysis

For each question provide graph/chart along with your own interpretation (~ 50 words)

• Which industry employed highest and lowest workers over the period?
• Which industry has the highest and lowest overall growth over the period?
• Which years are the best and worst performing year in relation to number of employment. (highest and lowest employment)

Visual analysis

Create a dynamic scatter/bubble plot showing the change of workforce number over the period using Plotly express.

Correlation

• Taking average employment number for each industry over the period, show and identify the highest and lowest correlated industries.
• Make a year wise correlation for each industry.  Does the aforementioned industries are also correlated over the each year? Explain your answer.

Clustering (k means & hierarchical)

5. • Using the best and worst performing year column’s employment data (2.3) undertake a K means clustering analysis (K=2 & 3) and identify industries cluster together.  Write your own interpretation (~100 words).
   • Using the same dataset (best & worst performing) create a hierarchical cluster.  Compare the cluster with k means clusters.

Discussion

Provide a brief discussion (~ 300 words) on employment landscape of Wales based on the employment data analysis results.