Author : GAURAB KUNDU
As a Data Analyst, I have been tasked with collecting data from various sources and identifying trends for this year's report on emerging skills.
My first task is to collect the top programming skills that are most in demand from various sources including:
Job postings
Training portals
Surveys
Once I have collected enough data, I will begin analyzing the data and identify insights and trends that may include the following:
What are the top programming languages in demand?
What are the top database skills in demand?
What are the popular IDEs?
| SL. NO | Outline |
|---|---|
| 1 | Executive Summary |
| 2 | Introduction |
| 3 | Objective |
| 4 | Hardware and Software Requirments |
| 5 | Methodology |
| 6 | Results |
| 7 | Discussion |
| 8 | Conclusion |
| 9 | Appendix |
This Project will give you an overview of :
-
Trends in programming languages and databases
-
Demographics survey
-
Technological gap in countries
-
Gender gap in jobs
As a Data Analyst, I have been tasked with collecting data from various sources and identifying trends for this year's report on emerging skills. My first task is to collect the top programming skills that are most in demand from various sources including: Job postings,Training portals,Surveys.
Once I have collected enough data, I will begin analyzing the data and identify insights and trends.
Analyzing the trends in software development.
Identify skill requirements for future.
What are the top programming languages in demand?
What are the top database skills in demand?
What are the popular IDEs?
Human Resource and IT Head.
In this Project We are going to use IBM Cloud Pack for Data and its various Web services, so a decent Internet Connection is required only. All the hardware requirments will be covered by IBM Cloud Pack for Data.
We are going to use IBM Watson Studio for this project.
In case of local machine We are going to use the following softwares in this project :
Programming Language : Python
IDE : Jupyter Notebook
Packages : Pandas, Numpy, Scipy, Scikit-learn, Matplotlib, BeautifulSoop.
The Data was collected from:
Stack Overflow Developer 2019 Survey
GitHub Job Postings
Programming Languages Annual Salary
The used Data Sets are:
DataSet1 which contains information about the IT professionals.
DataSet2 which contains information about trending technologies and programming languages.
To see the code and step by step process of Data Collection click here
To see the code and step by step process of Data Exploration click here
To see the code and step by step process of Data Wrangling click here
To see the code and step by step process of Exploratory Data Analysis click here
To see the code and step by step process of Exploratory Data Visualization click here
-
JavaScript, HTML/CSS, SQL are top 3 this year.
-
Python and Typescript becoming popular next year.
-
PowerShell edged out in next year.
-
Web development are still in high demand.
-
Big Data technology in companies still requires SQL.
-
With AI and ML in rising demand, Python is best choice.
-
MySQL is most popular.
-
Behind is Microsoft SQL.
-
MongoDB and Redis are upcoming favorites.
-
New kid on the block: Elasticsearch.
-
Open-source databases are still preferable in companies.
-
NoSQL databases will make an impact for storing non-relational data.
-
Redis supports abstract data types.
-
Pre-tuned search to website, app, or ecommerce store.
Technology Trends now and future
Training and Reskilling workers
Females participation in Technology field
Bridge divide of technology gaps in developing countries
Eliminate age and education discrimination in employment
-
Fast changing technology every year.
-
Concentration on several countries like USA and India.
-
Gender gap in technology jobs.
-
Platforms like Docker and AWS are growing.
-
Companies need to be flexible and adjust to rapid changes.
-
Need to spread technology out to lagging countries.
-
Impact on job hiring’s.
-
Shift to faster app deployments and cloud services in future.
From this project we have known the Technology Trends for current and next year, Programming Languages, Database and Platform overview. We have got an overview of Demographics. What are the actions to be taken. And we came to know that In future, we can use incorporate Machine Learning to predict trends and salaries
