-
This should be able to run with a stock python installation
-
Set any variables you wish at the top of main.py
-
From the command line run
python3 main.py -
Note that this exports two CSV files:
- cleaneddata.csv that contains the filtered data
- output.csv that contains the skills, proficiency, and record counts
-
An extremely simple data visualization in Data Visualization.xlsx is also included
- Sorting of output for more consistent downstream data usage
- Output more info on data sanitization - e.g. number of records cleaned up, which records, etc.
- Add proper logging instead of print statements
- Add try/catch in functions for proper error handling
- Add tests
- Containerize to ensure consistent developer experience