N8sGit / ai_project_group_8

A data analysis class project for Columbia University's AI bootcamp
0 stars 0 forks source link

Consolidate datasets #8

Closed N8sGit closed 6 months ago

N8sGit commented 6 months ago

Put all data we find from everywhere in one place (links, csvs, etc)

FundaSubasi commented 6 months ago

AI_AmericanCompaniesProfits.csv

petagaye143 commented 6 months ago

herd_2020.csv.zip

Variable/Header Key: https://ncsesdata.nsf.gov/explorer/variables?page=1

R&D expenditure by field of research and source of funds and also gathers information on types of research, expenses, and R&D personnel

petagaye143 commented 6 months ago

herd_2021.csv (1).zip

Variable/Header Key: https://ncsesdata.nsf.gov/explorer/variables?page=1

R&D expenditure by field of research and source of funds and also gathers information on types of research, expenses, and R&D personnel.

N8sGit commented 6 months ago

Here are software developer jobs posted on linkedin in 2023. Ideally I'd find another data set for a previous year(s) to contrast it with.

linkedin_postings.csv.zip

N8sGit commented 6 months ago

Here's approximately 200 machine learning engineer job listings .

ml_engineer_jpbs.json.zip

N8sGit commented 6 months ago

Here's even more linkedin job data, 100,000 items. I think it includes jobs from all kinds of jobs outside of tech though https://www.kaggle.com/datasets/arshkon/linkedin-job-postings

N8sGit commented 6 months ago

https://www.kaggle.com/datasets/asaniczka/1-3m-linkedin-jobs-and-skills-2024 This one claims to have a million

MxOdele commented 6 months ago

Combined data from US Census API: https://www.census.gov/data/developers/guidance.html

NOTE: Data from 2010 through 2019 only

combined_census_data.csv

kalAnglin commented 6 months ago

National Employment Matrix.csv

Reference: https://data.bls.gov/projections/occupationProj

kalAnglin commented 6 months ago

AI_Job_Threat_Index.csv

Reference: https://www.kaggle.com/code/unclepablo/ai-impact-on-jobs

kalAnglin commented 6 months ago

Electric_Vehicle_Population_Size_History_By_County.csv

Reference: https://catalog.data.gov/dataset/electric-vehicle-population-size-history-by-county

MxOdele commented 6 months ago

2022 5-year estimate data from US Census API: https://www.census.gov/data/developers/guidance.html

2022_acs5_census_data.csv