SAT Project - The first project I had done at General Assembly, performed EDA, data cleaning and created data visualizations

Overview

Project 1: Standardized Test Analysis by Adam Klesc

Overview

This project covers:

  • Basic statistics and probability
  • Many Python programming concepts
  • Programmatically interacting with files and directories
  • Visualizations
  • EDA
  • Working with Jupyter notebooks for development and reporting

The SAT is a standardized test that many colleges and universities in the United States require for their admissions process. This score is used along with other materials such as grade point average (GPA) and essay responses to determine whether or not a potential student will be accepted to the university.

The SAT has two sections of the test: Evidence-Based Reading and Writing and Math (source).

The SAT changed their format in 2016 to address some problems that students and schools had with their style of questions and questionable grading. The ACT surpassed the SAT in popularity due to these problems and a perception that the SAT was "class-biased" due to their questions. The ACT also did this through a lot of states make it free state-wide and a requirement to pass high school which the SAT did not catch up on.


Problem Statement

When crafting my problem statement, I really was stuck with what to really analyze and what problem to solve. But it really simplified the process for me when looking at the yearly datasets because looking at the years and the progression of both the SAT and ACT participation rates, it really clicked.

My problem statement in a short sentence is:

Has collegeboard solved the problems they were seeking to fix with the 2016 format change?

I really had to go through three factors when making my problem statement. Who is my audience, what data am I using, and what value am I bringing to my audience.

  • The first factor was fairly easy to answer, I think the people who would be most interested in the answer to my problem statement would be collegeboard and the people involved in the change to see whether their change has actually worked.

  • The second factor was what data I would use and primarily I would be using the SAT 2017-2019 data along with the ACT 2017-2019 data but over the course of the project, I added some outside sources as well.

  • The final factor in creating that problem statement was bringing clarity to the changes and whether they have been actually productive in solving what they were mean't to solve.


Datasets

Provided Data

These are the datasets I used in the process that were included in the data folder provided, I cleaned each of them but will still be sharing both the raw and cleaned datasets

Additional Data

These are the datasets I required from outside research I performed.


Data Dictionary

A dictionary compiling the primary columns from the two main datasets used throughout the analysis.

Feature Type Dataset Description
participation17 float SATTotal Participation numbers for the 2017 SAT(in decimal percentage)
participation17 float ACTTotal Participation numbers for the 2017 ACT(in decimal percentage)
participation18 float ACTTotal Participation numbers for the 2018 ACT(in decimal percentage)
participation18 float SATTotal Participation numbers for the 2018 SAT(in decimal percentage)
participation19 float SATTotal Participation numbers for the 2019 SAT(in decimal percentage)
participation19 *float( ACTTotal Participation numbers for the 2019 ACT(in decimal percentage)
total17 int SATTotal Average total score for the 2017 SAT(median score)
total18 int SATTotal Average total score for the 2018 SAT(median score)
total19 int SATTotal Average total score for the 2019 SAT(median score)
composite17 float ACTTotal Average total score for the 2017 ACT(mean score)
composite18 float ACTTotal Average total score for the 2018 ACT(mean score)
composite19 float ACTTotal Average total score for the 2019 ACT(mean score)
sat_free boolean ACTTotal/SATTotal States that have the SAT free statewide
act_free boolean ACTTotal/SATTotal States that have the ACT free statewide
population_rank float ACTTotal/SATTotal Population rank for each state
gdp_rank_19 float/int ACTTotal/SATTotal GDP rank for each state
state object SATTotal The states where the data is located
state object ACTTotal The states where the data is located

Deliverables

Notebook that contains my cleaning of data and creation of new CSV's

cleaning_and_creating.ipynb

Notebook that contains my analysis and visualization

visualization_and_analysis.ipynb

Starter Code

starter-code.ipynb

ReadMe

README-ADAMK.md

Presentation

project_1_presentation.pdf


Technical Report Starter Code

Edited structure of starter code notebook by creating individual notesbooks for cleaning and analysis + visualization. Starter code trials are complete either in those two notebooks or on the starter code itself

Notebook that contains my cleaning of data and creation of new CSV's

cleaning_and_creating.ipynb

Notebook that contains my analysis and visualization

visualization_and_analysis.ipynb

Starter Code

starter-code.ipynb


Analysis

The analysis started with understanding the problem statement, in order to do that, I had to find out the reasons why the SAT changed and look at those problems in isolation each when looking at the data to see if collegeboard has actually succeeded in solving the problems they tried to address with their change.

  • Increase participation to overtake the ACT in market-share

  • Eliminate the stigma that the SAT is class-biased and is unfair towards those of lower incomes

I narrowed it down to these two problems because of these two sources

greentestprep

cnn.com

These sources really helped clarify what the SAT was actually looking to achieve with their change and helped me in my data collection process

  • From looking at the mean and median, it was evident that the SAT was steadily gaining popularity while the ACT was losing popularity but what makes the change a great success in terms of the first problem the change was mean't to address was how the SAT was significantly more popular than the ACT in states with a higher population. The SAT has also notably been made free in 3 states after 2017 (the first full year of the SAT change), those states being Colorado, West Virginia, and Illinois. New Hampshire, Michigan, and Connecticut also made a switch to the SAT, the year of the change. It's clear that the SAT change has done wonders in improving participation and making states believers in their test.

  • This lines up with outside sources claiming that the SAT surpassed the ACT in 2019 with overall market share with 2.2 million students to the ACT's 1.8.

  • From looking at the correlation between the GDP per state + SAT Participation, it was clear to see that the change had not had the effect that was desired from collegeboard execs. The coefficient stayed the same despite the added help in a new Khan Academy course that was free to all + fee waivers (for college applications) for those who met a certain income threshold. source

  • While a lot of studies tend to disagree on the fact that the SAT is a class-biased test, it is clear that a lot of universities are taking note of the potentially inherent class disadvantage in standardized testing as a whole and have outright banned it not only for just times of a pandemic, but also for the foreseeable future. The most prominent of these universities being the University of California


In Conclusion

From my analysis, I was able to conclude that the SAT has successfully managed to overtake the ACT once again as the market leader in standardized testing due to primarily to the SAT changes made to the format and structure. It not only made the test more appealing to students but also states themselves as number of them made it free during the time between 2019 from the date of the change. This is evidenced by the fact that the SAT once again, became the market-leader in standardized testing after the ACT's regression post-SAT change. While solving participation was a massive success in both participation numbers and time, the second problem is where the SAT still needs work.

The SAT change partially occurred due to the reputation that the SAT was a class-biased test, the strange scoring of the 2400 scale and detachment from the actual school work that students were learning in school lead to the ACT being more popular and while they did fix the problem with participation, the lingering problem of class-bias is still there. With more colleges pulling away from standardized testing and geographical location being so heavily tied to participation and success, there need to be more upcoming changes to rectify this issue and make the SAT a more equitable test.

Owner
Adam Muhammad Klesc
Hopeful data scientist. Currently in General Assembly and taking their data science immersive course!
Adam Muhammad Klesc
Delving into Localization Errors for Monocular 3D Object Detection, CVPR'2021

Delving into Localization Errors for Monocular 3D Detection By Xinzhu Ma, Yinmin Zhang, Dan Xu, Dongzhan Zhou, Shuai Yi, Haojie Li, Wanli Ouyang. Intr

XINZHU.MA 124 Jan 04, 2023
Large-Scale Unsupervised Object Discovery

Large-Scale Unsupervised Object Discovery Huy V. Vo, Elena Sizikova, Cordelia Schmid, Patrick Pérez, Jean Ponce [PDF] We propose a novel ranking-based

17 Sep 19, 2022
FSL-Mate: A collection of resources for few-shot learning (FSL).

FSL-Mate is a collection of resources for few-shot learning (FSL). In particular, FSL-Mate currently contains FewShotPapers: a paper list which tracks

Yaqing Wang 1.5k Jan 08, 2023
Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation

Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation Paper Multi-Target Adversarial Frameworks for Domain Adaptation in

Valeo.ai 20 Jun 21, 2022
Autonomous Robots Kalman Filters

Autonomous Robots Kalman Filters The Kalman Filter is an easy topic. However, ma

20 Jul 18, 2022
Implementation of the paper Recurrent Glimpse-based Decoder for Detection with Transformer.

REGO-Deformable DETR By Zhe Chen, Jing Zhang, and Dacheng Tao. This repository is the implementation of the paper Recurrent Glimpse-based Decoder for

Zhe Chen 33 Nov 30, 2022
The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate. Website • Key Features • How To Use • Docs •

Pytorch Lightning 21.1k Jan 08, 2023
The official implementation of the IEEE S&P`22 paper "SoK: How Robust is Deep Neural Network Image Classification Watermarking".

Watermark-Robustness-Toolbox - Official PyTorch Implementation This repository contains the official PyTorch implementation of the following paper to

49 Dec 19, 2022
《K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters》(2020)

K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters This repository is the implementation of the paper "K-Adapter: Infusing Knowledge

Microsoft 118 Dec 13, 2022
noisy labels; missing labels; semi-supervised learning; entropy; uncertainty; robustness and generalisation.

ProSelfLC: CVPR 2021 ProSelfLC: Progressive Self Label Correction for Training Robust Deep Neural Networks For any specific discussion or potential fu

amos_xwang 57 Dec 04, 2022
MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation

MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation This repo is the official implementation of "MHFormer: Multi-Hypothesis Transforme

Vegetabird 281 Jan 07, 2023
An NVDA add-on to split screen reader and audio from other programs to different sound channels

An NVDA add-on to split screen reader and audio from other programs to different sound channels (add-on idea credit: Tony Malykh)

Joseph Lee 7 Dec 25, 2022
StyleMapGAN - Official PyTorch Implementation

StyleMapGAN - Official PyTorch Implementation StyleMapGAN: Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editing Hyunsu Kim, Yunj

NAVER AI 425 Dec 23, 2022
Project dự đoán giá cổ phiếu bằng thuật toán LSTM gồm: code train và code demo

Web predicts stock prices using Long - Short Term Memory algorithm Give me some start please!!! User interface image: Choose: DayBegin, DayEnd, Stock

Vo Thuong Truong Nhon 8 Nov 11, 2022
Visualizing lattice vibration information from phonon dispersion to atoms (For GPUMD)

Phonon-Vibration-Viewer (For GPUMD) Visualizing lattice vibration information from phonon dispersion for primitive atoms. In this tutorial, we will in

Liangting 6 Dec 10, 2022
Lunar is a neural network aimbot that uses real-time object detection accelerated with CUDA on Nvidia GPUs.

Lunar Lunar is a neural network aimbot that uses real-time object detection accelerated with CUDA on Nvidia GPUs. About Lunar can be modified to work

Zeyad Mansour 276 Jan 07, 2023
Prososdy Morph: A python library for manipulating pitch and duration in an algorithmic way, for resynthesizing speech.

ProMo (Prosody Morph) Questions? Comments? Feedback? Chat with us on gitter! A library for manipulating pitch and duration in an algorithmic way, for

Tim 71 Jan 02, 2023
Object tracking implemented with YOLOv4, DeepSort, and TensorFlow.

Object tracking implemented with YOLOv4, DeepSort, and TensorFlow. YOLOv4 is a state of the art algorithm that uses deep convolutional neural networks to perform object detections. We can take the ou

The AI Guy 1.1k Dec 29, 2022
ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers

ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers Official implementation of ViewFormer. ViewFormer is a NeRF-free neural rend

Jonáš Kulhánek 169 Dec 30, 2022
A benchmark framework for Tensorflow

TensorFlow benchmarks This repository contains various TensorFlow benchmarks. Currently, it consists of two projects: PerfZero: A benchmark framework

1.1k Dec 30, 2022