fivethirtyeight / data

Data and code behind the articles and graphics at FiveThirtyEight
https://data.fivethirtyeight.com/
Creative Commons Attribution 4.0 International
16.69k stars 10.96k forks source link

What Happened to fte_grade? #341

Open spencerthayer opened 3 months ago

spencerthayer commented 3 months ago

I've noticed recent changes to the president_polls.csv file format that are impacting data analysis, particularly regarding the election of 2024.

Previously, this file contained a column named fte_grade, critical to my analysis as it provided pollster ratings essential for weighting polls. In the latest version of the dataset, it appears this column has been renamed to numeric_grade. Unfortunately, I could not find any documentation or explanation for this change on the FiveThirtyEight website.

These modifications affect the continuity and reliability of ongoing analyses, and thus, I am seeking clarity on several points:

  1. Can you confirm the change from fte_grade to numeric_grade and detail any other modifications to column names or formats?
  2. What was the reason behind these changes? Do they reflect updates in the methodology or data structure?
  3. How stable is the dataset format expected to be moving forward, and should users anticipate further alterations?
  4. Is updated documentation or a changelog available to help users navigate these changes?

A clear understanding of these updates is essential for maintaining the integrity and accuracy of our analyses. I and the wider community that utilizes your datasets greatly appreciate your assistance and an update on this matter.

I am a long-time user and fan of your work, and I value the data services provided by FiveThirtyEight. I am looking forward to a prompt response to this issue.