ben-domingue / irw

Code related to data for the Item Response Warehouse
https://datapages.github.io/irw/
7 stars 11 forks source link

New Age of measuring paranormal and related beliefs: Psychometric properties and correlates of the Polish version of the Survey of Scientifically Unaccepted Beliefs (SSUB) #319

Closed ben-domingue closed 1 month ago

ben-domingue commented 1 month ago

https://www.researchgate.net/profile/Klara-Buczel/publication/380193423_New_Age_of_measuring_paranormal_and_related_beliefs_Psychometric_properties_and_correlates_of_the_Polish_version_of_the_Survey_of_Scientifically_Unaccepted_Beliefs_SSUB/links/6630f38506ea3d0b7419c08d/New-Age-of-measuring-paranormal-and-related-beliefs-Psychometric-properties-and-correlates-of-the-Polish-version-of-the-Survey-of-Scientifically-Unaccepted-Beliefs-SSUB.pdf

https://osf.io/k2453/

KingArthur0205 commented 1 month ago

This paper includes 1 dataset, which merges the responses from multiple questionnaires that assess respondent's openness to paranormal behaviours/conspiracy on different scales. I am splitting them into individual datasets as they are essentially different

The responses include 6 different samples whose data is collected via different online platforms and surveys. Deleted this column and corresponding NA rows as some respondents didn't participate in all of the questionnaires.

  1. Survey of Scientifically Unaccepted Beliefs(SSUB): 20 items on a 5-point scale. It assesses the beliefs in supernatural, paranormal and scientifically unaccepted beliefs. Participants from Sample 5 took a retest. To show this, a wave column is added for participants in sample 5.
  2. Generic Conspiracist Beliefs Scale(GCBS): 15 items on a 5-point scale. It assesses individual variations in conspiracy thinking. Participants from sample 3, 4 and 6 didn't take this questionnaire and their responses are thus deleted.
  3. NEO Five Factor Inventory(NEO-FFI): 60 items on a 5-point scale. It measures developed to evaluate 5 fundamental personality dimensions: Neuroticism, Extraversion, Openness to Experience, Agreeableness, and Conscientiousness. Only participants from sample 1 and 4 are engaged in answering this questionnaire.
  4. Dissociative Experiences Scale–Revised (DES-R-PL): 28 items on a 7-point scale. It is designed to gauge the extent of dissociation perceived as a continuum ranging from normal experiences to pathological psychotic symptoms. Only sample 1 participants took the questionnaire.
  5. Kon-2066: Only participants from sample 1 took this questionnaire. 22 items on a 2-point scale. It serves to evaluate personality traits associated with the occurrence and persistence of neurotic disorders, as well as changes resulting from psychotherapy.
  6. Bullshit Receptivity Scale–shortened version (BSR_10): Only participants from sample 6 took this questionnaire. 30 items on a 5-point scale. It measures the perception of pseudoprofound statements (“bullshit”) that are characterized by an illusion of a deeper, philosophical meaning, at the same time containing no meaning nor depth.
  7. Kwestionariusz Otwartości Przekonań(KOP20): Only participants from sample 6 took this questionnaire. It is used to measure superstition beliefs, such as “Knocking on unpainted wood reverts bad luck”. 20 items on a 4-point scle.
  8. Actively Open-minded Thinking Scale(AOT): Only participants from sample 6 took this questionnaire. 8 items on a 6-point scale.
KingArthur0205 commented 1 month ago

Zipped Version: NAMPRB_Siwiak_2024_CSV.zip NAMPRB_Siwiak_2024_Rdata.zip

Individual Datasets: NAMPRB_Siwiak_2024_AOT.csv NAMPRB_Siwiak_2024_BSR10.csv NAMPRB_Siwiak_2024_DESRPL.csv NAMPRB_Siwiak_2024_GCBS.csv NAMPRB_Siwiak_2024_KON2066.csv NAMPRB_Siwiak_2024_KOP20.csv NAMPRB_Siwiak_2024_NEOFFI.csv NAMPRB_Siwiak_2024_SSUB.csv

Zipped Version: NAMPRB_Siwiak_2024.zip Code:

# Paper: https://www.researchgate.net/profile/Klara-Buczel/publication/380193423_New_Age_of_measuring_paranormal_and_related_beliefs_Psychometric_properties_and_correlates_of_the_Polish_version_of_the_Survey_of_Scientifically_Unaccepted_Beliefs_SSUB/links/6630f38506ea3d0b7419c08d/New-Age-of-measuring-paranormal-and-related-beliefs-Psychometric-properties-and-correlates-of-the-Polish-version-of-the-Survey-of-Scientifically-Unaccepted-Beliefs-SSUB.pdf
# Data: https://osf.io/k2453/
library(dplyr)
library(tidyr)
library(haven)
library(readxl)

# ------ Helper Function ------
remove_na <- function(df) {
  df <- df[!(rowSums(is.na(df[, -which(names(df) == "id")])) == (ncol(df) - 1)), ]
  return(df)
}

df <- read_excel("data_SSUB-PL_adaptation.xlsx")
df <- df |>
  rename(id=Participant, sample=Sample) |>
  select(-Gender, -Age, -Education)

# ------ Process SSUB Dataset ------
ssub_df <- df |>
  select(id, sample, starts_with("SSUB"), -ends_with("mean"))
retest_ssub_df <- ssub_df[ssub_df$sample == 5, c("id", "sample", paste0("SSUB_RETEST_", 1:20))]

colnames(retest_ssub_df) <- gsub("RETEST", "NAB", colnames(retest_ssub_df)) # Rename retest as they are the same questions as wave 1
retest_ssub_df <- pivot_longer(retest_ssub_df, cols=-c("id", "sample"), names_to="item", values_to="resp")
retest_ssub_df$wave <- 1

ssub_df <- ssub_df |>
  select(-starts_with("SSUB_RETEST"))
#ssub_df$wave <- ifelse(ssub_df$sample == 5, 0, 0)
ssub_df$wave <- 0
ssub_df <- pivot_longer(ssub_df, cols=-c("id", "sample", "wave"), names_to="item", values_to="resp")

ssub_df <- rbind(ssub_df, retest_ssub_df)
ssub_df <- ssub_df |>
  select(-sample)

save(ssub_df, file="NAMPRB_Siwiak_2024_SSUB.Rdata")
write.csv(ssub_df, "NAMPRB_Siwiak_2024_SSUB.csv", row.names=FALSE)

# ------ Process GCBS Dataset ------
gcbs_df <- df |>
  select(id, starts_with("GCBS"), -ends_with("mean"))
gcbs_df <- remove_na(gcbs_df)
gcbs_df <- pivot_longer(gcbs_df, cols=-c("id"), names_to="item", values_to="resp")

save(gcbs_df, file="NAMPRB_Siwiak_2024_GCBS.Rdata")
write.csv(gcbs_df, "NAMPRB_Siwiak_2024_GCBS.csv", row.names=FALSE)

#  ------ Process NEO-FFI Dataset ------
neoffi_df <- df |>
  select(id, starts_with("NEO_FFI"))
neoffi_df <- remove_na(neoffi_df)
neoffi_df <- pivot_longer(neoffi_df, cols=-id, names_to="item", values_to="resp")

save(neoffi_df, file="NAMPRB_Siwiak_2024_NEOFFI.Rdata")
write.csv(neoffi_df, "NAMPRB_Siwiak_2024_NEOFFI.csv", row.names=FALSE)

# ------ Process DES-R-PL Dataset ------
desrpl_df <- df |>
  select(id, starts_with("DES"), -ends_with("sum"))
desrpl_df <- remove_na(desrpl_df)
desrpl_df <- pivot_longer(desrpl_df, cols=-id, names_to="item", values_to="resp")
desrpl_df <- desrpl_df %>%
  mutate(resp = ifelse(resp == 8, NA, resp))

save(desrpl_df, file="NAMPRB_Siwiak_2024_DESRPL.Rdata")
write.csv(desrpl_df, "NAMPRB_Siwiak_2024_DESRPL.csv", row.names=FALSE)

# ------ Process Kon-2066 Dataset ------
kon2066_df <- df |>
  select(id, starts_with("KON"), -ends_with("sum"))
kon2066_df <- remove_na(kon2066_df)
kon2066_df <- pivot_longer(kon2066_df, cols=-id, names_to="item", values_to="resp")

save(kon2066_df, file="NAMPRB_Siwiak_2024_KON2066.Rdata")
write.csv(kon2066_df, "NAMPRB_Siwiak_2024_KON2066.csv", row.names=FALSE)

# ------ Process BSR10 Dataset ------
bsr_df <- df |>
  select(id, starts_with("BSR"), -ends_with("mean"))
bsr_df <- remove_na(bsr_df)
bsr_df <- pivot_longer(bsr_df, cols=-id, names_to="item", values_to="resp")

save(bsr_df, file="NAMPRB_Siwiak_2024_BSR10.Rdata")
write.csv(bsr_df, "NAMPRB_Siwiak_2024_BSR10.csv", row.names=FALSE)

# ------ Process KOP20 Dataset ------
kop_df <- df |>
  select(id, starts_with("KOP"), -ends_with("mean"))
kop_df <- remove_na(kop_df)
kop_df <- pivot_longer(kop_df, cols=-id, names_to="item", values_to="resp")

save(kop_df, file="NAMPRB_Siwiak_2024_KOP20.Rdata")
write.csv(kop_df, "NAMPRB_Siwiak_2024_KOP20.csv", row.names=FALSE)

# ------ Process AOT Dataset ------
aot_df <- df |>
  select(id, starts_with("AOT"), -ends_with("mean"))
aot_df <- remove_na(aot_df)
aot_df <- pivot_longer(aot_df, cols=-id, names_to="item", values_to="resp")

save(aot_df, file="NAMPRB_Siwiak_2024_AOT.Rdata")
write.csv(aot_df, "NAMPRB_Siwiak_2024_AOT.csv", row.names=FALSE)
KingArthur0205 commented 1 month ago

License of preprint: CC BY 4.0

ben-domingue commented 1 month ago

huzzah!

ben-domingue commented 1 month ago

ah, wait, it's a little more complicated. the library has advised me that a preprint license doesn't necessarily apply to data. i'll send an email to these authors.

KingArthur0205 commented 1 month ago

ah, wait, it's a little more complicated. the library has advised me that a preprint license doesn't necessarily apply to data. i'll send an email to these authors.

Oh shoot. I don't think they declared a license for the data...

ben-domingue commented 1 month ago

as an example of something cleanly licensed on osf, see here: https://osf.io/eapd8/ note highlighted bit.

image

KingArthur0205 commented 1 month ago

as an example of something cleanly licensed on osf, see here: https://osf.io/eapd8/ note highlighted bit.

image

Thanks for the example! I checked both the preprint and OSF but found no luck

ben-domingue commented 1 month ago

email sent to authors

KingArthur0205 commented 1 month ago

email sent to authors

Just to confirm, we should resolve the licensing issue before starting to process the datasets, in case the authors don't respond. :)

ben-domingue commented 1 month ago

exactly. i have a large queue of data that i have processes but that didn't have clear licesning terms. kind of a dead end for the irw so am trying to reduce amount of that we're doing :)

ben-domingue commented 1 month ago

@KingArthur0205 i got permission to post these so think we need a PR for the code.

ben-domingue commented 1 month ago

actually some questions first @KingArthur0205 :

KingArthur0205 commented 1 month ago

@ben-domingue "NAMPRB_Siwiak_2024_SSUB.Rdata": This is actually because participants in sample 1-4 took a second trial and those in sample 5 didn't, so I just left the wave of those participants as NA. Shall we treat them (and perhaps future datasets) as wave 1?

"NAMPRB_Siwiak_2024_DESRPL.Rdata": This is actually a 0-7 scale, so the value of 8 is unusual. I’ll update the code and datasets to mark it as NA.

KingArthur0205 commented 1 month ago

@ben-domingue Code and datasets updated in the cell above.

ben-domingue commented 1 month ago

@KingArthur0205 yeah i think wave=NA is unclear. i get that wave=1 for one study is probably a little bit of a misnomer but seems potentially less awkward?

processing data now. ship PR?

KingArthur0205 commented 1 month ago

PR Created :) https://github.com/ben-domingue/irw/pull/592