hurlbertlab / dietdatabase

Creative Commons Zero v1.0 Universal
10 stars 9 forks source link

cleaning: Beal data duplicates #35

Closed ahhurlbert closed 7 years ago

ahhurlbert commented 7 years ago

Need to double-check that data are not being recorded twice for species that appear in multiple diet compendia by Beal (e.g. Beal 1907, Beal 1912, Beal 1916, Beal 1918, Beal et al. 1941, etc).

E.g., Scissor-tailed flycatcher appears in both Beal 1941 & Beal 1912, with the same data reported each time (although perhaps not to the same level of detail?). In cases where the same data are repeated in multiple sources we want to eliminate the duplicate source and use the earliest date.

Purple martin appears in both Beal et al. 1941 & Beal 1918 & Beal et al. 1916, and in this case the diet data seem to be from different analyses between 1918 and 1916/1941 (and in fact the results are quite different!).

NOTE: Beal et al. 1941 is really just a republishing of Beal et al. 1916. Need to check numbers more thoroughly, but only difference I saw was that Swallow-tailed Kite (which was present in 1916, but without quantitative data) was replaced by Barn Owl (in 1941, but also without sufficiently quantitative data to merit inclusion).