mathedjoe / animaltracker

Visualize and analyze GPS data for cows (and other animals).
5 stars 6 forks source link

Cleaning Exported Data sheet #64

Closed arispes closed 4 years ago

arispes commented 4 years ago

I'm noticing minor issue in the exported data--after cleaning. Below are the issues:

1) Column V (TimeDiff) and ColumnW (TimeDiffMin) are identical. Consolidate to one column, which should be "TimeDifferenceMinutes."

2) Column Y (GPS): only include the GPS number Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Correct output: 109

3) Column Z (Animal): only include Cow number Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Correct output: 1090

4) Column AA (DistGeo) The first datapoint for every animal (after cleaning/processing data) should be "0." Here, it is 78150.8582.

5) Column L (Rate) is calculated based on Distance (Col K) divided by Time Difference in Minutes (Col X). -Should rate be calculated using DistGeo (Col AA)? 6) Place a "0" on the first row for each animal. -Speed (Col H), Course (Col I), Course Diff (Col J), Distance (Col K), Rate (Col L), TimeDiffMins (Col X), DistGeo (Col AA)

data_export_2020-02-25_11-10-AM.csv.zip

ttsukianto commented 4 years ago

For bullet points 2 and 3, we currently have it implemented so that the formatting is Site(GPS number)(Cow number). Should we add this formatting as an alternative?

arispes commented 4 years ago

Bullet 2: Column Y should only have the GPS number--isolated from the original formatting. Column Y--Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Column Y--Correct output: 109

Bullet 3: Same as above but Column Z.
Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Correct output: 1090

dylanmikesell commented 4 years ago

Sergio, are the column always going to be formatted the same, e.g. ..._GPS_109? There needs to be some regularity to write a code that, for example, splits text on underscores and then finds the entry right after cows for this request to be automated.

Dylan

On Mon, Mar 23, 2020 at 12:56 PM Sergio Arispe notifications@github.com wrote:

Bullet 2: Column Y should only have the GPS number--isolated from the original formatting. Column Y--Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Column Y--Correct output: 109

Bullet 3: Same as above but Column Z. Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Correct output: 1090

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/mathedjoe/animaltracker/issues/64#issuecomment-602792392, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABVIE4VS7BF3TLHUJ34BGCDRI6WEHANCNFSM4K3RYPGA .

arispes commented 4 years ago

Every file will be formatted the same:

Location_timeperiod_collarnumber_animalID

I realized the folder that I compressed had the wrong naming format. My apologies. I ran it again and got the correct names within the columns.

Regards, Sergio


Sergio Arispe, Ph.D., P.A.S., Assistant Professor Oregon State University Department of Animal & Rangeland Sciences OSU Extension Service—Malheur County | Livestock and Rangeland 710 SW 5th Ave Ontario, OR 97914 P: 541-881-1417 (x104) | C: 530-304-0620 | F: 541-889-8840 Facebookhttps://www.facebook.com/MalheurCountyLivestockAndRangelandExtension | Twitterhttps://twitter.com/MalheurLvstkRng?lang=en | YouTubehttps://catalog.extension.oregonstate.edu/series3 Subscribe to my eNewsletterhttp://eepurl.com/gKbhbH

On Mar 23, 2020, at 1:27 PM, Arispe, Sergio Sergio.Arispe@oregonstate.edu<mailto:Sergio.Arispe@oregonstate.edu> wrote:

Every file will be formatted the same:

Location_timeperiod_collarnumber_animalID (reference P.16; Utilizing GPS technology for Data Analysis—attached).

I realized the folder that I compressed had the wrong naming format. My apologies. I ran it again and got the correct names within the columns.

Regards, Sergio


Sergio Arispe, Ph.D., P.A.S., Assistant Professor Oregon State University Department of Animal & Rangeland Sciences OSU Extension Service—Malheur County | Livestock and Rangeland 710 SW 5th Ave Ontario, OR 97914 P: 541-881-1417 (x104) | C: 530-304-0620 | F: 541-889-8840 Facebookhttps://www.facebook.com/MalheurCountyLivestockAndRangelandExtension | Twitterhttps://twitter.com/MalheurLvstkRng?lang=en | YouTubehttps://catalog.extension.oregonstate.edu/series3 Subscribe to my eNewsletterhttp://eepurl.com/gKbhbH <Screen Shot 2020-03-23 at 1.27.28 PM.png>

On Mar 23, 2020, at 1:15 PM, Dylan Mikesell notifications@github.com<mailto:notifications@github.com> wrote:

Sergio, are the column always going to be formatted the same, e.g. ..._GPS_109? There needs to be some regularity to write a code that, for example, splits text on underscores and then finds the entry right after cows for this request to be automated.

Dylan

On Mon, Mar 23, 2020 at 12:56 PM Sergio Arispe notifications@github.com<mailto:notifications@github.com> wrote:

Bullet 2: Column Y should only have the GPS number--isolated from the original formatting. Column Y--Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Column Y--Correct output: 109

Bullet 3: Same as above but Column Z. Current output: Unknown_ThreeFIngers_GPS_109_Cow1090 Correct output: 1090

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/mathedjoe/animaltracker/issues/64#issuecomment-602792392, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABVIE4VS7BF3TLHUJ34BGCDRI6WEHANCNFSM4K3RYPGA .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/mathedjoe/animaltracker/issues/64#issuecomment-602802493, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AK2DUQYB24WMCMT56RQGGP3RI6YMDANCNFSM4K3RYPGA.