CSSEGISandData / COVID-19

Novel Coronavirus (COVID-19) Cases, provided by JHU CSSE
https://systems.jhu.edu/research/public-health/ncov/
29.16k stars 18.47k forks source link

Naming Convention #482

Closed CSSEGISandData closed 4 years ago

CSSEGISandData commented 4 years ago

We are working to reconsider naming convention of countries. Sorry for the inconvenience and thank you for your patience through these transitions.

cwacht commented 4 years ago

Thank you for the update!

StateCenterKid commented 4 years ago

Please consider keeping the naming conventions of March 9th and making the modifications in a separate file. This will give users time to transition to the new formats.

Your work is greatly appreciated and the daily releases work great for the intended use of this data.

jimmychang851129 commented 4 years ago

Many thanks ! It really means a lot to us that Taiwan is not part of China.

SeanHung06 commented 4 years ago

Many Thanks!

scottmcdaniel commented 4 years ago

For reference: https://github.com/CSSEGISandData/COVID-19/issues/415

memochou1993 commented 4 years ago

Taiwan is Not a part of China. Thank you for your reconsideration.

Miserlou commented 4 years ago

Although the team here is claiming they are "working to reconsider", the University is telling journalists that it will not be changed back: https://twitter.com/BethanyAllenEbr/status/1237565381788569603

Terribly shameful for the University, sad for an otherwise extremely beneficial project.

+1 for reverting the change.

Miserlou commented 4 years ago

Interestingly, this ticket has also made the wire service, which is something I've never seen before: https://www.reuters.com/article/us-health-coronavirus-taiwan-university/taiwan-protests-as-top-u-s-university-labels-island-part-of-china-on-virus-map-idUSKBN20Y0NK

changey commented 4 years ago

Thank you! Appreciated!

takua624 commented 4 years ago

Thanks for reconsidering this. Hope the labels can soon resume what they were prior to March 9th.

ladris commented 4 years ago

I, for one, feel it's atrocious that instead of having a civil discourse about it, as academic pursuit requires, the response was to spam and essentially attempt to hold the project hostage until demands were met.

So now, instead of having a single thread with lots of feedback and support, where discussions of potential ways to handle a solution are thought out in a forum, we will have hundreds of one liner protest threads that are ignored and basically automatically closed on sight due to either the lack of cohesiveness, rhetoric, or occasionally downright repulsive commentary.

Eclipsed830 commented 4 years ago

I, for one, feel it's atrocious that instead of having a civil discourse about it, as academic persuit requires, the reaponse was to spam and essentialy attempt to hold the project hostage until demands were met.

While I agree it might have been better if all the responses and comments were in a single ticket, let's not let that get in the way of correcting the issue at hand. If this was about academic rigor, the name change never would have or should have happened in the first place. The media has WIDELY reported Taiwan's contributions and best practices with regards to this specific virus and Taiwan should have never been censored and marginalized like they were with this policy change. The fact of the matter is, Taiwan has never been part of the PRC and the Chinese Communist Party has never had effective authority over the country of Taiwan. Labeling Taiwan under China and as "Taipei" instead of Taiwan is absolutely unacceptable and that sort of misinformation does not belong anywhere, let alone on a Johns Hopkins University project. Of course people got upset over this issue... with this update it essentially made it so Taiwan and the 23+ million people that put blood, sweat and tears into their country simply don't exist.

As I said in the other ticket, the last sentence in the Reuters article talking about this issue is the most important key point that I hope the team here understands:

The island is not governed in any way by Beijing, and Beijing has no direct say in its health policy or how it handles the virus.

ladris commented 4 years ago

That's not what it did at all, that's a political perception of the issue. The fact of the matter, is the project is data driven. If it's demonstrated that someone on the project maliciously edited or modified the data TO do that, that is one thing. It's another entirely if, in the course of formatting continuously being adjusted because not everyone has a Country>State>County>City>Town>Village model, that ultimately the guidelines of organization from the WHO were followed, then go protest the WHO. The appropriate response is certainly not to go mass disrupt a global source of information as a miss-targeted entity.

But for people to mass post that "China has corrupted JHU" and "JHU Adheres to the One China policy" is a farce.

I highly doubt someone woke up and said "Oh, hmmm, Taiwan... can't have them independent" and most likely it was a mass edit of formatting across multiple countries. My issue isn't whether or not it should be listed independently, but how the response was handled, and the continuous validation that it's an appropriate response.

Eclipsed830 commented 4 years ago

That's not what it did at all, that's a political perception of the issue. The fact of the matter, is the project is data driven. If it's demonstrated that someone on the project maliciously edited or modified the data TO do that, that is one thing. It's another entirely if, in the course of formatting continuously being adjusted because not everyone has a Country>State>County>City>Town>Village model, that ultimately the guidelines of organization from the WHO were followed, then go protest the WHO. The appropriate response is certainly not to go mass disrupt a global source of information as a miss-targeted entity.

I think the issue is people are talking about the output on the actual map posted by @CSSEGISandData and not the git repository itself. You have two types of people here; people upset that Taiwan was removed and censored on the map, and people upset that their dataset was broken.

Taiwan is not a member of the WHO, so protesting the WHO would be meaningless. The best you can do is go directly to the source (here).

I highly doubt someone woke up and said "Oh, hmmm, Taiwan... can't have them independent" and most likely it was a mass edit of formatting across multiple countries. My issue isn't whether or not it should be listed independently, but how the response was handled, and the continuous validation that it's an appropriate response.

To be fair, China is kind of notorious for forcing these types of edits and Taiwanese people are just sick of it I think...

ladris commented 4 years ago

To be fair, China is kind of notorious for forcing these types of edits and Taiwanese people are just sick of it I think...

To be honest, I have very similar feelings. But also understand time and place needs to be considered. This legitimately has a chance of snowballing recklessly out of control to the point where the top 10 pages are nothing but the same, one line thread over and over again to the point that it would have to be mass "censored" which would cause even more fury because it "validates" that they are being oppressed and censored, instead of the reality being the mass spam being disruptive with only one real solution. :-/

takua624 commented 4 years ago

I, for two, think it completely reasonable to blame JHU before JHU explains it's just reporting whatever misinformation the WHO feed it. Now that we know the origin of this farce is WHO (or, CHO since it's obeying the instructions from china so faithfully), we'll make sure that every Taiwanese knows it's useless to issue a complaint here.

Without the knowledge about the involvement of WHO, it seems just like the maintainer of this map surreptitiously brought chinese propaganda into this project. Instead of issuing complaints, do you expect Taiwanese to appreciate the elegance of this sneaky move (although now we know they probably didn't do it) and patiently check out who has already filed a complaint and leave a feeble "yeah, please change it back" comment in that inconspicuous thread?

I, for three, think no one can hold the project hostage just by leaving angry comments. The maintainer of the project can still do what they want to do, and people can still report whatever other bugs they find.

I, for one, think it's actually atrocious to use "atrocious" to describe the anguish felt by the Taiwanese due to the injustice delivered by WHO.

designbyadrian commented 4 years ago

Can we stop shouting about Big Bad China and just recognise the fact that printing data with free-text fields as keys is bad practice? Taiwan isn't unique in receiving wrong country names.

ladris commented 4 years ago

Without the knowledge about the involvement of WHO, it seems just like the maintainer of this map surreptitiously brought chinese propaganda into this project. Instead of issuing complaints, do you expect Taiwanese to appreciate the elegance of this sneaky move (although now we know they probably didn't do it) and patiently check out who has already filed a complaint and leave a feeble "yeah, please change it back" comment in that inconspicuous thread?

No, I expect them to be very vocal about it. In a single thread. As I said. 70+ one liner threads get spammed out, filtered and closed. A single thread, or even two threads, with 500+ responses keeps attention as long as it is civil.

I, for three, think no one can hold the project hostage just by leaving angry comments. The maintainer of the project can still do what they want to do, and people can still report whatever other bugs they find.

And sure, no one person could. But how about when the top 600 "issue" posts are rhetoric protest posts? Or when 1 out of every 16 posts is actually a technical issue or missing cases report. How about when people go to report an issue and see nothing but a spam "attack" and decide that a crucial issue isn't worth reporting because the devs will never see it?

I, for one, think it's actually atrocious to use "atrocious" to describe the anguish felt by the Taiwanese due to the injustice delivered by WHO.

And we haven't even discussed the extra time sink necessary to police and clean up the posts being taken out of the maintainers probably valuable time.

takua624 commented 4 years ago

If it's wrong from the beginning, it's just a mistake. But it has been correct for more than a month, and then become wrong, that made Taiwanese suspect it's Big Bad China taking advantage of the bad practice of printing data with free-text fields as keys.

takua624 commented 4 years ago

Without the knowledge about the involvement of WHO, it seems just like the maintainer of this map surreptitiously brought chinese propaganda into this project. Instead of issuing complaints, do you expect Taiwanese to appreciate the elegance of this sneaky move (although now we know they probably didn't do it) and patiently check out who has already filed a complaint and leave a feeble "yeah, please change it back" comment in that inconspicuous thread?

No, I expect them to be very vocal about it. In a single thread. As I said. 70+ one liner threads get spammed out, filtered and closed. A single thread, or even two threads, with 500+ responses keeps attention as long as it is civil.

I, for three, think no one can hold the project hostage just by leaving angry comments. The maintainer of the project can still do what they want to do, and people can still report whatever other bugs they find.

And sure, no one person could. But how about when the top 600 "issue" posts are rhetoric protest posts? Or when 1 out of every 16 posts is actually a technical issue or missing cases report. How about when people go to report an issue and see nothing but a spam "attack" and decide that a crucial issue isn't worth reporting because the devs will never see it?

I, for one, think it's actually atrocious to use "atrocious" to describe the anguish felt by the Taiwanese due to the injustice delivered by WHO.

And we haven't even discussed the extra time sink necessary to police and clean up the posts being taken out of the maintainers probably valuable time.

Very civil. Got it.

paulyehtw commented 4 years ago

Hey, why on the earth you think Taiwan is a part of China? I suggest you to read some history and you will realize you are being ignorant

ladris commented 4 years ago

Hey, why on the earth you think Taiwan is a part of China? I suggest you to read some history and you will realize you are being ignorant

Whereas I think you should actually read the conversation before ignorantly posting

At no point did any of us say it was. However, we have all commented on the appropriate way to discuss the issue, of which you are a demonstration of the problem.

alexkychen commented 4 years ago

Hey @CSSEGISandData, I just want to give you a kind heads-up. Now it is 3 AM in Taiwan. Once the mistake (list Taiwan as part of China) is on Taiwan local media tomorrow morning, it will only make it crazier here. I bet you want to fix the bug very quickly. I highly appreciate your hard work and good luck!!

takua624 commented 4 years ago

It's already "fixed" somehow, Taiwan now belongs to the country/region "others"

ladris commented 4 years ago

Hey @CSSEGISandData, I just want to give you a kind heads-up. Now it is 3 AM in Taiwan. Once the mistake (list Taiwan as part of China) is on Taiwan local media tomorrow morning, it will only make it crazier here. I bet you want to fix the bug very quickly. I highly appreciate your hard work and good luck!!

Except it's not a bug nor a mistake. It's an issue with how the WHO defines sovereignty, and most of the data used comes from them. But it is being discussed and options looked at.

alexkychen commented 4 years ago

It's already "fixed" somehow, Taiwan now belongs to the country/region "others"

Great! That's an improvement. It would be perfect to see "Taiwan" listed on the "Confirmed Cases by Country/Region" panel instead of "others". Keep up the good work, folks!

designbyadrian commented 4 years ago

@alexkychen Why on earth would it be in the local media?

ladris commented 4 years ago

@alexkychen Why on earth would it be in the local media?

Never doubt the power of ill informed outrage.

takua624 commented 4 years ago

you still can do something to prevent this outrage: write to the Taiwan local media to tell them the right information.

alwaeles commented 4 years ago

Is it possible to add an ISO 3166-1 numeric field? This would allow better data processing with other datasets...

For example, https://population.un.org/wpp/Download/Standard/CSV/

At the moment it's not really possible to make an hard link between this dataset and those from the UN... Adding the numeric ID field would allow to compare much more things.

eacvo67347 commented 4 years ago

Hey, why on the earth you think Taiwan is a part of China? I suggest you to read some history and you will realize you are being ignorant

Whereas I think you should actually read the conversation before ignorantly posting

At no point did any of us say it was. However, we have all commented on the appropriate way to discuss the issue, of which you are a demonstration of the problem.

I think you are being too nice about this, and are giving China / WHO the benefit of the doubt.

A lot of people were drawn here because a report double checked with JHU for a response, and they flip flopped on their initial response.

When contacted by Axios, Lauren Gardner, an associate professor of civil and systems engineering at JHU who directs the map project, at first said they would be changing it back to "Taiwan" immediately.

However, a JHU spokesperson later said they would retain the term “Taipei and environs” and would be adopting the World Health Organization naming scheme, which also uses “Taipei and environs” to refer to Taiwan.

Just to list out Taiwan's accomplishments in keeping the coronavirus off its shores:

This is why Taiwan's numbers are so low. And this is why there is an outrage. I doubt other countries have done as much in keeping their citizens safe.

/rant

CSSEGISandData commented 4 years ago

please see issue #504

eacvo67347 commented 4 years ago

Is it possible to add an ISO 3166-1 numeric field? This would allow better data processing with other datasets...

For example, https://population.un.org/wpp/Download/Standard/CSV/

At the moment it's not really possible to make an hard link between this dataset and those from the UN... Adding the numeric ID field would allow to compare much more things.

quoting someone else about the issue of ISO country codes. Unicode CLDR is more equitable.

The problem with using ISO country codes is they are politicized as being involved with the ISO requires UN Membership. This is why using ISO 3166-2 country codes and naming is considered bad practice and most software developers instead use Unicode CLDR. http://cldr.unicode.org/translation/displaynames/country-names

https://github.com/unicode-cldr/cldr-localenames-full/blob/master/main/en/territories.json

Originally posted by @Eclipsed830 in https://github.com/CSSEGISandData/COVID-19/issues/372#issuecomment-597427641

eugene-yang commented 4 years ago

I would like to give credit to the team! @CSSEGISandData Thank you for addressing this issue.

I do understand there are political challenges out there and thank you so much for making this change. Based on your commit log, I know you are working really hard on this! image

and minutes after image

For everyone, especially Taiwanese like me, who was outrageous about this issue, please give them some credit for addressing this. They are a small team and faced tons of issues when updating the data last night. Having this issue handled in a day is incredible!

changey commented 4 years ago

Thank you @CSSEGISandData !

ohbriansung commented 4 years ago

Thank you @CSSEGISandData ! Well done!

eugene-yang commented 4 years ago

And a follow-up message to @CSSEGISandData, since you have already put it on github as an opensource project, feel free to reach out to the community for help. There are tons of experienced engineers and developers can help with solving whatever issues or even implementing new features.

Based on your commit log on web-data branch, I know you are working very hard on this and we can actually see the updates on the map. Nice work and feel free to call for help :)

takua624 commented 4 years ago

Thank you @CSSEGISandData ! I greatly appreciate your effort to restore a map free of the mis-information originated from WHO. I'm sorry for being not particularly civil and blamed you for altering how the data was represented.

weasellin commented 4 years ago

Thanks @CSSEGISandData for building this nice project, and for the great effort to handling this naming issue, to give us taiwanese people basic respect. Hope WHO could learn from you.

annieyanghy commented 4 years ago

Thank you @CSSEGISandData for making changes in the face of political hostility. However, I still want to know why Taiwan has a star sign though. I appreciate all of the efforts but just want to know the rationale behind. Thanks.

eugene-yang commented 4 years ago

@annieyanghy at the footnote of the interactive map FYI --

*This website and its contents herein, including all data, mapping, and analysis (“Website”), copyright 2020 Johns Hopkins University, all rights reserved, is provided to the public strictly for educational and academic research purposes. The Website relies upon publicly available data from multiple sources, that do not always agree. The names of locations correspond with the official designations used by the U.S. State Department, including for Taiwan. The Johns Hopkins University hereby disclaims any and all representations and warranties with respect to the Website, including accuracy, fitness for use, and merchantability. Reliance on the Website for medical guidance or use of the Website in commerce is strictly prohibited.

ShawTim commented 4 years ago

@CSSEGISandData excuse me - how about Hong Kong? It's still combined into China.

annieyanghy commented 4 years ago

@annieyanghy at the footnote of the interactive map FYI --

*This website and its contents herein, including all data, mapping, and analysis (“Website”), copyright 2020 Johns Hopkins University, all rights reserved, is provided to the public strictly for educational and academic research purposes. The Website relies upon publicly available data from multiple sources, that do not always agree. The names of locations correspond with the official designations used by the U.S. State Department, including for Taiwan. The Johns Hopkins University hereby disclaims any and all representations and warranties with respect to the Website, including accuracy, fitness for use, and merchantability. Reliance on the Website for medical guidance or use of the Website in commerce is strictly prohibited.

Thank you for the clarification. I was thinking that might be a footnote to it but couldn't find it. Thank you.

wzxu commented 4 years ago

"Taipei and environs, China" was such a creative, unprofessional, irresponsible, politics-over-global-health monstrosity of a naming by WHO. Casting aside the fact that PRC has never ruled over Taiwan for one second, it simply has zero say and no direct info of how the disease is being controlled in Taiwan, so how is it logical to even suggest they can represent her?

Now it's finally back to normal* Good job everyone 👏

KTHStw commented 4 years ago

Truly appreciate it. Thank you @CSSEGISandData

KevinCayenne commented 4 years ago

Truly thanks! Thanks @CSSEGISandData stand for making it change and all your effort on the map!

Johnny850807 commented 4 years ago

Apprecieted! @CSSEGISandData

hanshengchiu commented 4 years ago

If you multiply number of deaths and infections in China by 10, you'll get realistic numbers, not "official" ones.

lung2008123 commented 4 years ago

@CSSEGISandData Appreciate! Taiwan is an independent country, not a part of CCP & CRP.

goldflower commented 4 years ago

Thanks, you guys rock :)