search

emeryberger / CSrankings

A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.
http://csrankings.org
Other
2.67k stars 3.12k forks source link

lifting of moratorium #2234

Closed marcniethammer closed 1 year ago

marcniethammer commented 4 years ago

I am reposting issue #1422 on the lifting of the moratorium to add/change the existing areas as it has not been resolved and was auto-closed due to inactivity. The moratorium appears to have been in place for about two years now. Given the desire by various communities to be included, as well as the analysis by @fycus-tree (#859), it would be useful to revisit the moratorium or to communicate why it is in place and what the plan for lifting it is. The analysis by @fycus-tree (#859) also suggests that some areas should likely be included while others appear not to fulfill the inclusion criteria as stated.

Here is the reposted issue (originally posted Mar 21, 2019, with a follow-up requests for an update on June 21, 2019, then auto-closed due to inactivity on Nov 24, 2019):

Hi Emery,

what are the current thoughts on lifting the 2018 moratorium (see your response in #856) on adding new areas / conferences?

There seem to be many open requests and, of course, there is also the quantitative analysis by @fycus-tree (#859).

Thanks for any updates on this issue.

For convenience, here is a reasonably complete list of open issues in this regard to allow for a quick overview: #1312, #1256, #839, #856, #762, #367, #238, #427, #423, #366, #361, #263, #259, #240, #162, #147, #99, #38

bhatiasiddharth commented 4 years ago

Has there been any update? I think the community has been requesting for quite a lot of time. @emeryberger: Sir, can you please reconsider.

williamstome commented 4 years ago

Bumping this with particular attention to HCI, which is currently broken on this site due to incorrect level of granularity. @emeryberger

marcniethammer commented 4 years ago

@emeryberger What are your thoughts on this?

marcniethammer commented 3 years ago

Hi @emeryberger, are there any thoughts on lifting the moratorium and considering adding new areas?

It seems like this has been requested for a long time by people from various different fields. Unfortunately, without a resolution/response so far.

What would be a reasonable way forward, in your opinion?

marcniethammer commented 3 years ago

Hi @emeryberger , just wondering what your thoughts are on how to move forward. I.e., is your plan to keep the areas / conferences static? Or is it likely that it will be possible to include new areas? (If so with what process?)

Besides the open issues from my original post in 2019 there are several new requests for areas to consider. For example these: #3518 #3002 #2667 #2504 .

I have no horse in the race for any of these areas above (well, maybe a little bit for ICLR). I am just mentioning them because the topic of area inclusion keeps popping up and is likely creating frustration for people in areas that are not included. I imagine it might be actively harmful for student recruitment for the non-included areas (which is certainly not the intention of csrankings). So it would be good to work toward a solution. I'd be happy to help if there is something I can do.

Thanks for considering.

marcniethammer commented 2 years ago

Hi @emeryberger , sorry for my persistence here. Any update? Or is the conclusion that the areas and conferences are fixed and will not be changed? There seem to be many community requests for adding different areas and conferences. Some likely stronger than others, but certainly not all unwarranted.

emeryberger commented 1 year ago

I have added ICLR. It is unlikely that a new area of "medical image analysis" will be added to CSrankings in the near term.

marcniethammer commented 1 year ago

@emeryberger Why is it that it seems like no new areas can ever be added? Also, what speaks against medical image analysis? I provided a detailed analysis years ago and it is still a mystery to me why medical image analysis should not be considered computer science, while other interdisciplinary areas are included. What is your argument?

Please also note that issue #2234 is related to the general moratorium which affects many different areas and goes way beyond medical image analysis. I don't think it is appropriate to close this issue and declare success by simply adding ICLR (though it is a positive move). What about all the other community requests? Will there finally be a real process?

williamstome commented 1 year ago

Agreed. The HCI topic is still a mess after years of requests (where is CSCW? HRI?) and we basically have to tell students to ignore the site if they're interested in HCI. Feels deeply unhelpful to add ICLR and call this closed.

On Sat, Dec 3, 2022, 3:00 PM marcniethammer @.***> wrote:

@emeryberger https://github.com/emeryberger Why is it that it seems like no new areas can ever be added? Also, what speaks against medical image analysis? I provided a detailed analysis years ago and it is still a mystery to me why medical image analysis should not be considered computer science, while other interdisciplinary areas are included. What is your argument?

Please also note that issue #2234 https://github.com/emeryberger/CSrankings/issues/2234 is related to the general moratorium which affects many different areas and goes way beyond medical image analysis. I don't think it is appropriate to close this issue and declare success by simply adding ICLR (though it is a positive move). What about all the other community requests? Will there finally be a real process?

— Reply to this email directly, view it on GitHub https://github.com/emeryberger/CSrankings/issues/2234#issuecomment-1336265860, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAXFQTRGPY7ESDF4BBQHNE3WLO7HHANCNFSM4KCG26CA . You are receiving this because you commented.Message ID: @.***>

tejas-gokhale commented 1 year ago

@williamstome I have locally built csrankings and have managed to figure out (after a lot of playing around) how to add new conferences -- it takes a bit of work but is not difficult to do. I will try to add HRI, CSCW -- let me know if you have any other requests.

As my own little pet project, I am planning to

  1. add conferences that others have requested before (such as AISTATS, UAI, WSDM, AAMAS, ICAPS, ...). I will read the issues that @marcniethammer has mentioned above to make a list of other requested conferences.
  2. add "Speech" as an area with InterSpeech and ICASSP. I am actually very curious how the speech area has not been requested before (if Vision is part of "AI" surely Speech should also be?).
  3. add well known journals in my area (T-PAMI, TACL, JMLR, TMLR, JAIR) -- I don't think the ranking should be based on conferences only.

For folks reading this, note that I am doing this just as a fun (what?!) exercise. I am also a complete novice when it comes to writing websites like this, so I am not in a position to promise anything!

emeryberger commented 1 year ago

The terms of CSrankings explicitly forbid derivatives.

On Mon, May 22, 2023 at 18:31 Tejas Gokhale @.***> wrote:

@williamstome https://github.com/williamstome I have locally built csrankings and have managed to figure out (after a lot of playing around) how to add new conferences -- it takes a bit of work but is not difficult to do. I will try to add HRI, CSCW -- let me know if you have any other requests.

As my own little pet project, I am planning to

  1. add conferences that others have requested before (such as AISTATS, UAI, WSDM, AAMAS, ICAPS, ...). I will read the issues that @marcniethammer https://github.com/marcniethammer has mentioned above to make a list of other requested conferences.
  2. add "Speech" as an area with InterSpeech and ICASSP. I am actually very curious how the speech area has not been requested before (if Vision is part of "AI" surely Speech should also be?). An arbitrary defi
  3. add well known journals in my area (T-PAMI, TACL, JMLR, TMLR, JAIR) -- I don't think the ranking should be based on conferences only.

For folks reading this, note that I am doing this just as a fun (what?!) exercise. I am also a complete novice when it comes to writing websites like this, so I am not in a position to promise anything!

— Reply to this email directly, view it on GitHub https://github.com/emeryberger/CSrankings/issues/2234#issuecomment-1556776854, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAMJXM3MI4C3ZMCREEJMP4LXHMP5HANCNFSM4KCG26CA . You are receiving this because you were mentioned.Message ID: @.***>

--

Professor Emery Berger College of Information and Computer Sciences University of Massachusetts Amherst www.emeryberger.org, @emeryberger

williamstome commented 1 year ago

Are you ever planning on addressing the problems people have been raising for years regarding the arbitrary exclusion of top tier conferences? It sounds like Tejas is willing to put in the work for you.

On Mon, May 22, 2023, 4:21 AM Emery Berger @.***> wrote:

The terms of CSrankings explicitly forbid derivatives.

On Mon, May 22, 2023 at 18:31 Tejas Gokhale @.***> wrote:

@williamstome https://github.com/williamstome I have locally built csrankings and have managed to figure out (after a lot of playing around) how to add new conferences -- it takes a bit of work but is not difficult to do. I will try to add HRI, CSCW -- let me know if you have any other requests.

As my own little pet project, I am planning to

  1. add conferences that others have requested before (such as AISTATS, UAI, WSDM, AAMAS, ICAPS, ...). I will read the issues that @marcniethammer https://github.com/marcniethammer has mentioned above to make a list of other requested conferences.
  2. add "Speech" as an area with InterSpeech and ICASSP. I am actually very curious how the speech area has not been requested before (if Vision is part of "AI" surely Speech should also be?). An arbitrary defi
  3. add well known journals in my area (T-PAMI, TACL, JMLR, TMLR, JAIR) -- I don't think the ranking should be based on conferences only.

For folks reading this, note that I am doing this just as a fun (what?!) exercise. I am also a complete novice when it comes to writing websites like this, so I am not in a position to promise anything!

— Reply to this email directly, view it on GitHub < https://github.com/emeryberger/CSrankings/issues/2234#issuecomment-1556776854 , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAMJXM3MI4C3ZMCREEJMP4LXHMP5HANCNFSM4KCG26CA

. You are receiving this because you were mentioned.Message ID: @.***>

--

Professor Emery Berger College of Information and Computer Sciences University of Massachusetts Amherst www.emeryberger.org, @emeryberger

— Reply to this email directly, view it on GitHub https://github.com/emeryberger/CSrankings/issues/2234#issuecomment-1556960253, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAXFQTQTMKRAHF7IIUUTTF3XHM43VANCNFSM4KCG26CA . You are receiving this because you were mentioned.Message ID: @.***>

marcniethammer commented 1 year ago

This particular issue (on lifting of the moratorium) was also simply closed without actually resolving any of the underlying issues.