search

emeryberger / CSrankings

A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.
http://csrankings.org
Other
2.65k stars 3.02k forks source link

Any chance of a "CS Education" Area? #11

Closed acbart closed 7 years ago

acbart commented 7 years ago

This could represent SIGCSE, TOCE, CSE, ITiCSE, ICER, etc. I know it's not the most popular subfield, but we're growing in importance and popularity.

emeryberger commented 7 years ago

It's possible though it might not meet the inclusion criteria (at least 50 R1 institutions have published at least one paper in the last 10 years). What are the top three conferences for this area?

acbart commented 7 years ago

I can't imagine that it'd be hard to meet the criteria; I suspect SIGCSE alone would manage that.

I would suggest that the top three conferences are:

I could see an argument for the CCCS conferences or the Koli conference, but I think those three are the big ones based on the SIGCSE community and the ACM Special Interest Group Page.

emeryberger commented 7 years ago

At this point, I do not see how SIGCSE can be included until it follows a more rigorous process of peer review that matches those of all the other represented communities - that is, until volunteer-based reviewing is replaced by traditional program committees composed of established experts.

http://sigcse2016.sigcse.org/reviewers/index.html

acbart commented 7 years ago

Well, issues with SIGCSE's review process aside, what about the other venues? TOCE, CSE, ITiCSE, etc. have more traditional review mechanisms and I'd be surprised to find out that none of them meet the established criteria.

emeryberger commented 7 years ago

CSRankings currently only includes journals that are the publication outlets for conferences.

What is the CSE to which you are referring? (DBLP link please.)

acbart commented 7 years ago

http://dblp2.uni-trier.de/db/journals/csedu/

emeryberger commented 7 years ago

Looks like it's an instance of a journal that is not a publication outlet for a conference.

acbart commented 4 years ago

At this point, I do not see how SIGCSE can be included until it follows a more rigorous process of peer review that matches those of all the other represented communities - that is, until volunteer-based reviewing is replaced by traditional program committees composed of established experts.

http://sigcse2016.sigcse.org/reviewers/index.html

You know, coming back to this 4 years later now that I have a job, I just wanna say that it was a bad bit of logic. Your stated criteria on your website does not say anything about applying peer review criteria. I think you should either update your FAQ or include the metrics.

emeryberger commented 4 years ago

SIGCSE is and remains a unique case. It remains the case that SIGCSE - unlike all other areas I am aware of - not only relies entirely on community-based reviewing, but also does not appear distinguish between research articles and practitioner's experience reports in the proceedings. These are both unlike every other area of CS represented in CSrankings (this is not a metrics concern, and it's also not a frequently-asked question). It would certainly help make the case for including SIGCSE were it to move its research output to be in line with the standards of the broader CS community. It remains to be seen whether it would meet the stated criteria in the FAQ of representation among R1 institutions.

acbart commented 4 years ago

Well, you can make arguments based on merits about whether you agree with SIGCSE's reviewing policy, but at the end of the day there are budding researchers who are trying to apply to graduate school, and they're apparently using your ranking site. They're recommended by folks like Phil Guo and Google. Sure, maybe you think that they shouldn't be presented with CS Ed as an option because the field isn't up to your standards for rigor. But the fact is that some folks, thankfully, will still persist and want to know this kind of information because they have no starting point about what the partial order of schools is. Locking out CS Ed may keep these numbers slightly closer to your desired reality, but they aren't really helping future graduate students make decisions. And I don't think this field is going to get better by staying stagnate.

a-cavalcanti commented 2 years ago

Is there any possibility to include the education area now in 2022?

For example: LAK - https://dblp2.uni-trier.de/db/conf/lak/index.html , ICALT - https://dblp2.uni-trier.de/db/conf/icalt/index.html

acbart commented 2 years ago

@emeryberger Here's an opportunity to reconsider again, another couple years later! Perhaps its time to finally introduce CS Education into your rankings?

SethPoulsen commented 2 years ago

An alternative proposal--if we were to make the area title slightly more general, and call it "Computers and Education" instead of "CS Education", it could include applications of computer science to solving education problems that aren't necessarily computer science education.

Then we could include the Artificial Intelligence in Education (AIED) and Educational Data Mining (EDM) conferences, giving us 3 conferences that meet @emeryberger's requirements:

ICER, AIED, and EDM.

What would people's thoughts be on that?

SethPoulsen commented 2 years ago

Another candidate for inclusion could be ACM's new Learning at Scale conference (L@S), which also meets the requirements.

tmbarnes commented 1 year ago

I agree, we need to add AI in Education, Educational Data Mining, Learning at Scale, ICER, ITiCSE, and SIGCSE.

If SIGCSE is excluded, I could see that, if there is an explicit written policy about what kind of peer review structure is required, and if SIGCSE does not meet it, then it would be reasonable to exclude it.