ai-se / ML-assisted-SLR

Automated Systematic Literature Review
2 stars 2 forks source link

SE community #19

Open azhe825 opened 8 years ago

azhe825 commented 8 years ago

About SLR

Evidence-based software engineering

Evidence-based software engineering for practitioners

First brought to SE community

Guidelines for performing systematic literature reviews in software engineering

The famous GOLDEN guideline

A systematic review of systematic review process research in software engineering

An recent review

Overview

Outcomes of a Community Workshop to Identify and Rank Barriers to the Systematic Literature Review Process

Identifying barriers to the systematic literature review process

Same goal. Primary study selection being identified as the top three most difficult, time-consuming, tool support needed phase in SLR.

Tools to support systematic reviews in software engineering: A cross-domain survey using semi-structured interviews

Tools to Support Systematic Reviews in Software Engineering: A Feature Analysis Best study for tools

Tools to support systematic literature reviews in software engineering: A mapping study

tools

SLuRp: a tool to help large complex systematic literature reviews deliver valid and rigorous results

SESRA: A Web-based Automated Tool to Support the Systematic Literature Review Process best and latest tool so far

SLR-Tool: A Tool for Performing Systematic Literature Reviews.

Using GQM and TAM to evaluate StArt-a tool that supports Systematic Review

VTM

A Visual Analysis Approach to Update Systematic Reviews

A visual analysis approach to validate the selection review of primary studies in systematic reviews

An approach based on visual text mining to support categorization and classification in the systematic mapping

A visual text mining approach for systematic reviews

timm commented 8 years ago

just to keep everything in one place

image

timm commented 8 years ago

@azhe825 writes:

Thanks! That is helpful. Will include these two studies in background.

What I found in SE community is that:

  1. Many tools developed to support lit review. (No active learning involved, no attempt to let user review LESS docs)
  2. Visual Text Mining (VTM) applied to assist lit review. (Unsupervised learning.) Among the four VTM papers (2007, 2010, 2012, 2014)

    2007: closes to our target. use VTM to exclude some docs. Very small scale experiment (100 docs, 31 relevant). Can reduce the time taken for screening to 30% and retrieving 90% relevant docs.

    2010: VTM is not used to assist screening but Systematic Mapping. VTM happens AFTER screening and is applied to visualize the included docs (as some clusters, similarity measurement) to assist mapping.

    2012: VTM is used to assist screening. Not trying to reduce the num of docs need to review, but provide additional information to help user decide whether to include or exclude. Can slightly increase accuracy and slightly reduce time taken of screening.

    2014: VTM is used to help update SLR. not related to screening.

timm commented 8 years ago

sounds likes you have a process map. e.g.

walking that map is like a phd. here is the big picture. here is this paper (best methods for "a") and future work will explore {b,c,d}

can you draw that map for me?

azhe825 commented 8 years ago

Big map is here.

Right now only focusing on primary study selection. Therefore only collected papers for this step.

I am still drawing one local map for primary study selection.

timm commented 8 years ago

good. a little verbose for a paper but a great phd road map. i we can get prof kraft to review (and slightly modify) this then we get a phd committee member for you . when u ge the hall results, we'll bring kraft up to critique

azhe825 commented 8 years ago

I am writing a 3 Section Version of the paper on sharelatex, it is not finished yet. Currently at the background section. Should I finish that first before getting prof Kraft review it?

timm commented 8 years ago

your call. sometimes i'm the brake on stuff. but unless i am going too slow, best show me stuff b4 kraft

so why not do this. do your stuff, send it to me, wait 2 days. if no feedback, send to kraft