azhe825
commented
8 years ago CCFinder: a multilinguistic token-based code clone detection system for large scale source code (2002, 1155)
Use tokenization, but not standard text mining methods.
Transformation: in order to detect clones slightly modified
Issues in Clone Detection
- Identification of Structures: clones start in the middle of a function and ends in the middle of another function is not considered. Detect funcs, classes, tables first.
- Regularization of Identifiers: transform complex names into simple form. the front-end of the clone detection tool, the lexical analysis and transformation, should include all language-dependent parts; whereas, the back-end, the matching detection, should be language independent.
- Measuring Clones: distinguish important clones from many "uninteresting" clones. Clones that are widely spread become important.
Procedures:
Lexical Analysis
- The tokens of all source files are concatenated into a single token sequence, so that finding clones in multiple files is performed in the same way as single file analysis.
Transformation
Match Detection
- Each clone pair is represented as a quadruplet (LeftBegin, LeftEnd, RightBegin, RightEnd), where LeftBegin and LeftEnd are the beginning and termination positions (indices in the token sequence) of a leading clone, and RightBegin and RightEnd belong to another following clone for a clone pair.
Formatting
- Each location of clone pair is converted into line numbers on the original source files.
CCFinder: a multilinguistic token-based code clone detection system for large scale source code (2002, 1155)