aboutcode-org / ai-gen-code-search

A set of utilities and tools to detect and search AI-generated code
1 stars 0 forks source link

Consider using token replacement and abstraction #6

Open pombredanne opened 2 weeks ago

pombredanne commented 2 weeks ago

This is something done here for instance https://dickgrune.com/Programs/similarity_tester/ See:

Each code token is assigned a normalized replacement (here a single letter) and this is what is used afterwards.