search

secure-software-engineering / TypeEvalPy

A Micro-benchmarking Framework for Python Type Inference Tools
26 stars 3 forks source link

Dynamic Type Inference #2

Open bengsparks opened 8 months ago

bengsparks commented 8 months ago

Are there any plans to support dynamic type inference via Instagram's MonkeyType or Dropbox's pyannotate? If so, Gruber et. al's FlaPy can be used for dependency installation and sandboxing.

ashwinprasadme commented 8 months ago

We did initially look into this and limited our scope to only static analysis tools. But, this looks interesting. We will add this to our pipeline. Would you like to contribute to this? We can have a separate leaderboard for dynamic tools.

bengsparks commented 7 months ago

Hi, what kind of contribution would be needed? I had cobbled together something with MonkeyType and FlaPy that permitted tracing of singular repositories (assuming dependency installation succeeded) for my master's thesis, I could probably reproduce it