search

pvs-hd-tea / PyTypes

Infer Types by Python Tracing
MIT License
11 stars 1 forks source link

Update main to evaluate projects with evaluation command #157

Closed RecurvedBow closed 2 years ago

RecurvedBow commented 2 years ago

Given a project and its tracedata, tygegen init main should:

  1. Collect the trace data (Already implemented)
  2. Process it using the filters (Already implemented)
  3. Generate the files with traced type hints (Already implemented)
  4. Compare the original with the generated file (Classes implemented, but usage missing)
  5. Get the metric data (Classes implemented, but usage missing)

Implement step 4 and 5.

bengsparks commented 2 years ago

I have a branch for this already. It's missing the metric data usage though. Feel free to update it as you implemented the metric perfomance

RecurvedBow commented 2 years ago

It looks like this branch adds pytest requirements + contains refactors. However, if I see this correctly, it does not implement anything regarding evaluation in typegen main. Still, will start work on this issue if this branch has been merged.

RecurvedBow commented 2 years ago

Will be done together with #160

bengsparks commented 2 years ago

After discussion: A new subcommand will be created called evaluation that consumes the original and the generated project