Open joshpxyne opened 1 year ago
Can you provide an ememple which has error in the "dependency function"? So that we can determine whether our modifications are correct. And you can get the dependency by using the AST analysis in the original code repository. I can help you to solve that😊 @0xpayne
@TheCutestCat I love it! One example in the benchmark that's common is the DB read/write functions. A common culprit in the flask-nodejs benchmark is the LLM naming the DB function in camelCase but the app trying to call it in snake_case.
Would love a hand there!
The LLM should be allowed to "request" to see a dependency function it cannot see (in another file etc). This can apply to either source or target.