skeskinen / bert.cpp

ggml implementation of BERT
MIT License
463 stars 58 forks source link

CodeBERT #7

Open walking-octopus opened 1 year ago

walking-octopus commented 1 year ago

I appears Microsoft have a neat little BERT model for code search and basic comment generation, code translation, and simple refactoring. With faster inference in C++, perhaps someone can make a neat VSCode extension or CLI for it...

https://github.com/microsoft/CodeBERT

skeskinen commented 1 year ago

How would you imagine these models are used in practice? For code search or something else?

walking-octopus commented 1 year ago

Code search would be the easiest use-case for it, but it seems is can also support very basic code generation/editing. I suppose this model can be useful in the ggml-org/p1 project.

znsoftm commented 1 year ago

Are working on the codebert? my email: znsoft@163.com