I want to try translation between java and python. As current datasets from CodeXGLUE were representing functions in a single line, it is easy to finetune and test.
But what if I want to do this for python where indentation is very important? i.e, how will the tokenization take care of it?
I saw an example in TransCoder that they used below format for indentation using INDENT, DEDENT and NEWLINE -
Hi,
I want to try translation between java and python. As current datasets from CodeXGLUE were representing functions in a single line, it is easy to finetune and test. But what if I want to do this for python where indentation is very important? i.e, how will the tokenization take care of it? I saw an example in TransCoder that they used below format for indentation using
INDENT
,DEDENT
andNEWLINE
-Can you suggest how to proceed further with indentation using PLBART?