search

SKT-AI / KoGPT2

Korean GPT-2 pretrained cased (KoGPT2)
Other
532 stars 98 forks source link

ONNX Export and Inference #30

Closed soeque1 closed 3 years ago

soeque1 commented 3 years ago

๐Ÿš€ Feature

ONNX export ๋ฐ inference๋ฅผ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.

Motivation

์ตœ๊ทผ pytorch์—์„œ onnx export์‹œ dynamic_axes๋ฅผ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค. ์‰ฝ๊ฒŒ dynamic sequnce์— ๋Œ€ํ•˜์—ฌ ์ปจ๋ฒ„ํŒ…์ด ๊ฐ€๋Šฅํ•  ๊ฒƒ์œผ๋กœ ๊ธฐ๋Œ€๋ฉ๋‹ˆ๋‹ค.

Pitch

์ž‘์—…ํ•˜์—ฌ PR ํ•˜๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค.

haven-jeon commented 3 years ago

์˜ค.. ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค. ๋จธ์ง€ ํ–ˆ๋„ค์š”..