search

chengchingwen / Transformers.jl

Julia Implementation of Transformer models
MIT License
526 stars 75 forks source link

Improve documentation and take inspiration from python package #174

Open AbhimanyuAryan opened 7 months ago

AbhimanyuAryan commented 7 months ago

Peter any recommendations on things you want me to add in documentation? I am planning to improve documentation for this package. Mostly take my knowledge from Python package and add stuff :)

chengchingwen commented 7 months ago

What about a section for people from the Python world? Or anything you found that is missing or unclear in the current document.

AbhimanyuAryan commented 7 months ago

What about a section for people from the Python world? Or anything you found that is missing or unclear in the current document.

sounds like a good plan. I'll start adding that

AbhimanyuAryan commented 7 months ago

@chengchingwen do we also have a binding for datasets in Julia: https://pypi.org/project/datasets/

AbhimanyuAryan commented 7 months ago

I think I found it: https://github.com/JuliaGenAI/HuggingFaceDatasets.jl too dumb of me to not do a simple google search

chengchingwen commented 7 months ago

Make sure you add a warning in the doc that HuggingFaceDatasets.jl would run Python under the hood

AbhimanyuAryan commented 7 months ago

currently I am writing a tutorial on retraining bert for text classification here: https://github.com/AbhimanyuAryan/Transformers.jl/commit/de3e9a3497dcaf0ec97e7e531832b542e326bff1