transformer model based on Tensorlayer

tensorlayer / TensorLayer

Deep Learning and Reinforcement Learning Library for Scientists and Engineers

http://tensorlayerx.com

Other

7.34k stars 1.61k forks source link

Open ArnoldLIULJ opened 5 years ago

ArnoldLIULJ commented 5 years ago

[x] I've tested that my changes are compatible with the latest version of Tensorflow.
[x] I've read the Contribution Guidelines
[x] I've updated the documentation if necessary.

ArnoldLIULJ commented 5 years ago

Documentations haven't been done

JingqingZ commented 5 years ago

The dependency on Keras should be removed gradually.

tf.keras.optimizers -> tf.optimiziers tf.keras.initializers -> tl.initializers

zsdonghao commented 5 years ago

ready to merge?

ArnoldLIULJ commented 5 years ago

Add attention visualisation util Add attention visualisation test

ArnoldLIULJ commented 5 years ago

ready to merge?

not yet

ArnoldLIULJ commented 5 years ago

Add documentation Add attention-weights visualisation and pass unit-testing READY TO MERGE

zsdonghao commented 5 years ago

Hi, could you provide an example code in the examples folder? and update changelog.md ? thanks

luomai commented 5 years ago

There are some naming issues with this PR. Please don't merge it for now.

luomai commented 5 years ago

@ArnoldLIULJ any update?

ArnoldLIULJ commented 5 years ago

@ArnoldLIULJ any update?

was on vocation and would be working on a simplified tutorial today

ArnoldLIULJ commented 5 years ago

Add examples in example/translation_task/tutorial_transformer

ArnoldLIULJ commented 5 years ago

Hi, could you provide an example code in the examples folder? and update changelog.md ? thanks

done

zsdonghao commented 5 years ago

Hi the RST format is not correct in many function, please check~

ArnoldLIULJ commented 5 years ago

please check

zsdonghao commented 5 years ago

I think this one can be merged after the travis pass~.