search

openai / gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"
https://openai.com/blog/better-language-models/
Other
22.18k stars 5.47k forks source link

how can i get the input and output node names to generate pb file? #221

Open pragnakalpdev6 opened 4 years ago

pragnakalpdev6 commented 4 years ago

I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time.

IveJ commented 4 years ago

Hi friend,

Try reference to docs if any help. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md

or inspect if you use export_meta_graph method with limit size of graph proto buff if possible in your case.

On Fri, Dec 20, 2019, 14:14 pragnakalpdev6 notifications@github.com wrote:

I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/openai/gpt-2/issues/221?email_source=notifications&email_token=AEYAML5G2OVQYVN6P3P2YILQZRWGXA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IB4GQ4A, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML4TVPCJKI5HQQYEGD3QZRWGXANCNFSM4J5ZEGBQ .

pragnakalpdev6 commented 4 years ago

Hi friend, Try reference to docs if any help. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md or inspect if you use export_meta_graph method with limit size of graph proto buff if possible in your case. … On Fri, Dec 20, 2019, 14:14 pragnakalpdev6 @.***> wrote: I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#221?email_source=notifications&email_token=AEYAML5G2OVQYVN6P3P2YILQZRWGXA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IB4GQ4A>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML4TVPCJKI5HQQYEGD3QZRWGXANCNFSM4J5ZEGBQ .

Actually i have the saved model but i want to make frozen graph def of the saved model but i don't know input and output nodes so how can i get that. I also used tensorboard to visualize the graph but i was unable to figure out the graph's input and output nodes. Thanks for the help

IveJ commented 4 years ago

Hi Friend,

Plz referrence to docs in gpt-2, this is nodes within both ends of layers in nn, in this case train_loader, validation_loader.

https://github.com/openai/gpt-2-output-dataset/blob/master/detector/train.py

or one of among popular theory equivalence: https://books.google.com.vn/books?id=xxiUDwAAQBAJ&pg=PA102&lpg=PA102&dq=openai+graph%27s+input+and+output+nodes&source=bl&ots=9kv0IurHhE&sig=ACfU3U1L5pQLhUbgrMqQqL9ZlBnjXslKGw&hl=en&sa=X&ved=2ahUKEwikt8_nvcnmAhWTLqYKHf3MBAgQ6AEwCHoECAgQAQ#v=onepage&q=openai%20graph's%20input%20and%20output%20nodes&f=false

On Sat, Dec 21, 2019, 12:04 pragnakalpdev6 notifications@github.com wrote:

Hi friend, Try reference to docs if any help. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/saved_model/README.md or inspect if you use export_meta_graph method with limit size of graph proto buff if possible in your case. … <#m1589364898180241536> On Fri, Dec 20, 2019, 14:14 pragnakalpdev6 @.***> wrote: I am working to make pb file of the checkpoint but i don't know the input and output nodes of the model so i am unable to make frozen graph of the model for prediction. i tried so many ways to make pb file. In one of the way i am getting error that PB file should be less than 2gb How to resolve this issue? Thank you for your time. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <

221 https://github.com/openai/gpt-2/issues/221?email_source=notifications&email_token=AEYAML5G2OVQYVN6P3P2YILQZRWGXA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4IB4GQ4A>,

or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML4TVPCJKI5HQQYEGD3QZRWGXANCNFSM4J5ZEGBQ .

Actually i have the saved model but i want to make frozen graph def of the saved model but i don't know input and output nodes so how can i get that. I also used tensorboard to visualize the graph but i was unable to figure out the graph's input and output nodes. Thanks for the help

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/openai/gpt-2/issues/221?email_source=notifications&email_token=AEYAMLY7FANC7CV4A6ETSXTQZWPUBA5CNFSM4J5ZEGB2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEHOVHGA#issuecomment-568152984, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEYAML22IR75LGOG7XUAIJ3QZWPUBANCNFSM4J5ZEGBQ .

bhavikapanara commented 4 years ago

Hi @pragnakalpdev6

Did you able to get the output node name to generate pb file?

I am also facing similar issues can you please help me to resolve it?

Thanks, Bhavika