dbl001
commented
4 years ago Hi Durgesh,
The first 5 Epoch are for training the word vectors not the topic vectors (unless you changed):
Epoch that we want to "switch on" LDA loss
switch_loss_epoch = 5
Please try running for at least 25 Epochs (200 is recommended).
On Aug 10, 2019, at 4:19 AM, Durgesh Kumar notifications@github.com wrote:
While running the lda2vec on 20-Newsgroup downloaded from sklearn datasets, I am getting same top 10 word for each iteration.
Output : EPOCH: 2 time taken: 42.41943836212158, LOSS 4.823064 w2v 4.823064 lda 79421.92 ---------Closest 10 words to .............................given indexes---------- Topic 0 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, etc, addition Topic 1 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 2 : likewise, instance, unfortunately, furthermore, example, presumably, similarly, actually, etc, addition Topic 3 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 4 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 5 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 6 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 7 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 8 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 9 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, addition, etc Topic 10 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 11 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 12 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 13 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 14 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 15 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 16 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 17 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 18 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 19 : likewise, instance, unfortunately, furthermore, example, presumably, similarly, actually, etc, addition
Would highly appreciate any help on it?
Thanking You, Durgesh Kumar
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/nateraw/Lda2vec-Tensorflow/issues/61?email_source=notifications&email_token=AAXWFW22SHAPA6TU4NPDWIDQD2P3HA5CNFSM4IKZHNB2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HEQ4FWQ, or mute the thread https://github.com/notifications/unsubscribe-auth/AAXWFWZYW3WZHNENHTHTAWDQD2P3HANCNFSM4IKZHNBQ.
While running the lda2vec on 20-Newsgroup downloaded from sklearn datasets, I am getting same top 10 word for each iteration.
Output: EPOCH: 2 time taken: 42.41943836212158, LOSS 4.823064 w2v 4.823064 lda 79421.92 ---------Closest 10 words to .............................given indexes---------- Topic 0 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, etc, addition Topic 1 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 2 : likewise, instance, unfortunately, furthermore, example, presumably, similarly, actually, etc, addition Topic 3 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 4 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 5 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 6 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 7 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 8 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 9 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, addition, etc Topic 10 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 11 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 12 : likewise, unfortunately, instance, furthermore, example, presumably, similarly, actually, etc, addition Topic 13 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 14 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 15 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 16 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 17 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 18 : likewise, unfortunately, instance, furthermore, presumably, example, similarly, actually, supposedly, addition Topic 19 : likewise, instance, unfortunately, furthermore, example, presumably, similarly, actually, etc, additionWould highly appreciate any help on it?
Thanking You, Durgesh Kumar