birchill / 10ten-ja-reader

A browser extension to translate Japanese by hovering over words.
https://addons.mozilla.org/firefox/addon/10ten-ja-reader/
GNU General Public License v3.0
609 stars 45 forks source link

Frequency Dictionaries #972

Open wJosuke opened 2 years ago

wJosuke commented 2 years ago

Hi Birchill,

This is my preferred pop-up dictionary, even on desktop. Unfortunately one of the things I like to do is check the frequency of words in order to decide whether or not it's worth creating a flash card on. It doesn't seem like a feature to use custom dictionaries is available, so are there any plans to incorporate frequency lists in the dictionary results (or perhaps a separate tab)? These results would indicate a ranking for a particular word in a particular use case (i.e Novels, Youtube, Anime, News) depending on the dictionary.

Keep up the great work!

birtles commented 2 years ago

Hi Josuke,

Thanks very much for your kind comments.

We can certainly look at adding additional frequency lists. Do you have any pointers to particular frequency lists you'd like to see included?

Thanks again!

wJosuke commented 2 years ago

There are a few frequency lists used within the communities that I have seen but this document has all the ones that I have been using that cover specific types of content. I'd particularly like to see the Anime & J Drama list, Netflix, Youtube, BCCWJ LUW and the Novels list. I know some others might like to see the visual novel one as well. I'm not certain why there are two .zip files for many dictionaries.

image This is how the freq dictionaries appear on yomichan, others elect to put the number beside the word. and here is a document explaining each dictionary file Frequency - Dictionary Info.txt

Apologies for any inconvenience, and thanks again!

birtles commented 2 years ago

Thanks very much for those pointers. Unfortunately the Frequency - Dictionary Info.txt link didn't work for me.

That seems very promising indeed. I hope we can incorporate this.

wJosuke commented 2 years ago

Try this one.

I felt it important to mention that these files are found via TheMoeWay resource list. I am unsure if you require permission or not to use the files for something like, but they have been available to the public to use freely with Yomichan. Best of luck to you!

birtles commented 2 years ago

Try this one.

Great, thank you!

I felt it important to mention that these files are found via TheMoeWay resource list. I am unsure if you require permission or not to use the files for something like, but they have been available to the public to use freely with Yomichan. Best of luck to you!

Oh, I see. Unfortunately TheMoeWay is known for linking to illegal resources. For example, the dictionary files linked to there are most certainly illegal. I wonder what the original source is for these files.

wJosuke commented 2 years ago

I will see if I can't find some official resources, then. My apologies. I do believe that many of the frequency lists based on novels, visual novels and such are community created but I understand why you might not feel comfortable using them.

Just browsing very quickly, I found this Netflix freq list made by this person. https://www.youtube.com/watch?v=DwJWld8hW0M

As well as this one https://github.com/MarvNC/jpdb-freq-list

birtles commented 2 years ago

Not at all! Thank you so much for all your help with this. Yes, if there is some official source that would be great.

wJosuke commented 1 year ago

Apologies for the rather late response. I managed to find an official source for a relatively popular frequency dictionary.

https://clrd.ninjal.ac.jp/bccwj/en/freq-list.html

birtles commented 1 year ago

Thank you! I had a look at that list, but for commercial users apparently we'd need to pay 800万円 given how many users we have 😬