n3mo / massmine

Your Access To Data
GNU General Public License v3.0
73 stars 13 forks source link

Different languages - Haitian Creole #1

Closed jodth07 closed 9 years ago

jodth07 commented 9 years ago

I am intersted in possibly using this to do research and gather data in languages other than English, - particularly, Haitian Creole. Can this be implemented?

Additionally, from a linguistic point of view, it would be a great resource to have to study endangered languages.

J.D.

n3mo commented 9 years ago

I'm glad to hear that you are interested in considering MassMine as a research tool. You can in fact restrict your search results to a specific language. If you are using the Twitter search functionality (as in the example configuration file included with the MassMine installation), the solution is to specify a lang option. For this option, you indicate a language using the appropriate ISO 639-1 code. For Haitian Creole, the code is "ht".

Adapting the example configuration file, I was able to successfully pull 20 tweets from Twitter matching the phrase "bonswa" (pardon my lack of Haitian Creole) using the following configuration settings:

mm_apps:
 - YourAppHere

mm_keys:
 - YourKeyHere

mm_secrets:
 - YourSecretHere

service : twitter

twitter:
 task : search 
 options:
  file.name     : twitter_data.dat
  searchString  : bonswa
  tweets        : 20
  lang          : ht

Cheers! Nick

macloo commented 9 years ago

Can we see a list of options soon? E.g. lang

n3mo commented 9 years ago

I'm in the process of writing up the full details, and I'll leave this issue open until a substantial portion gets added to the MassMine documentation. At the very least, you can expect a full specification of the search task that is used in the example configuration file within the next day. I'll keep everyone posted here as things progress.

Edit: URL corrected

n3mo commented 9 years ago

I have added documentation on searching Twitter to the MassMine documentation. The remaining docs will be fleshed out as quickly as time will allow.

Edit: You'll need to update MassMine to version >0.5.0 to use the latest documentation. Updating is simple and fast

Cheers!

jodth07 commented 9 years ago

This is awesome. Thank you guys