Error using NLTK - Githubissues

ghost commented 4 years ago

Versions

Python: 3.7.3
OS: Linux Mint 19.1
Buildozer: 1.0

Description

Hello, I am using NLTK with kivy. The app works perfectly running with python main.py, but when debugging on the phone it gives an error. The logcat message says that it could not find the "punkt resource", but it exists in the directory in which it was searched.

I've already tried to move directories and use the suggested command (nltk.download ('punkt')), but nothing worked.

Any solution?

Thanks!

buildozer.spec

Command:

buildozer -v android debug deploy run

Spec file:

[app]

# (str) Title of your application
title = My Application

# (str) Package name
package.name = myapp

# (str) Package domain (needed for android/ios packaging)
package.domain = org.test

# (str) Source code where the main.py live
source.dir = .

# (list) Source files to include (let empty to include all the files)
source.include_exts = py,png,jpg,kv,atlas

# (list) List of inclusions using pattern matching
#source.include_patterns = assets/*,images/*.png

# (list) Source files to exclude (let empty to not exclude anything)
#source.exclude_exts = spec

# (list) List of directory to exclude (let empty to not exclude anything)
#source.exclude_dirs = tests, bin

# (list) List of exclusions using pattern matching
#source.exclude_patterns = license,images/*/*.jpg

# (str) Application versioning (method 1)
version = 0.1

# (str) Application versioning (method 2)
# version.regex = __version__ = ['"](.*)['"]
# version.filename = %(source.dir)s/main.py

# (list) Application requirements
# comma separated e.g. requirements = sqlite3,kivy
requirements = python3,kivy==master,kivymd,distance,networkx,nltk,decorator,regex

# (str) Custom source folders for requirements
# Sets custom source for any requirements with recipes
# requirements.source.kivy = ../../kivy

# (list) Garden requirements
#garden_requirements =

# (str) Presplash of the application
#presplash.filename = %(source.dir)s/data/presplash.png

# (str) Icon of the application
#icon.filename = %(source.dir)s/data/icon.png

# (str) Supported orientation (one of landscape, sensorLandscape, portrait or all)
orientation = portrait

# (list) List of service to declare
#services = NAME:ENTRYPOINT_TO_PY,NAME2:ENTRYPOINT2_TO_PY

#
# OSX Specific
#

#
# author = © Copyright Info

# change the major version of python used by the app
osx.python_version = 3

# Kivy version to use
osx.kivy_version = 1.9.1

#
# Android specific
#

# (bool) Indicate if the application should be fullscreen or not
fullscreen = 0

# (string) Presplash background color (for new android toolchain)
# Supported formats are: #RRGGBB #AARRGGBB or one of the following names:
# red, blue, green, black, white, gray, cyan, magenta, yellow, lightgray,
# darkgray, grey, lightgrey, darkgrey, aqua, fuchsia, lime, maroon, navy,
# olive, purple, silver, teal.
#android.presplash_color = #FFFFFF

# (list) Permissions
#android.permissions = INTERNET

# (int) Target Android API, should be as high as possible.
#android.api = 27

# (int) Minimum API your APK will support.
#android.minapi = 21

# (int) Android SDK version to use
#android.sdk = 20

# (str) Android NDK version to use
#android.ndk = 17c

# (int) Android NDK API to use. This is the minimum API your app will support, it should usually match android.minapi.
#android.ndk_api = 21

# (bool) Use --private data storage (True) or --dir public storage (False)
#android.private_storage = True

# (str) Android NDK directory (if empty, it will be automatically downloaded.)
#android.ndk_path =

# (str) Android SDK directory (if empty, it will be automatically downloaded.)
#android.sdk_path =

# (str) ANT directory (if empty, it will be automatically downloaded.)
#android.ant_path =

# (bool) If True, then skip trying to update the Android sdk
# This can be useful to avoid excess Internet downloads or save time
# when an update is due and you just want to test/build your package
# android.skip_update = False

# (bool) If True, then automatically accept SDK license
# agreements. This is intended for automation only. If set to False,
# the default, you will be shown the license when first running
# buildozer.
# android.accept_sdk_license = False

# (str) Android entry point, default is ok for Kivy-based app
#android.entrypoint = org.renpy.android.PythonActivity

# (str) Android app theme, default is ok for Kivy-based app
# android.apptheme = "@android:style/Theme.NoTitleBar"

# (list) Pattern to whitelist for the whole project
#android.whitelist =

# (str) Path to a custom whitelist file
#android.whitelist_src =

# (str) Path to a custom blacklist file
#android.blacklist_src =

# (list) List of Java .jar files to add to the libs so that pyjnius can access
# their classes. Don't add jars that you do not need, since extra jars can slow
# down the build process. Allows wildcards matching, for example:
# OUYA-ODK/libs/*.jar
#android.add_jars = foo.jar,bar.jar,path/to/more/*.jar

# (list) List of Java files to add to the android project (can be java or a
# directory containing the files)
#android.add_src =

# (list) Android AAR archives to add (currently works only with sdl2_gradle
# bootstrap)
#android.add_aars =

# (list) Gradle dependencies to add (currently works only with sdl2_gradle
# bootstrap)
#android.gradle_dependencies =

# (list) add java compile options
# this can for example be necessary when importing certain java libraries using the 'android.gradle_dependencies' option
# see https://developer.android.com/studio/write/java8-support for further information
# android.add_compile_options = "sourceCompatibility = 1.8", "targetCompatibility = 1.8"

# (list) Gradle repositories to add {can be necessary for some android.gradle_dependencies}
# please enclose in double quotes 
# e.g. android.gradle_repositories = "maven { url 'https://kotlin.bintray.com/ktor' }"
#android.add_gradle_repositories =

# (list) packaging options to add 
# see https://google.github.io/android-gradle-dsl/current/com.android.build.gradle.internal.dsl.PackagingOptions.html
# can be necessary to solve conflicts in gradle_dependencies
# please enclose in double quotes 
# e.g. android.add_packaging_options = "exclude 'META-INF/common.kotlin_module'", "exclude 'META-INF/*.kotlin_module'"
#android.add_gradle_repositories =

# (list) Java classes to add as activities to the manifest.
#android.add_activites = com.example.ExampleActivity

# (str) OUYA Console category. Should be one of GAME or APP
# If you leave this blank, OUYA support will not be enabled
#android.ouya.category = GAME

# (str) Filename of OUYA Console icon. It must be a 732x412 png image.
#android.ouya.icon.filename = %(source.dir)s/data/ouya_icon.png

# (str) XML file to include as an intent filters in <activity> tag
#android.manifest.intent_filters =

# (str) launchMode to set for the main activity
#android.manifest.launch_mode = standard

# (list) Android additional libraries to copy into libs/armeabi
#android.add_libs_armeabi = libs/android/*.so
#android.add_libs_armeabi_v7a = libs/android-v7/*.so
#android.add_libs_arm64_v8a = libs/android-v8/*.so
#android.add_libs_x86 = libs/android-x86/*.so
#android.add_libs_mips = libs/android-mips/*.so

# (bool) Indicate whether the screen should stay on
# Don't forget to add the WAKE_LOCK permission if you set this to True
#android.wakelock = False

# (list) Android application meta-data to set (key=value format)
#android.meta_data =

# (list) Android library project to add (will be added in the
# project.properties automatically.)
#android.library_references =

# (list) Android shared libraries which will be added to AndroidManifest.xml using <uses-library> tag
#android.uses_library =

# (str) Android logcat filters to use
#android.logcat_filters = *:S python:D

# (bool) Copy library instead of making a libpymodules.so
#android.copy_libs = 1

# (str) The Android arch to build for, choices: armeabi-v7a, arm64-v8a, x86, x86_64
android.arch = armeabi-v7a

#
# Python for android (p4a) specific
#

# (str) python-for-android fork to use, defaults to upstream (kivy)
#p4a.fork = kivy

# (str) python-for-android branch to use, defaults to master
p4a.branch = develop

# (str) python-for-android git clone directory (if empty, it will be automatically cloned from github)
#p4a.source_dir =

# (str) The directory in which python-for-android should look for your own build recipes (if any)
#p4a.local_recipes =

# (str) Filename to the hook for p4a
#p4a.hook =

# (str) Bootstrap to use for android builds
# p4a.bootstrap = sdl2

# (int) port number to specify an explicit --port= p4a argument (eg for bootstrap flask)
#p4a.port =

#
# iOS specific
#

# (str) Path to a custom kivy-ios folder
#ios.kivy_ios_dir = ../kivy-ios
# Alternately, specify the URL and branch of a git checkout:
ios.kivy_ios_url = https://github.com/kivy/kivy-ios
ios.kivy_ios_branch = master

# Another platform dependency: ios-deploy
# Uncomment to use a custom checkout
#ios.ios_deploy_dir = ../ios_deploy
# Or specify URL and branch
ios.ios_deploy_url = https://github.com/phonegap/ios-deploy
ios.ios_deploy_branch = 1.7.0

# (str) Name of the certificate to use for signing the debug version
# Get a list of available identities: buildozer ios list_identities
#ios.codesign.debug = "iPhone Developer: <lastname> <firstname> (<hexstring>)"

# (str) Name of the certificate to use for signing the release version
#ios.codesign.release = %(ios.codesign.debug)s

[buildozer]

# (int) Log level (0 = error only, 1 = info, 2 = debug (with command output))
log_level = 2

# (int) Display warning if buildozer is run as root (0 = False, 1 = True)
warn_on_root = 1

# (str) Path to build artifact storage, absolute or relative to spec file
# build_dir = ./.buildozer

# (str) Path to build output (i.e. .apk, .ipa) storage
# bin_dir = ./bin

#    -----------------------------------------------------------------------------
#    List as sections
#
#    You can define all the "list" as [section:key].
#    Each line will be considered as a option to the list.
#    Let's take [app] / source.exclude_patterns.
#    Instead of doing:
#
#[app]
#source.exclude_patterns = license,data/audio/*.wav,data/images/original/*
#
#    This can be translated into:
#
#[app:source.exclude_patterns]
#license
#data/audio/*.wav
#data/images/original/*
#

#    -----------------------------------------------------------------------------
#    Profiles
#
#    You can extend section / key with a profile
#    For example, you want to deploy a demo version of your application without
#    HD content. You could first change the title to add "(demo)" in the name
#    and extend the excluded directories to remove the HD content.
#
#[app@demo]
#title = My Application (demo)
#
#[app:source.exclude_patterns@demo]
#images/hd/*
#
#    Then, invoke the command line with the "demo" profile:
#
#buildozer --profile demo android debug```

### Logs

--------- beginning of system --------- beginning of main 06-10 18:05:10.765 22521 22556 I python : [INFO 06-10 18:05:18.275 22521 22556 I python : [INFO 06-10 18:05:18.275 22521 22556 I python 06-10 18:05:18.275 22521 22556 I python : 06-10 18:05:18.275 22521 22556 I python : 06-10 18:05:18.275 22521 22556 I python : 06-10 18:05:18.275 22521 22556 I python : 06-10 18:05:18.275 22521 22556 I python : 06-10 18:05:18.275 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.285 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python 06-10 18:05:18.295 22521 22556 I python 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.295 22521 22556 I python : 06-10 18:05:18.305 22521 22556 I python 06-10 18:05:18.305 22521 22556 I python 06-10 18:05:18.305 22521 22556 I python ] [Clipboard ] Provider: android ] [Base ] Leaving application in progress... : Traceback (most recent call last): File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/app/main.py", line 26, in File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/app.py", line 950, in run File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/base.py", line 561, in runTouchApp File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/base.py", line 335, in mainloop File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/base.py", line 379, in idle File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/base.py", line 330, in dispatch_input File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/base.py", line 296, in post_dispatch_input File "kivy/_event.pyx", line 709, in kivy._event.EventDispatcher.dispatch File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivymd/uix/behaviors/ripplebehavior.py", line 245, in on_touch_up File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivymd/uix/button.py", line 969, in on_touch_up File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/uix/behaviors/button.py", line 179, in on_touch_up File "kivy/_event.pyx", line 705, in kivy._event.EventDispatcher.dispatch File "kivy/_event.pyx", line 1248, in kivy._event.EventObservers.dispatch File "kivy/_event.pyx", line 1132, in kivy._event.EventObservers._dispatch File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/kivy/lang/builder.py", line 57, in custom_callback File "/data/data/org.test.myapp/files/app/textointegra.kv", line 27, in on_release: app.sumarizar(txtEntrada.text) File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/app/main.py", line 22, in sumarizar File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/app/resumo.py", line 38, in summarize File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/app/resumo.py", line 21, in split_sentences File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/nltk/tokenize/init.py", line 106, in sent_tokenize File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/nltk/data.py", line 752, in load File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/nltk/data.py", line 877, in _open File "/home/alexandre/Documents/ProjetosComerciais/PlayStore/Andamento/Summarizer/.buildozer/android/platform/build-armeabi-v7a/build/python-installs/myapp/nltk/data.py", line 585, in find : LookupError: : ** Resource punkt not found. Please use the NLTK Downloader to obtain the resource: :
>>> import nltk >>> nltk.download('punkt') :
For more information see: https://www.nltk.org/data.html :
Attempted to load tokenizers/punkt/PY3/english.pickle :
Searched in: - '/data/nltk_data' - 'nltk_data' - 'share/nltk_data' - 'lib/nltk_data' - '/usr/share/nltk_data' - '/usr/local/share/nltk_data' - '/usr/lib/nltk_data' - '/usr/local/lib/nltk_data' - '' : ** :
: Python for android ended.

frsnmk commented 3 years ago

I have the same problem with you, where can we save the 'nltk_data' folder when building into apk? have you found a solution?

ngochien1990 commented 2 years ago

Do we have any solutions so far?

mr-lops commented 2 years ago

Hello, what happens is that if you leave the NLTK data file in the app's folder, the user does not have permission to access it. So the alternative I found was to compress the "nltk_data" and when the user opens the app for the first time it will extract it to the "Android" folder where the user has access. Then I add this folder to be one of the paths to the "nltk_data".

follow the way it worked for me.

put this code in your main.py.

from kivy.utils import platform
import nltk

if __name__ == "__main__":
    if platform == 'android':
        localNLTK = "/storage/emulated/0/Android/nltk_data"
        if os.path.isdir('/storage/emulated/0/Android/nltk_data'):
            if localNLTK not in nltk.data.path:
                nltk.data.path.append(localNLTK)
        else:
            from zipfile import ZipFile
            with ZipFile('nltk_data.zip', 'r') as zipObj:
                zipObj.extractall(localNLTK)
            if localNLTK not in nltk.data.path:
                nltk.data.path.append(localNLTK)

Put this file in the same directory as main.py

nltk_data.zip

sorry for my english, hope this helps.

pihash252 commented 1 year ago

Hi, I'm facing the same issue, but since I'm using Colab to build my app. Can someone please tell me how to go about including nltk in my Android app? Right now I'm getting this error: LookupError: 11-15 18:17:38.562 24746 24893 I python : LookupError: 11-15 18:17:38.562 24746 24893 I python : **** 11-15 18:17:38.562 24746 24893 I python : Resource stopwords not found. 11-15 18:17:38.562 24746 24893 I python : Please use the NLTK Downloader to obtain the resource: 11-15 18:17:38.562 24746 24893 I python : 11-15 18:17:38.562 24746 24893 I python : >>> import nltk 11-15 18:17:38.562 24746 24893 I python : >>> nltk.download('stopwords') 11-15 18:17:38.562 24746 24893 I python : 11-15 18:17:38.562 24746 24893 I python : For more information see: https://www.nltk.org/data.html 11-15 18:17:38.562 24746 24893 I python : 11-15 18:17:38.562 24746 24893 I python : Attempted to load corpora/stopwords.zip/stopwords/ 11-15 18:17:38.562 24746 24893 I python : 11-15 18:17:38.562 24746 24893 I python : Searched in: 11-15 18:17:38.563 24746 24893 I python : - '/data/nltk_data' 11-15 18:17:38.563 24746 24893 I python : - 'nltk_data' 11-15 18:17:38.563 24746 24893 I python : - 'share/nltk_data' 11-15 18:17:38.563 24746 24893 I python : - 'lib/nltk_data' 11-15 18:17:38.563 24746 24893 I python : - '/usr/share/nltk_data' 11-15 18:17:38.563 24746 24893 I python : - '/usr/local/share/nltk_data' 11-15 18:17:38.563 24746 24893 I python : - '/usr/lib/nltk_data' 11-15 18:17:38.563 24746 24893 I python : - '/usr/local/lib/nltk_data' 11-15 18:17:38.563 24746 24893 I python : ****

pihash252 commented 1 year ago

Hello, what happens is that if you leave the NLTK data file in the app's folder, the user does not have permission to access it. So the alternative I found was to compress the "nltk_data" and when the user opens the app for the first time it will extract it to the "Android" folder where the user has access. Then I add this folder to be one of the paths to the "nltk_data".

follow the way it worked for me.

put this code in your main.py.
from kivy.utils import platform
import nltk

if __name__ == "__main__":
    if platform == 'android':
        localNLTK = "/storage/emulated/0/Android/nltk_data"
        if os.path.isdir('/storage/emulated/0/Android/nltk_data'):
            if localNLTK not in nltk.data.path:
                nltk.data.path.append(localNLTK)
        else:
            from zipfile import ZipFile
            with ZipFile('nltk_data.zip', 'r') as zipObj:
                zipObj.extractall(localNLTK)
            if localNLTK not in nltk.data.path:
                nltk.data.path.append(localNLTK)
Put this file in the same directory as main.py

nltk_data.zip

sorry for my english, hope this helps.

@mr-lops I tried your code but during running the app crashes with the logcat saying "FileNotFoundError: [Errno 2] No such file or directory: 'nltk_data.zip'". I'd kept the zip file in the main folder among other program files. Also, I'm using Google Colab to build my apk using bulldozer. Let me know if I need to make any changes.

github-actions[bot] commented 8 months ago

👋 @ghost, we use the issue tracker exclusively for bug reports and feature requests. However, this issue appears to be a support request. Please use our support channels to get help with the project. Let us know if this comment was made in error, and we'll be happy to reopen the issue.

kivy / buildozer

Error using NLTK #1148

Versions

Description

buildozer.spec