KoNLPy-gRPC

Redesigned KoNLPy (Wrapper) for Usability and Portability with gRPC.

Try Now!

Requirements:

pip install poetry
pip install -r $(python manage.py requirements.txt) -r $(python manage.py requirements-dev.txt)

gRPC Compile needed!

python -m grpc_tools.protoc -I protos/ --python_out=konlpy_grpc/_generated/ --grpc_python_out=konlpy_grpc/_generated/ protos/*.proto

Server

python -m pip install konlpy

python -m konlpy_grpc server
python -m konlpy_grpc hannanum_server
python -m konlpy_grpc kkma_server
python -m konlpy_grpc komoran_server
python -m konlpy_grpc mecab_server
python -m konlpy_grpc okt_server

Tests

python -m pytest
python -m pytest --grpc-fake-server
python -m pytest --grpc-real-server=[::]:50051
python -m pytest --konlpy-repo=../konlpy

Release

rm -rf dist/
poetry publish --build -r test
poetry run twine upload --repository-url https://test.pypi.org/legacy/ dist/*

TODO

• [x] [P0] client.py will be a konlpy-alike module.
  • [x] [P0] KoNLPy monkey-patcher
• [x] [P1] Packaging with Poetry pyproject.toml.
  • [x] PyPI Register
  • [ ] Find lowerbound-version of requirements.
• [P1] gRPC Proto Compile
• [P1] In-house tool: manage.py
• [P1] KoNLPy Version Matching (set minimum) and Follow-up
• [P1] gRPC retry/timeout/error_handling logic
• [x] [P1] gRPC reflection
• [P1] gRPC heartbeat
• [x] [P1] gRPC Gateway (gRPC to JSON)
• [x] [P2] Dockerize / Register
  • k8s and istio?
• [P2] CI
• [x] [P3] Button for deploying this to AWS/GCS/Azure now! (and connect by README.)
  • [x] aizine
  • [ ] AWS/GCS/Azure
• [P3] CustomDic?
• [P3] Stream I/O
• [P3] Redesign tests/ with grpc-testing
• [P4] Java Edition for KoNLPy-gRPC-Server
  • gRPC protos deploy/versioning

Additional Links

• KoNLPy/KoNLPy
• Pruned KoNLPy v0.5.2-rc.1
  • Currently, servers rely on KoNLPy v0.5.2 version.

License

GNU GPLv3