anaschwendler
commented
6 years ago Ok, let's test this PR:
-
Clone the project:
$ git clone git@github.com:datasciencebr/jarbas.git -
Change to Jarbas folder:
$ cd jarbas -
Change to @cuducos branch:
$ git fetch origin $ git checkout -b cuducos-slim-docker-elm origin/cuducos-slim-docker-elm $ git merge master -
Edit
docker-compose.ymlto useDockerfile-elmfile instead of pullingdatasciencebr/jarbas-frontend. -
Build containers, run Jarbas and check if Layers (localhost:8000/layers/) doesn't crash:
$ cp contrib/.env.sample .env $ docker-compose up -d $ docker-compose run --rm django python manage.py migrate $ docker-compose run --rm django python manage.py reimbursements /mnt/data/reimbursements_sample.xz $ docker-compose run --rm django python manage.py companies /mnt/data/companies_sample.xz $ docker-compose run --rm django python manage.py suspicions /mnt/data/suspicions_sample.xz $ docker-compose run --rm django python manage.py tweets $ docker-compose run --rm django python manage.py searchvector
I guess I did something wrong, since I didn't get it:
How do I:
Edit
docker-compose.ymlto useDockerfile-elmfile instead of pullingdatasciencebr/jarbas-frontend.
?
I guess I did something wrong here
While running, I got this error:
```
➜ jarbas git:(cuducos-slim-docker-elm) ✗ docker-compose run --rm django python manage.py tweets
Starting jarbas_postgres_1 ...
Starting jarbas_queue_1 ... done
Starting jarbas_elm_1 ... done
Starting jarbas_tasks_1 ... done
Traceback (most recent call last):
File "manage.py", line 22, in
execute_from_command_line(sys.argv)
File "/usr/local/lib/python3.5/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
utility.execute()
File "/usr/local/lib/python3.5/site-packages/django/core/management/__init__.py", line 356, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/usr/local/lib/python3.5/site-packages/django/core/management/base.py", line 283, in run_from_argv
self.execute(*args, **cmd_options)
File "/usr/local/lib/python3.5/site-packages/django/core/management/base.py", line 330, in execute
output = self.handle(*args, **options)
File "/code/jarbas/chamber_of_deputies/management/commands/tweets.py", line 30, in handle
for status, document_id in self.document_ids:
File "/code/jarbas/chamber_of_deputies/management/commands/tweets.py", line 102, in document_ids
for tweet_id, url in self.urls:
File "/code/jarbas/chamber_of_deputies/management/commands/tweets.py", line 79, in urls
for tweet in self.tweets:
File "/code/jarbas/chamber_of_deputies/management/commands/tweets.py", line 69, in tweets
yield from api.GetUserTimeline(**kwargs)
File "/usr/local/lib/python3.5/site-packages/twitter/api.py", line 798, in GetUserTimeline
resp = self._RequestUrl(url, 'GET', data=parameters)
File "/usr/local/lib/python3.5/site-packages/twitter/api.py", line 4948, in _RequestUrl
limit = self.CheckRateLimit(url)
File "/usr/local/lib/python3.5/site-packages/twitter/api.py", line 4801, in CheckRateLimit
self.InitializeRateLimit()
File "/usr/local/lib/python3.5/site-packages/twitter/api.py", line 4784, in InitializeRateLimit
data = self._ParseAndCheckTwitter(resp.content.decode('utf-8'))
File "/usr/local/lib/python3.5/site-packages/twitter/api.py", line 4894, in _ParseAndCheckTwitter
self._CheckForTwitterError(data)
File "/usr/local/lib/python3.5/site-packages/twitter/api.py", line 4914, in _CheckForTwitterError
raise TwitterError(data['errors'])
twitter.error.TwitterError: [{'code': 89, 'message': 'Invalid or expired token.'}]
```
cuducos
What is the purpose of this Pull Request?
The Docker image to render Elm was too big (723MB):
What was done to achieve this purpose?
I suggest we use the
slimversion of thenodeDocker image instead (I triedalpinebut ended up with somenpmerrors). This reduced the image size in 61%:How to test if it really works?
Edit
docker-compose.ymlto useDockerfile-elmfile instead of pullingdatasciencebr/jarbas-frontend. Build containers, run Jarbas and check if Layers (localhost:8000/layers/) doesn't crash.Who can help reviewing it?
@anaschwendler