jazzband / pip-tools

A set of tools to keep your pinned Python dependencies fresh.
https://pip-tools.rtfd.io
BSD 3-Clause "New" or "Revised" License
7.78k stars 611 forks source link

How to use pip-compile with extra argument #920

Closed elcolie closed 5 years ago

elcolie commented 5 years ago

How can I use pip-compile with extra argument in pip? pip install rasa-x --extra-index-url https://pypi.rasa.com/simple

I had tried putting rasa-x --extra-index-url https://pypi.rasa.com/simple to requirements.in, but it raises error

Reference: https://rasa.com/docs/rasa-x/installation-and-setup/

atugushev commented 5 years ago

Hello @elcolie,

Thanks for submitting this! Quick summary how to use --extra-index-url:

  1. Pass an --extra-index-url to the pip-compile/pip-sync directly
$ cat requirements.in
rasa-x

$ pip-compile --extra-index-url https://pypi.rasa.com/simple
...

$ pip-sync --extra-index-url https://pypi.rasa.com/simple
...
  1. Add an --extra-index-url to the requirements.in:
$ cat requirements.in
--extra-index-url https://pypi.rasa.com/simple
rasa-x

$ pip-compile 
...

$ pip-sync
...

Hope it helps!

elcolie commented 5 years ago

@atugushev Thanks for fast response. However, requirements.in does not has single line. It has more than 1 dependencies. How to apply it specifically?

atugushev commented 5 years ago

Thanks for fast response. However, requirements.in does not has single line. It has more than 1 dependencies. How to apply it specifically?

I might be not completely get your question. Could you please elaborate on what you are trying to achieve?

elcolie commented 5 years ago

My bad. I found the answer Thank you very much requirements.in

rasa
--extra-index-url https://pypi.rasa.com/simple
rasa-x

I got requirements.txt

#
# This file is autogenerated by pip-compile
# To update, run:
#
#    pip-compile requirements.in
#
--extra-index-url https://pypi.rasa.com/simple

absl-py==0.8.0            # via dopamine-rl, rasa, tensorboard, tensorflow, tensorflow-datasets
aiofiles==0.4.0           # via sanic
aiohttp==3.6.1            # via rasa, rasa-x
alembic==1.0.11           # via rasa-x
apscheduler==3.6.1        # via rasa, rasa-x
asn1crypto==1.0.1         # via cryptography
astor==0.8.0              # via tensorflow
async-generator==1.10     # via rasa
async-timeout==3.0.1      # via aiohttp
attrs==19.2.0             # via aiohttp, rasa, rasa-x, tensorflow-datasets
boto3==1.9.243            # via rasa
botocore==1.12.243        # via boto3, s3transfer
bz2file==0.98             # via tensor2tensor
cachetools==3.1.1         # via google-auth
certifi==2019.9.11        # via python-telegram-bot, requests
cffi==1.12.3              # via cryptography
chardet==3.0.4            # via aiohttp, requests
click==7.0                # via flask
cloudpickle==1.2.2        # via gym, tensorflow-probability
colorclass==2.2.0         # via rasa
coloredlogs==10.0         # via rasa, rasa-sdk
colorhash==1.0.2          # via rasa
configargparse==0.14.0    # via rasa-sdk
cryptography==2.7         # via python-telegram-bot, rasa-x
cycler==0.10.0            # via matplotlib
decorator==4.4.0          # via networkx, tensorflow-probability
dill==0.3.1.1             # via tensorflow-datasets
dnspython==1.16.0         # via pymongo
docopt==0.6.2             # via pykwalify
docutils==0.15.2          # via botocore
dopamine-rl==2.0.5        # via tensor2tensor
fbmessenger==6.0.0        # via rasa
flask-cors==3.0.8         # via rasa-sdk
flask==1.1.1              # via flask-cors, rasa-sdk, tensor2tensor
future==0.17.1            # via mesh-tensorflow, pyglet, python-telegram-bot, rasa-sdk, tensor2tensor, tensorflow-datasets, webexteamssdk
gast==0.2.2               # via rasa, tensorflow
gevent==1.4.0             # via rasa, rasa-sdk, tensor2tensor
gin-config==0.2.1         # via dopamine-rl, tensor2tensor
google-api-python-client==1.7.11  # via tensor2tensor
google-auth-httplib2==0.0.3  # via google-api-python-client
google-auth==1.6.3        # via google-api-python-client, google-auth-httplib2
google-pasta==0.1.7       # via tensorflow
googleapis-common-protos==1.6.0  # via tensorflow-metadata
greenlet==0.4.15          # via gevent
grpcio==1.24.1            # via tensorboard, tensorflow
gunicorn==19.9.0          # via tensor2tensor
gym==0.14.0               # via dopamine-rl, tensor2tensor
h5py==2.10.0              # via keras-applications, tensor2tensor
httplib2==0.14.0          # via google-api-python-client, google-auth-httplib2, oauth2client
httptools==0.0.13         # via sanic
humanfriendly==4.18       # via coloredlogs
idna==2.8                 # via requests, yarl
isodate==0.6.0            # via rasa-x
itsdangerous==1.1.0       # via flask
jinja2==2.10.3            # via flask
jmespath==0.9.4           # via boto3, botocore
jsonpickle==1.2           # via rasa
jsonschema==2.6.0         # via rasa, rasa-x
kafka-python==1.4.7       # via rasa
keras-applications==1.0.8  # via tensorflow
keras-preprocessing==1.1.0  # via tensorflow
kfac==0.2.0               # via tensor2tensor
kiwisolver==1.1.0         # via matplotlib
mako==1.1.0               # via alembic
markdown==3.1.1           # via tensorboard
markupsafe==1.1.1         # via jinja2, mako
matplotlib==3.1.1         # via rasa
mattermostwrapper==2.1    # via rasa
mesh-tensorflow==0.0.5    # via tensor2tensor
mpmath==1.1.0             # via sympy
multidict==4.5.2          # via aiohttp, sanic, yarl
networkx==2.3             # via rasa
numpy==1.17.2             # via gym, h5py, keras-applications, keras-preprocessing, kfac, matplotlib, opencv-python, rasa, scikit-learn, scipy, tensor2tensor, tensorboard, tensorflow, tensorflow-datasets, tensorflow-probability
oauth2client==4.1.3       # via tensor2tensor
opencv-python==4.1.1.26   # via dopamine-rl, tensor2tensor
packaging==19.2           # via rasa
pika==1.0.1               # via rasa, rasa-x
pillow==6.2.0             # via tensor2tensor
promise==2.2.1            # via tensorflow-datasets
prompt-toolkit==2.0.10    # via questionary
protobuf==3.10.0          # via googleapis-common-protos, tensorboard, tensorflow, tensorflow-datasets, tensorflow-metadata
psutil==5.6.3             # via tensorflow-datasets
pyasn1-modules==0.2.6     # via google-auth, oauth2client
pyasn1==0.4.7             # via oauth2client, pyasn1-modules, rsa
pycparser==2.19           # via cffi
pydot==1.4.1              # via rasa
pyglet==1.3.2             # via gym
pyjwt==1.7.1              # via rasa, rasa-x, sanic-jwt, twilio, webexteamssdk
pykwalify==1.7.0          # via rasa
pymongo[srv,tls]==3.9.0   # via rasa
pyparsing==2.4.2          # via matplotlib, packaging, pydot
pypng==0.0.20             # via tensor2tensor
pysocks==1.7.1            # via twilio
python-crfsuite==0.9.6    # via sklearn-crfsuite
python-dateutil==2.8.0    # via alembic, botocore, matplotlib, pykwalify, rasa, rasa-x
python-editor==1.0.4      # via alembic
python-engineio==3.9.3    # via python-socketio, rasa
python-socketio==4.3.1    # via rasa
python-telegram-bot==11.1.0  # via rasa
pytz==2019.3              # via apscheduler, rasa, twilio, tzlocal
pyyaml==5.1.2             # via pykwalify
questionary==1.3.0        # via rasa, rasa-x
rasa-sdk==1.3.3           # via rasa
rasa-x==0.21.3
rasa==1.3.7
redis==3.3.8              # via rasa
requests-toolbelt==0.9.1  # via webexteamssdk
requests==2.22.0          # via fbmessenger, mattermostwrapper, rasa, rasa-sdk, rasa-x, requests-toolbelt, rocketchat-api, slackclient, tensor2tensor, tensorflow-datasets, twilio, webexteamssdk
rocketchat-api==0.6.34    # via rasa
rsa==4.0                  # via google-auth, oauth2client
ruamel.yaml==0.15.100     # via rasa
s3transfer==0.2.1         # via boto3
sanic-cors==0.9.9.post3   # via rasa, rasa-x
sanic-jwt==1.3.2          # via rasa, rasa-x
sanic-plugins-framework==0.8.2  # via sanic-cors
sanic==19.3.1             # via rasa, rasa-x, sanic-cors, sanic-plugins-framework
scikit-learn==0.20.4      # via rasa
scipy==1.3.1              # via gym, rasa, scikit-learn, tensor2tensor
setuptools-scm==3.3.3     # via rasa-x
simplejson==3.16.0        # via rasa, rasa-x
six==1.12.0               # via absl-py, apscheduler, cryptography, cycler, flask-cors, gin-config, google-api-python-client, google-auth, grpcio, gym, h5py, isodate, keras-preprocessing, kfac, mesh-tensorflow, oauth2client, packaging, promise, prompt-toolkit, protobuf, python-dateutil, python-engineio, python-socketio, rasa-sdk, sklearn-crfsuite, slackclient, tensor2tensor, tensorboard, tensorflow, tensorflow-datasets, tensorflow-probability, twilio, websocket-client
sklearn-crfsuite==0.3.6   # via rasa
slackclient==1.3.2        # via rasa
sqlalchemy==1.3.9         # via alembic, rasa, rasa-x
sympy==1.4                # via tensor2tensor
tabulate==0.8.5           # via sklearn-crfsuite
tensor2tensor==1.14.1     # via rasa
tensorboard==1.14.0       # via tensorflow
tensorflow-datasets==1.2.0  # via tensor2tensor
tensorflow-estimator==1.14.0  # via tensorflow
tensorflow-gan==1.0.0.dev0  # via tensor2tensor
tensorflow-metadata==0.14.0  # via tensorflow-datasets
tensorflow-probability==0.7.0  # via kfac, rasa, tensor2tensor
tensorflow==1.14.0        # via rasa
termcolor==1.1.0          # via tensorflow, tensorflow-datasets
terminaltables==3.1.0     # via rasa
tqdm==4.36.1              # via rasa, sklearn-crfsuite, tensor2tensor, tensorflow-datasets
twilio==6.31.1            # via rasa
tzlocal==2.0.0            # via apscheduler
ujson==1.35               # via sanic
uritemplate==3.0.0        # via google-api-python-client
urllib3==1.25.6           # via botocore, requests
uvloop==0.13.0            # via sanic
wcwidth==0.1.7            # via prompt-toolkit
webexteamssdk==1.2        # via rasa
websocket-client==0.54.0  # via slackclient
websockets==6.0           # via sanic
werkzeug==0.16.0          # via flask, tensorboard
wheel==0.33.6             # via tensorboard, tensorflow
wrapt==1.11.2             # via tensorflow, tensorflow-datasets
yarl==1.3.0               # via aiohttp

# The following packages are considered to be unsafe in a requirements file:
# setuptools==41.4.0        # via apscheduler, kiwisolver, markdown, protobuf, rasa, tensorboard