Dtale flask in pythonanywhere

[eriksdev1]

Please forgive me if I'm requesting help here also, as this the project's home. How can I load data into a flask-dtale app (csv file)

Hello I have seen the site working with the dtale library: http://alphatechadmin.pythonanywhere.com/dtale/main/1

and I even tried the example (taken from reddit) But I had no success by the way I got this error while using the embedded example: bs4.FeatureNotFound in server:8080/load-players

I'm unable to replicate how it works, I can't load a csv file I uploaded to pythonanywhere, I found a forum post saying you need to use the full path in pythonanywhere: /home/USER/mysite/data/ for example

But still I'm unable to figure this out with the documentation example code:

@app.route("/dtale") def dtalepage(): mytitle = "Analysis with dtale library" df = pd.read_csv('/home/erikssawa/mysite/data/engine_metadata.csv') instance = startup(data=df, ignore_duplicate=True) return redirect(f"/dtale/main/{instance._data_id}", code=302)

I get the error The requested URL was not found on the server.

My file structure is:

├── flask_app.py

├── static

│---------├── bootstrapfiles, javascript, images dir

├── templates

│---------├──index.html, about.html, dtalepage.html

├── data

│-------├── csv files

full flask_app.py code to copypaste https://pastebin.com/8AL0rR7n

Any hints onto how to configure the routes, redirecting or whatever is necessary would be great

Any help is much appreciated

[aschonfeld]

@eriksdev1 so looks like there may have been packages updates as well as updates to the website my app was parsing. I have updated the app.py code to handle the changes baseball-reference has made to their website and you can view them here.

In addition to pulling down the latest code you'll have to do a pip install lxml on the virtual environment you're running your code. That should solve the bs4.FeatureNotFound error.

Let me know if you're still having issues after those updates.

[eriksdev1]

Hello @aschonfeld many thanks for replying and updating code, I was able to reproduce the example as the reddit gif but unable to use the data, any hits are welcome (when I try to manipulate the data nothing happens, is like the data is just visible but can't be accessed) I attach a gif. I also have a question, can the hiding main menu bar be made not to hide ? Many thanks.

[aschonfeld]

@eriksdev1 which browser are you using? I'm using chrome and everything seems to work as expected. Thanks

[eriksdev1]

Hello, many thanks for replying, yes I'm also using chrome, for some reason the data is just seen in the grid but is not letting be manipulated by dtale I'm using Version 99.0.4844.82 (Official Build) (64-bit)

[aschonfeld]

Would you be willing to send me your console output from the developer toolbar? Without it I'm kind of at a loss since everything works for me. So you can do that by doing the following:

• click the three dots in the upper righthand corner
• go to "More Tools" -> "Developer Tools"
• then copy and paste the output from the console drawer at the bottom after you've tried doing some D-Tale manipulations

The console looks like this area at the bottom:

[eriksdev1]

I was able to save the log to this, many many thanks for looking into this 192.168.0.9-1648135939206.log some are:

[aschonfeld]

Thanks for the extra detail. So those errors make no sense to me at all. Those network calls work fine for me. On thing I noticed is that in your original post you had the following code snippet:

@app.route("/dtale")
def dtalepage():
    mytitle = "Analysis with dtale library"
    df = pd.read_csv('/home/erikssawa/mysite/data/engine_metadata.csv')
    instance = startup(data=df, ignore_duplicate=True)
    return redirect(f"/dtale/main/{instance._data_id}", code=302)

Do you still have something like this in your code? Because if so re-using the "dtale" (@app.route("/dtale")) route will definitely cause problems. I'd change it to something like @app.route("/dtale-loader")

[eriksdev1]

Oh ok, I will try running the app changing the route to @app.route("/dtale-loader") Also, I was running the example from the insde the whole downloade repo folder, I have also installed several packages with the normal pip install, ... (not using a venv), I will try using a venv and report shortly and using this folders

[eriksdev1]

Hi, well maybe versions are the problem, just a hunch, I still get errors: Can I ask for a requirements.txt file, I'm new to this and maybe using the same versions you are using could help, sadly I have been unable to make this run, really appreciate the help

[aschonfeld]

So those errors you're getting in to console are expected. I get the same ones, they're just side-effect with how plotly dash handles hidden elements. When I run my version of this app I'm using a python 3.8 environment (created using pyenv) and here's all the packages I have installed:

aiohttp==3.7.4.post0
alembic==1.6.5
altair==4.1.0
anyio==3.3.0
appdirs==1.4.4
appnope==0.1.2
argon2-cffi==20.1.0
astor==0.8.1
asttokens==2.0.5
async-generator==1.10
async-timeout==3.0.1
attrs==21.2.0
backcall==0.2.0
base58==2.1.0
beautifulsoup4==4.9.3
black==20.8b1
bleach==3.3.0
blinker==1.4
bokeh==2.4.0
bqplot==0.12.31
Brotli==1.0.9
bs4==0.0.1
cachetools==4.2.2
certifi==2021.5.30
certipy==0.1.3
cffi==1.14.5
chardet==4.0.0
click==7.1.2
colorama==0.4.4
contextlib2==21.6.0
coverage==5.5
cryptography==3.4.7
cycler==0.10.0
dash==2.0.0
dash-bio==0.7.1
dash-bootstrap-components==0.13.1
dash-colorscales==0.0.4
dash-core-components==2.0.0
dash-daq==0.5.0
dash-html-components==2.0.0
dash-renderer==1.9.1
dash-table==5.0.0
debugpy==1.3.0
decorator==5.0.9
defusedxml==0.7.1
docutils==0.17.1
dtale==2.2.0
entrypoints==0.3
et-xmlfile==1.1.0
execnet==1.9.0
executing==0.8.2
flake8==3.9.2
Flask==2.0.1
Flask-Compress==1.10.1
flask-ngrok==0.0.25
future==0.18.2
gitdb==4.0.7
GitPython==3.1.18
greenlet==1.1.0
htmlmin==0.1.12
idna==2.10
ImageHash==4.2.1
importlib-metadata==4.6.1
iniconfig==1.1.1
ipykernel==6.0.2
ipython==7.31.0
ipython-genutils==0.2.0
ipywidgets==7.6.3
itsdangerous==2.0.1
jedi==0.18.0
Jinja2==3.0.1
joblib==1.0.1
jsonschema==3.2.0
jupyter==1.0.0
jupyter-client==6.1.12
jupyter-console==6.4.0
jupyter-core==4.7.1
jupyter-server==1.10.1
jupyter-server-proxy==3.1.0
jupyter-telemetry==0.1.0
jupyterhub==1.4.2
jupyterlab-pygments==0.1.2
jupyterlab-widgets==1.0.0
kaleido==0.2.1
keyring==23.0.1
kiwisolver==1.3.1
lxml==4.8.0
lz4==3.1.3
Mako==1.1.4
Markdown==3.3.4
MarkupSafe==2.0.1
matplotlib==3.4.2
matplotlib-inline==0.1.2
mccabe==0.6.1
missingno==0.4.2
mistune==0.8.4
mock==4.0.3
multidict==5.1.0
multimethod==1.6
mypy-extensions==0.4.3
nbclient==0.5.3
nbconvert==6.1.0
nbformat==5.1.3
nest-asyncio==1.5.1
networkx==2.6rc2
notebook==6.4.0
numpy==1.21.0
oauthlib==3.1.1
openpyxl==3.0.7
packaging==21.0
pamela==1.0.0
pandas==1.3.2
pandas-profiling==3.1.0
pandocfilters==1.4.3
panel==0.12.2
param==1.11.1
parso==0.8.2
path==16.0.0
path.py==12.5.0
pathspec==0.8.1
patsy==0.5.1
pexpect==4.8.0
phik==0.12.0
pickleshare==0.7.5
Pillow==8.3.0
pkginfo==1.7.1
plotly==5.1.0
pluggy==0.13.1
ppscore==1.2.0
prometheus-client==0.11.0
prompt-toolkit==3.0.19
protobuf==3.17.3
psutil==5.8.0
ptyprocess==0.7.0
pure-eval==0.2.1
py==1.10.0
pyarrow==5.0.0
pycodestyle==2.7.0
pycparser==2.20
pyct==0.4.8
pydantic==1.8.2
pydeck==0.7.0
pyflakes==2.3.1
Pygments==2.9.0
pyOpenSSL==20.0.1
pyparsing==3.0.0b2
pyrsistent==0.18.0
pytest==6.2.4
pytest-cov==2.12.1
pytest-fixture-config==1.7.0
pytest-server-fixtures==1.7.0
pytest-shutil==1.7.0
python-dateutil==2.8.1
python-editor==1.0.4
python-json-logger==2.0.1
pytz==2021.1
pyviz-comms==2.1.0
PyWavelets==1.2.0
PyYAML==5.4.1
pyzmq==22.1.0
qtconsole==5.1.1
QtPy==1.9.0
readme-renderer==29.0
redis==3.5.3
redislite==6.0.674960
regex==2021.7.5
requests==2.25.1
requests-toolbelt==0.9.1
requests-unixsocket==0.2.0
retry==0.9.2
rfc3986==1.5.0
rpy2==3.4.5
ruamel.yaml==0.17.10
ruamel.yaml.clib==0.2.6
scikit-learn==0.24.2
scipy==1.7.0
seaborn==0.11.1
Send2Trash==1.7.1
simpervisor==0.4
six==1.16.0
smmap==4.0.0
sniffio==1.2.0
soupsieve==2.2.1
SQLAlchemy==1.4.21
squarify==0.4.3
stack-data==0.1.3
statsmodels==0.12.2
streamlit==0.87.0
strsimpy==0.2.0
tangled-up-in-unicode==0.1.0
tenacity==7.0.0
termcolor==1.1.0
terminado==0.10.1
testpath==0.5.0
threadpoolctl==2.1.0
toml==0.10.2
toolz==0.11.1
tornado==6.1
tqdm==4.61.2
traitlets==5.0.5
traittypes==0.2.1
twine==3.4.1
typed-ast==1.4.3
typing-extensions==3.10.0.0
tzlocal==2.1
urllib3==1.26.6
validators==0.18.2
visions==0.7.4
voila==0.2.16
wcwidth==0.2.5
webencodings==0.5.1
websocket-client==1.1.0
Werkzeug==2.0.1
widgetsnbextension==3.5.1
xarray==0.18.2
xlrd==2.0.1
yarl==1.6.3
zipp==3.5.0

Hope this helps

[aschonfeld]

@eriksdev1 i just fixed a bug with the charts where they weren’t rendering because of how google colab’s proxy was handling requests #692. If you update your doe to have the following it may solve your issue:

import dtale.app as dtale_app

dtale_app.USE_COLAB = True

Let me know if this helps and I can try and update that solution to be a little more widely available. Thanks

[aschonfeld]

Closing due to lack of activity