databricks-demos / dbdemos

Demos to implement your Databricks Lakehouse
Other
285 stars 96 forks source link

Dolly demo: "Notebook not found" error #32

Open ericthomas1 opened 1 year ago

ericthomas1 commented 1 year ago

I'd like to work through the dolly-llm-chatbot demo, but I'm stuck on the second code block:

Executing this... %run ./_resources/00-init $catalog=hive_metastore $db=dbdemos_llm

...results in this:

Notebook not found: Users/<me>/<my-notebook>/_resources/00-init. Notebooks can be specified via a relative path (./Notebook or ../folder/Notebook) or via an absolute path (/Abs/Path/to/Notebook). Make sure you are specifying the path correctly.

I'd prefer to not install any additional packages/etc. I just want to experiment with the demo code itself.

How do I get past this error?

Thank you

QuentinAmbard commented 1 year ago

Hi @ericthomas1 , How did you install the demo ? If you run it with %pip install it should install the demo in _resources If not did you had an error during the installation?

ericthomas1 commented 1 year ago

Hello, I actually didn't install the demos. Just started walking though the demo (https://www.dbdemos.ai/demo-notebooks.html?demoName=llm-dolly-chatbot).

I now see on dbdemos.ai that I should have run %pip install dbdemos.

Will do that now.

Thanks

ericthomas1 commented 1 year ago

Hm... I started a new notebook with %pip install dbdemos.

Results:

Python interpreter will be restarted.
Collecting dbdemos
  Downloading dbdemos-0.3.13-py3-none-any.whl (30.1 MB)
Requirement already satisfied: requests in /databricks/python3/lib/python3.8/site-packages (from dbdemos) (2.25.1)
Collecting dbsqlclone
  Downloading dbsqlclone-0.1.21-py3-none-any.whl (10 kB)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /databricks/python3/lib/python3.8/site-packages (from requests->dbdemos) (1.25.11)
Requirement already satisfied: certifi>=2017.4.17 in /databricks/python3/lib/python3.8/site-packages (from requests->dbdemos) (2020.12.5)
Requirement already satisfied: chardet<5,>=3.0.2 in /databricks/python3/lib/python3.8/site-packages (from requests->dbdemos) (4.0.0)
Requirement already satisfied: idna<3,>=2.5 in /databricks/python3/lib/python3.8/site-packages (from requests->dbdemos) (2.10)
Installing collected packages: dbsqlclone, dbdemos
Successfully installed dbdemos-0.3.13 dbsqlclone-0.1.21
Python interpreter will be restarted.

I then successfully ran the subsequent command %pip install -U chromadb==0.3.22 langchain==0.0.164 transformers==4.29.0 accelerate==0.19.0

Same error as this original post when running: %run ./_resources/00-init $catalog=hive_metastore $db=dbdemos_llm:

Notebook not found: Users/<user>@<org.tld>/_resources/00-init. Notebooks can be specified via a relative path (./Notebook or ../folder/Notebook) or via an absolute path (/Abs/Path/to/Notebook). Make sure you are specifying the path correctly.

Stacktrace:
  /Users/<user>@<org.tld>/<notebook_name>: python

Thoughts?

QuentinAmbard commented 1 year ago

hi @ericthomas1 so you need to install the demo like this:

image

so in a cell: %pip install dbdemos.

and then in the following cell:

import dbdemos
dbdemos.install('llm-dolly-chatbot')

This will install all the notebooks for you (don't try to load the notebooks manually, the installer will do it for you) you can also chose where the notebooks will be loaded:

import dbdemos
dbdemos.install('llm-dolly-chatbot', path="/an/existing/workspace/folder/")