search

amundsen-io / amundsen

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
https://www.amundsen.io/amundsen/
Apache License 2.0
4.37k stars 953 forks source link

Amunsen crashes because yaml file has incompatible versions mentioned #2160

Open pankajsoni22 opened 1 year ago

pankajsoni22 commented 1 year ago

Incompatible versions of elasticsearch and amundsen-search containers

Expected Behavior

  1. With the command docker-compose -f docker-amundsen.yml up amundsen start working seamlessly
  2. Once amundsen is up with neo4j backend one should be able to ingest sample_data
  3. Amundsen UI should be able to search
  4. Amundsen UI should be able to bookmark
  5. Amundsen UI should be able to put together description of columns, tables etc.

Current Behavior

  1. databuilder/requirements.txt file do not hold dependencies like psycopg2-binary',atlas-client`.
  2. Incompatible versions of elasticsearch and elasticsearch-dsl are mentioned that doesn't work with elasticsearch:8.0.0 container (which is mentioned in docker-amundsen.yml file)

Possible Solution

  1. Mention missing dependencies in requirements.txt with their compatible versions.
  2. Update docker-amundsen.yml file with compatible versions. like elasticsearch==7.13.4, elasticsearch-dsl==7.4.0, amundsen-common==0.24.1, amundsen-databuilder==6.4.6, amundsen-search==3.0.0

Steps to Reproduce

  1. Run docker-compose -f docker-amundsen.yml up
  2. Install python 3.x >= 3.6
  3. Install python dependencies from amundsen/databuilder/requirements.txt directory by running pip3 install -r requirements.txt
  4. Run python3 setup.py install
  5. Run python3 example/scripts/sample_data_loader.py
  6. Now you have to face many problems like es_amundsen container not receiving HTTP PUT calls to create new indexes.
  7. When you go on UI no search is possible
  8. Data partially ingested

Screenshots (if appropriate)

Context

Your Environment

boring-cyborg[bot] commented 1 year ago

Thanks for opening your first issue here!

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.