search

stackabletech / demos

This repo contains SDP stacks and demos
https://docs.stackable.tech/home/stable/demos/
Apache License 2.0
0 stars 2 forks source link

Fix the data-lakehouse-iceberg-trino-spark demo #62

Open NickLarsenNZ opened 2 months ago

NickLarsenNZ commented 2 months ago

This came out of the release upgrade testing: https://github.com/stackabletech/demos/issues/59#issuecomment-2238788852

Spark

No visualization information available for the streaming job run. but that seems to only be because the jobs completed. The active job show a visualisation, as does the completed water_level job.

Job list Missing visualization
Job list Missing visualization

You can see exceptions on the right, and the jobs didn't seem to run (0 ms duration).

Postgres

There was also some warnings from the postgres helm install:

# Postgres gave the following warnings:
# WARNING: There are "resources" sections in the chart not set. Using "resourcesPreset" is not recommended for production. For production installations, please set the following values according to your workload needs:
#     - primary.resources
#     - readReplicas.resources
mbaeuerle commented 2 days ago

This might not be related but the URL to the bike status endpoint is not reachable any longer: https://ip-api.mobidata-bw.de/v1/NVBW/gbfs/v2/free_bike_status.json Used in the shared bike status: https://github.com/stackabletech/demos/blob/main/demos/data-lakehouse-iceberg-trino-spark/LakehouseKafkaIngest.xml#L1388

NickLarsenNZ commented 5 hours ago

This might not be related but the URL to the bike status endpoint is not reachable any longer: https://ip-api.mobidata-bw.de/v1/NVBW/gbfs/v2/free_bike_status.json Used in the shared bike status: https://github.com/stackabletech/demos/blob/main/demos/data-lakehouse-iceberg-trino-spark/LakehouseKafkaIngest.xml#L1388

Thanks for the heads-up @mbaeuerle. I'll take a look into this in the lead up to the SDP 24.11 release.