search

heavyai / heavydb

HeavyDB (formerly OmniSciDB)
https://heavy.ai
Apache License 2.0
2.96k stars 448 forks source link

Some demos on the website are not working or outdated #823

Open alexey-milovidov opened 11 months ago

alexey-milovidov commented 11 months ago

https://www.heavy.ai/demos/flights Shows "503 Service Unavailable"

https://www.heavy.ai/demos/tweetmap Shows "We're sorry... we're dealing with one too many connections right now." But from side channels, I know that this web page does not, in fact, receive any traffic.

https://www.heavy.ai/demos/taxis It works. But it shows the dataset size of only 1,186,355,942 records, while I know that as of today, there should be more than 4 billion records.

https://www.heavy.ai/demos/ships It works, somewhat sluggish, but alive.

cdessanti commented 11 months ago

Hello Alexey,

Thank you for bringing the non-working demos to our attention. We have discovered that our internal data center is experiencing some issues preventing the tweet-map and flights demo from running correctly.

Regarding the taxi demo, it is based on outdated NYC taxi run data that included pickup and drop-off coordinates. Unfortunately, the municipality stopped sharing such data a long time ago and recently republished the entire dataset, but without the geospatial data. As a result, it's impossible to use such data to guess the starting building for the ride, which is necessary for the demo.

For the ship demo, it may take some time to render, and the entire dashboard refreshes in 2-3 seconds. You can check the query runtime by opening the console window in the Chrome browser.

You should see an output similar to this:

SELECT MIN(VesselLength) AS minimum,MAX(VesselLength) AS maximum FROM ships_ais 
on Server 0 - Execution Time: 82 ms, Total Time: 88 ms, Real Time: 723 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 
SELECT MIN(BaseDateTime) AS minimum,MAX(BaseDateTime) AS maximum FROM ships_ais 
on Server 0 - Execution Time: 77 ms, Total Time: 153 ms, Real Time: 802 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 
SELECT COUNT(*) AS val FROM ships_ais 
WHERE ("ships_ais"."Longitude" is not null
          AND "ships_ais"."Latitude" is not null
          AND "ships_ais"."Longitude" >= -131.176002427 AND "ships_ais"."Longitude" <= -62.688129878 AND "ships_ais"."Latitude" >= -6.408586142 AND "ships_ais"."Latitude" <= 68.591503582) AND "ships_ais"."BaseDateTime" BETWEEN '2009-10-04 00:00:00.000' AND '2011-07-03 00:00:00.000' 
on Server 0 - Execution Time: 64 ms, Total Time: 79 ms, Real Time: 332 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 SELECT COUNT(*) AS val FROM ships_ais on Server 0 - Execution Time: 40 ms, Total Time: 45 ms, Real Time: 284 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 SELECT ships_ais.VesselType AS key0,COUNT(*) AS val  FROM ships_ais WHERE ("ships_ais"."Longitude" is not null
          AND "ships_ais"."Latitude" is not null
          AND "ships_ais"."Longitude" >= -131.176002427 AND "ships_ais"."Longitude" <= -62.688129878 AND "ships_ais"."Latitude" >= -6.408586142 AND "ships_ais"."Latitude" <= 68.591503582) AND "ships_ais"."BaseDateTime" BETWEEN '2009-10-04 00:00:00.000' AND '2011-07-03 00:00:00.000' GROUP BY key0 ORDER BY val DESC NULLS LAST LIMIT 100 
on Server 0 - Execution Time: 77 ms, Total Time: 125 ms, Real Time: 375 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 SELECT CASE WHEN ships_ais.VesselLength >= 408 THEN 20 ELSE WIDTH_BUCKET(ships_ais.VesselLength, 0, 408, 20) END - 1 AS key0,COUNT(*) AS val  FROM ships_ais WHERE ("ships_ais"."Longitude" is not null
          AND "ships_ais"."Latitude" is not null
          AND "ships_ais"."Longitude" >= -131.176002427 AND "ships_ais"."Longitude" <= -62.688129878 AND "ships_ais"."Latitude" >= -6.408586142 AND "ships_ais"."Latitude" <= 68.591503582) AND "ships_ais"."BaseDateTime" BETWEEN '2009-10-04 00:00:00.000' AND '2011-07-03 00:00:00.000' AND (("ships_ais"."VesselLength" BETWEEN 0 AND 408)) GROUP BY key0 HAVING key0 >= 0 AND key0 < 20 ORDER BY key0 
on Server 0 - Execution Time: 642 ms, Total Time: 655 ms, Real Time: 1212 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 SELECT APPROX_COUNT_DISTINCT(MMSI) AS val FROM ships_ais WHERE ("ships_ais"."Longitude" is not null
          AND "ships_ais"."Latitude" is not null
          AND "ships_ais"."Longitude" >= -131.176002427 AND "ships_ais"."Longitude" <= -62.688129878 AND "ships_ais"."Latitude" >= -6.408586142 AND "ships_ais"."Latitude" <= 68.591503582) AND "ships_ais"."BaseDateTime" BETWEEN '2009-10-04 00:00:00.000' AND '2011-07-03 00:00:00.000' 
on Server 0 - Execution Time: 346 ms, Total Time: 919 ms, Real Time: 1555 ms

vendor.0e48eb580f8ba8bf826666cadfd6e2867aa16f4a.js:2 render: {"width":714,"height":1062,"viewRenderOptions":{"premultipliedAlpha":false},"data":[{"name":"pointmap","sql":"SELECT conv_4326_900913_x(Longitude) AS x, conv_4326_900913_y(Latitude) AS y, VesselType AS color FROM ships_ais WHERE SAMPLE_RATIO(0.00003145508260710046) AND ((\"ships_ais\".\"Longitude\" is not null\n          AND \"ships_ais\".\"Latitude\" is not null\n          AND \"ships_ais\".\"Longitude\" >= -131.176002427 AND \"ships_ais\".\"Longitude\" <= -62.688129878 AND \"ships_ais\".\"Latitude\" >= -6.408586142 AND \"ships_ais\".\"Latitude\" <= 68.591503582) AND \"ships_ais\".\"BaseDateTime\" BETWEEN '2009-10-04 00:00:00.000' AND '2011-07-03 00:00:00.000') LIMIT 100000","enableHitTesting":true}],"scales":[{"name":"x","type":"linear","domain":[-14602445.792417677,-6978410.695794406],"range":"width","nullValue":-100},{"name":"y","type":"linear","domain":[-714892.7303833269,10625058.631854909],"range":"height","nullValue":-100},{"name":"pointmap_fillColor","type":"ordinal","domain":["Tug","Cargo","0","Other","Passenger","unknown","Fishing","Tanker","Pleasure Craft","Pilot Vessel","Dredger","Cargo - Hazard A (Major)","Reserved","Military Ops","Wing In Grnd","Tanker - Hazard A (Major)","High-Speed Craft","SAR","Tanker - Hazard B","Dive Vessel","Anti-Pollution","Sailing Vessel","Tanker - Hazard C (Minor)","Cargo - Hazard D (Recognizable)","Port Tender","Tanker - Hazard D (Recognizable)","Cargo - Hazard B","Law Enforce","Cargo - Hazard C (Minor)","1","7","SAR Aircraft","Local Vessel","9","6","Special Craft"],"range":["rgba(234,85,69,0.87)","rgba(189,207,50,0.87)","rgba(179,61,198,0.87)","rgba(39,174,239,0.87)","rgba(135,188,69,0.87)","rgba(244,106,155,0.87)","rgba(172,229,199,0.87)","rgba(237,225,91,0.87)","rgba(131,109,197,0.87)","rgba(134,216,127,0.87)","rgba(234,85,69,0.87)","rgba(189,207,50,0.87)","rgba(179,61,198,0.87)","rgba(239,155,32,0.87)","rgba(135,188,69,0.87)","rgba(244,106,155,0.87)","rgba(172,229,199,0.87)","rgba(237,225,91,0.87)","rgba(131,109,197,0.87)","rgba(134,216,127,0.87)","rgba(234,85,69,0.87)","rgba(189,207,50,0.87)","rgba(179,61,198,0.87)","rgba(239,155,32,0.87)","rgba(135,188,69,0.87)","rgba(244,106,155,0.87)","rgba(172,229,199,0.87)","rgba(237,225,91,0.87)","rgba(131,109,197,0.87)","rgba(134,216,127,0.87)","rgba(234,85,69,0.87)","rgba(189,207,50,0.87)","rgba(179,61,198,0.87)","rgba(239,155,32,0.87)","rgba(135,188,69,0.87)","rgba(244,106,155,0.87)"],"default":"rgba(39,174,239,0.87)","nullValue":"rgba(202,202,202,0.87)"}],"projections":[],"marks":[{"type":"symbol","from":{"data":"pointmap"},"properties":{"xc":{"scale":"x","field":"x"},"yc":{"scale":"y","field":"y"},"fillColor":{"scale":"pointmap_fillColor","field":"color"},"shape":"circle","width":2,"height":2}}],"usermeta":{"clearCaches":true}} 
on Server 0 - Execution Time: 967 ms, Total Time: 2197 ms, Real Time: undefined ms

For this frame of the Dashboard.

image Have you noticed a slower refresh time for the dashboard when you tried to access it?

Best regards, Candido