Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.73k stars 2.92k forks source link

Metrics not updated when two hive catalogs use local cache in Presto #17151

Open nmahadevuni opened 1 year ago

nmahadevuni commented 1 year ago

Alluxio Version: 2.7.3

Describe the bug Setup alluxio local cache with two hive catalogs in Presto. Say hive1 and hive2. When I query from tables in hive1 catalogs, the JMX metrics are updated, but when I query from tables in hive2 catalog, the metrics are not updated.

To Reproduce 1) Setup two hive catalogs hive1 and hive2. 2)

     create table hive1.default.t1(i int); 
     insert into hive1.default.t1 values(1),(2),(3);
     create table hive2.default.t1(i int); 
     insert into hive2.default.t1 values(1),(2),(3);

3)

    select * from hive1.default.t1;
    select * from hive1.default.t1;

4) select * from jmx.current."com.facebook.alluxio:name=client.cachebytesreadcache.<user.app.id>,type=meters"; JMX metrics from query in 4 above shows correct cache metrics. 5)

    select * from hive2.default.t1;
    select * from hive2.default.t1;

6) select * from jmx.current."com.facebook.alluxio:name=client.cachebytesreadcache.<user.app.id>,type=meters"; JMX metrics from query in 6 above doesn't show updated cache metrics even though the queries in 5 hit the cache.

Expected behavior Since both catalogs share the same cache instance, the metrics should have been updated for the queries on the hive2 catalog too, since they also hit the cache.

Urgency Medium

Are you planning to fix it No

LuQQiu commented 1 year ago

@beinan @dbw9580 FYI

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.