search

apache / incubator-heron

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter
https://heron.apache.org/
Apache License 2.0
3.65k stars 598 forks source link

Support legacy api of HealthManger #3818

Closed thinker0 closed 2 years ago

thinker0 commented 2 years ago

Support legacy api of HealthManger

3817

thinker0 commented 2 years ago

This is the first time I've seen this error.

[2022-04-13 10:38:18 +0900] [INFO]: State watch triggered for topologies.
[2022-04-13 10:38:18 +0900] [INFO]: Adding children watch for path: /heron/topologies
[2022-04-13 10:38:18 +0900] [INFO]: State watch triggered for topologies.
INFO:     Application startup complete.
[2022-04-13 10:38:18 +0900] [INFO]: Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:31762 (Press CTRL+C to quit)
[2022-04-13 10:38:18 +0900] [INFO]: Uvicorn running on http://0.0.0.0:31762 (Press CTRL+C to quit)
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/2148a0851af15427075470f2dbc45ea582a6a5b0/uvicorn-0.11.7-py3-none-any.whl/uvicorn/protocols/http/httptools_impl.py", line 390, in run_asgi
    result = await app(self.scope, self.receive, self.send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/2148a0851af15427075470f2dbc45ea582a6a5b0/uvicorn-0.11.7-py3-none-any.whl/uvicorn/middleware/proxy_headers.py", line 45, in __call__
    return await self.app(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/c0d3074d049fa733501c957df29d174fae232e84/fastapi-0.75.0-py3-none-any.whl/fastapi/applications.py", line 261, in __call__
    await super().__call__(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/errors.py", line 181, in __call__
    raise exc
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/errors.py", line 159, in __call__
    await self.app(scope, receive, _send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/base.py", line 64, in __call__
    await response(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/responses.py", line 244, in __call__
    await wrap(partial(self.listen_for_disconnect, receive))
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/a300cd1c27cc66d08e6736c76f7ae04743dcf9a8/anyio-3.5.0-py3-none-any.whl/anyio/_backends/_asyncio.py", line 574, in __aexit__
    raise exceptions[0]
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/responses.py", line 240, in wrap
    await func()
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/responses.py", line 234, in stream_response
    await send({"type": "http.response.body", "body": b"", "more_body": False})
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/errors.py", line 156, in _send
    await send(message)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/2148a0851af15427075470f2dbc45ea582a6a5b0/uvicorn-0.11.7-py3-none-any.whl/uvicorn/protocols/http/httptools_impl.py", line 520, in send
    self.transport.write(body)
  File "uvloop/handles/stream.pyx", line 673, in uvloop.loop.UVStream.write
  File "uvloop/handles/handle.pyx", line 159, in uvloop.loop.UVHandle._ensure_alive
RuntimeError: unable to perform operation on <TCPTransport closed=True reading=False 0x31ef7e0>; the handler is closed
[2022-04-13 10:39:10 +0900] [ERROR]: Exception in ASGI application
Traceback (most recent call last):
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/2148a0851af15427075470f2dbc45ea582a6a5b0/uvicorn-0.11.7-py3-none-any.whl/uvicorn/protocols/http/httptools_impl.py", line 390, in run_asgi
    result = await app(self.scope, self.receive, self.send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/2148a0851af15427075470f2dbc45ea582a6a5b0/uvicorn-0.11.7-py3-none-any.whl/uvicorn/middleware/proxy_headers.py", line 45, in __call__
    return await self.app(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/c0d3074d049fa733501c957df29d174fae232e84/fastapi-0.75.0-py3-none-any.whl/fastapi/applications.py", line 261, in __call__
    await super().__call__(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/errors.py", line 181, in __call__
    raise exc
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/errors.py", line 159, in __call__
    await self.app(scope, receive, _send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/base.py", line 64, in __call__
    await response(scope, receive, send)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/responses.py", line 244, in __call__
    await wrap(partial(self.listen_for_disconnect, receive))
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/a300cd1c27cc66d08e6736c76f7ae04743dcf9a8/anyio-3.5.0-py3-none-any.whl/anyio/_backends/_asyncio.py", line 574, in __aexit__
    raise exceptions[0]
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/responses.py", line 240, in wrap
    await func()
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/responses.py", line 234, in stream_response
    await send({"type": "http.response.body", "body": b"", "more_body": False})
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/fc57f7e0aa93ba0fd0bd0a64dbaa11019af27aeb/starlette-0.17.1-py3-none-any.whl/starlette/middleware/errors.py", line 156, in _send
    await send(message)
  File "/var/lib/mesos/slaves/8955ddfd-4cab-4906-8664-97900802f975-S1028/frameworks/c663397e-a472-43bd-92dd-d97027fcf6ce-0000/executors/thermos-www-prod-heron-tracker-0-aedf8bc1-250d-4c8f-8a90-5c758a392980/runs/0564bcd9-eb4c-4362-82a4-98d4d1900aaf/sandbox/.pex/installed_wheels/2148a0851af15427075470f2dbc45ea582a6a5b0/uvicorn-0.11.7-py3-none-any.whl/uvicorn/protocols/http/httptools_impl.py", line 520, in send
    self.transport.write(body)
  File "uvloop/handles/stream.pyx", line 673, in uvloop.loop.UVStream.write
  File "uvloop/handles/handle.pyx", line 159, in uvloop.loop.UVHandle._ensure_alive
RuntimeError: unable to perform operation on <TCPTransport closed=True reading=False 0x31ef7e0>; the handler is closed
ERROR:    Exception in ASGI application
nicknezis commented 2 years ago

Interesting. Is this exception being thrown from the Heron Executor code? From this stack trace, it's hard to tell which lines of Heron code are related. I might need more context before being able to help.

thinker0 commented 2 years ago

@nicknezis heron-tracker. I don't know right now either.

nicknezis commented 2 years ago

Have been having some side discussions with @thinker0 . He may have found the typo culprit.

thinker0 commented 2 years ago

HealthManager 0.20.4, 0.20.5 works well ^__^;

thinker0 commented 2 years ago

Sorry another issue 

[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.healthmgr.HealthManager: Starting Health Manager  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.healthmgr.HealthManager: Starting Health Manager metric posting thread  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.common.network.HeronClient: Connecting to endpoint: /127.0.0.1:31043  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.healthmgr.HealthManagerMetrics: Connected to Metrics Manager. Ready to send register request  
[2022-04-14 08:44:27 +0900] [INFO] com.microsoft.dhalion.policy.PoliciesExecutor: Executing Policy: DynamicResourceAllocationPolicy, checkpoint: 2022-04-13T23:44:27.673475303Z  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.healthmgr.HealthManagerMetrics: We registered ourselves to the Metrics Manager  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.common.network.SocketChannelHelper: Forcing to flush data to socket with best effort.  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.common.network.HeronClient: To stop the HeronClient.  
[2022-04-14 08:44:27 +0900] [INFO] org.apache.heron.healthmgr.HealthManagerMetrics: SimpleMetricsManagerClient exits  
[2022-04-14 08:44:27 +0900] [STDERR] stderr: Exception in thread "main"   
[2022-04-14 08:44:27 +0900] [STDERR] stderr: java.util.concurrent.ExecutionException: java.lang.ClassCastException: class java.lang.Double cannot be cast to class java.lang.String (java.lang.Double and java.lang.String are in module java.base of loader 'bootstrap')
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at org.apache.heron.healthmgr.HealthManager.main(HealthManager.java:242)
[2022-04-14 08:44:27 +0900] [STDERR] stderr: Caused by: java.lang.ClassCastException: class java.lang.Double cannot be cast to class java.lang.String (java.lang.Double and java.lang.String are in module java.base of loader 'bootstrap')
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at org.apache.heron.healthmgr.sensors.TrackerMetricsProvider.parse(TrackerMetricsProvider.java:115)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at org.apache.heron.healthmgr.sensors.TrackerMetricsProvider.getMeasurements(TrackerMetricsProvider.java:81)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at com.microsoft.dhalion.api.MetricsProvider.getMeasurements(MetricsProvider.java:59)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at org.apache.heron.healthmgr.sensors.BackPressureSensor.fetch(BackPressureSensor.java:83)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at com.microsoft.dhalion.policy.HealthPolicyImpl.executeSensors(HealthPolicyImpl.java:115)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at com.microsoft.dhalion.policy.PoliciesExecutor.lambda$start$2(PoliciesExecutor.java:81)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[2022-04-14 08:44:27 +0900] [STDERR] stderr:    at java.base/java.lang.Thread.run(Thread.java:833)
thinker0 commented 2 years ago

  1. https://github.com/apache/incubator-heron/blob/master/heron/healthmgr/src/java/org/apache/heron/healthmgr/sensors/MetricsCacheMetricsProvider.java#L130

  2. https://github.com/apache/incubator-heron/blob/master/heron/healthmgr/src/java/org/apache/heron/healthmgr/sensors/TrackerMetricsProvider.java#L115

It's a String value.

thinker0 commented 2 years ago 
% bazel test heron/healthmgr/...
WARNING: Running Bazel server needs to be killed, because the startup options are different.
Starting local Bazel server and connecting to it...
WARNING: ignoring _JAVA_OPTIONS in environment.
WARNING: /Users/thinker0/opensource/heron/heron/healthmgr/tests/java/BUILD:53:13: in srcs attribute of java_library rule //heron/healthmgr/tests/java:healthmgr-tests: please do not import '//heron/healthmgr/src/java:org/apache/heron/healthmgr/HealthManager.java' directly. You should either move the file to this package or depend on an appropriate rule there. Since this rule was created by the macro 'java_library', the error might have been caused by the macro implementation
INFO: Analyzed 21 targets (182 packages loaded, 2646 targets configured).
INFO: Found 5 targets and 16 test targets...
INFO: Elapsed time: 316.516s, Critical Path: 81.63s
INFO: 798 processes: 38 internal, 760 local.
INFO: Build completed successfully, 798 total actions
//heron/healthmgr/tests/java:BackPressureDetectorTest                    PASSED in 2.9s
//heron/healthmgr/tests/java:BackPressureSensorTest                      PASSED in 2.9s
//heron/healthmgr/tests/java:BufferSizeSensorTest                        PASSED in 2.7s
//heron/healthmgr/tests/java:DataSkewDiagnoserTest                       PASSED in 3.1s
//heron/healthmgr/tests/java:ExecuteCountSensorTest                      PASSED in 2.9s
//heron/healthmgr/tests/java:GrowingWaitQueueDetectorTest                PASSED in 3.1s
//heron/healthmgr/tests/java:HealthManagerTest                           PASSED in 4.6s
//heron/healthmgr/tests/java:HealthPolicyConfigReaderTest                PASSED in 2.0s
//heron/healthmgr/tests/java:LargeWaitQueueDetectorTest                  PASSED in 2.8s
//heron/healthmgr/tests/java:MetricsCacheMetricsProviderTest             PASSED in 2.9s
//heron/healthmgr/tests/java:PackingPlanProviderTest                     PASSED in 2.9s
//heron/healthmgr/tests/java:ProcessingRateSkewDetectorTest              PASSED in 2.8s
//heron/healthmgr/tests/java:ScaleUpResolverTest                         PASSED in 3.9s
//heron/healthmgr/tests/java:SlowInstanceDiagnoserTest                   PASSED in 2.8s
//heron/healthmgr/tests/java:UnderProvisioningDiagnoserTest              PASSED in 1.8s
//heron/healthmgr/tests/java:WaitQueueSkewDetectorTest                   PASSED in 3.1s