Open AndreiArdelean1 opened 1 year ago
JurajNyiri
commented
1 year ago This integration reuses onvif from Home Assistant. Adding detectors for these would require to expand on it or handlers to be added into https://github.com/home-assistant/core/blob/dev/homeassistant/components/onvif/parsers.py .
JurajNyiri
commented
1 year ago Please report them here.
I tested on C200 with my Person Detection enabled and I have not received any events...
NEVdataDyne
commented
1 year ago I would like to help as I need my tapo cameras to trigger automations in HA when a person is detected. Until now the only way I could achieve that is to use Alexa between the cameras and HA. With this solution the cameras need to access internet which is not ideal. Using the video stream to detect people on another system is also not a solution because it uses the WiFi so much that it interferes with my Philips Hue remotes.
Could you please tell me how to install https://github.com/JurajNyiri/HomeAssistant-Tapo-Control/tree/expand_onvif ?
JurajNyiri
commented
1 year ago NEVdataDyne
commented
1 year ago I downloaded the zip I updated the Tapo custom component to 5.0 Then I replaced all the files custom_components\tapo_control by the ones from the zip using samba share and restarted HA I didn't see any new entities so I installed the onvif integration and connected it to one of my C225 camera I didn't see any new entities either (besides the onvif related entities that I was expecting) In the logs there doesn't seem to be a message like "No registered handler for event from" or "Unable to parse event from"
I am not sure what I should do?
JurajNyiri
commented
1 year ago The code in the branch above doesnt have any new entities. However, it will catch any previously uncought events with an error message. If you are not seeing any other events then it looks like the camera is not issueing those events. I will do some more testing later with the subscription.
NEVdataDyne
commented
1 year ago I do have many errors and warnings from the Tapo integrations. Three of them occur very often (several occurence each minute) I don't know if they are related to unsupported events but the warnings don't provide much info. They occur even when person and movement detection are turned off but there may be other unsupported events, if these are what you are looking for I don't know how to filter them for the specific events that interest us or to make the warning messages more usefull?
Warning 1 This error originated from a custom integration.
Logger: custom_components.tapo_control Source: custom_components/tapo_control/utils.py:561 Integration: Tapo: Cameras Control (documentation, issues) First occurred: 31 March 2023 at 22:06:48 (22736 occurrences) Last logged: 13:37:12
Setting up events...
Warning 2 This error originated from a custom integration.
Logger: custom_components.tapo_control Source: custom_components/tapo_control/utils.py:559 Integration: Tapo: Cameras Control (documentation, issues) First occurred: 31 March 2023 at 22:06:48 (22736 occurrences) Last logged: 13:37:12
setupEvents - entry
Error 1 This error originated from a custom integration.
Logger: custom_components.tapo_control Source: components/onvif/event.py:82 Integration: Tapo: Cameras Control (documentation, issues) First occurred: 31 March 2023 at 22:06:38 (22741 occurrences) Last logged: 13:37:11
Unexpected error fetching Tapo resource status data: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.132:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZHTTP/1.1 500 Internal Server Error') Unexpected error fetching Tapo resource status data: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.25:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZeHTTP/1.1 500 Internal Server Error') Unexpected error fetching Tapo resource status data: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.129:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZHTTP/1.1 500 Internal Server Error') Unexpected error fetching Tapo resource status data: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.140:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZHTTP/1.1 500 Internal Server Error') Unexpected error fetching Tapo resource status data: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.30:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZeHTTP/1.1 500 Internal Server Error') Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 10, in map_exceptions yield File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 188, in _receive_event event = self._h11_state.next_event() File "/usr/local/lib/python3.10/site-packages/h11/_connection.py", line 487, in next_event exc._reraise_as_remote_protocol_error() File "/usr/local/lib/python3.10/site-packages/h11/_util.py", line 77, in _reraise_as_remote_protocol_error raise self File "/usr/local/lib/python3.10/site-packages/h11/_connection.py", line 469, in next_event event = self._extract_next_receive_event() File "/usr/local/lib/python3.10/site-packages/h11/_connection.py", line 411, in _extract_next_receive_event event = self._reader(self._receive_buffer) File "/usr/local/lib/python3.10/site-packages/h11/_readers.py", line 104, in maybe_read_from_SEND_RESPONSE_server matches = validate(status_line_re, lines[0], "illegal status line: {!r}", lines[0]) File "/usr/local/lib/python3.10/site-packages/h11/_util.py", line 91, in validate raise LocalProtocolError(msg) h11._util.RemoteProtocolError: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.135:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZHTTP/1.1 500 Internal Server Error')
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions yield File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "/usr/local/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request raise exc File "/usr/local/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request response = await connection.handle_async_request(request) File "/usr/local/lib/python3.10/site-packages/httpcore/_async/connection.py", line 90, in handle_async_request return await self._connection.handle_async_request(request) File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 112, in handle_async_request raise exc File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 91, in handle_async_request ) = await self._receive_response_headers(*kwargs) File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 155, in _receive_response_headers event = await self._receive_event(timeout=timeout) File "/usr/local/lib/python3.10/site-packages/httpcore/_async/http11.py", line 187, in _receive_event with map_exceptions({h11.RemoteProtocolError: RemoteProtocolError}): File "/usr/local/lib/python3.10/contextlib.py", line 153, in exit self.gen.throw(typ, value, traceback) File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) httpcore.RemoteProtocolError: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.135:2020\x00\x00Accept\x00 /*\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZHTTP/1.1 500 Internal Server Error')
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 239, in _async_refresh self.data = await self._async_update_data() File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 195, in _async_update_data return await self.update_method() File "/config/custom_components/tapo_control/init.py", line 234, in async_update_data await setupOnvif(hass, entry) File "/config/custom_components/tapo_control/utils.py", line 553, in setupOnvif hass.data[DOMAIN][entry.entry_id]["eventsSetup"] = await setupEvents( File "/config/custom_components/tapo_control/utils.py", line 563, in setupEvents if await events.async_start(): File "/usr/src/homeassistant/homeassistant/components/onvif/event.py", line 82, in async_start if await self.device.create_pullpoint_subscription(): File "/usr/local/lib/python3.10/site-packages/onvif/client.py", line 350, in create_pullpoint_subscription pullpoint = await events.CreatePullPointSubscription() File "/usr/local/lib/python3.10/site-packages/zeep/proxy.py", line 64, in call return await self._proxy._binding.send_async( File "/usr/local/lib/python3.10/site-packages/zeep/wsdl/bindings/soap.py", line 156, in send_async response = await client.transport.post_xml( File "/usr/local/lib/python3.10/site-packages/zeep/transports.py", line 235, in post_xml response = await self.post(address, message, headers) File "/usr/local/lib/python3.10/site-packages/zeep/transports.py", line 220, in post response = await self.client.post( File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1848, in post return await self.request( File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1533, in request return await self.send(request, auth=auth, follow_redirects=follow_redirects) File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1620, in send response = await self._send_handling_auth( File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1648, in _send_handling_auth response = await self._send_handling_redirects( File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1685, in _send_handling_redirects response = await self._send_single_request(request) File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1722, in _send_single_request response = await transport.handle_async_request(request) File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 352, in handle_async_request with map_httpcore_exceptions(): File "/usr/local/lib/python3.10/contextlib.py", line 153, in exit self.gen.throw(typ, value, traceback) File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.RemoteProtocolError: illegal status line: bytearray(b'POST /onvif/service\x00HTTP/1.1\x00\x00Host\x00 192.168.50.135:2020\x00\x00Accept\x00 /\x00\x00Accept-Encoding\x00 gzip, deflate, br\x00\x00Connection\x00 keep-alive\x00\x00User-Agent\x00 ZHTTP/1.1 500 Internal Server Error')
AndreiArdelean1
commented
1 year ago @NEVdataDyne It looks like you are having the issue #303 (the last error in your comment). Is your motion sensor (classic one) working/triggered in Homeassistant?
@JurajNyiri I'm not seeing any of the errors you mentioned. Could it be that the integration needs to subscribe explicitly for certain events? Something like "on event PERSON_DETECTED post to WEBHOOK".
Also, because of #303 I'm having issues at the moment. I'm changing the file manually inside onvif-zeep-async but it sometimes gets overwritten or some other issue, but the motion detection (classic one) is not very stable for me. This could be the cause I'm not getting any of the new errors.
NEVdataDyne
commented
1 year ago @AndreiArdelean1 No motion sensor doesn't seem to work. It doesn't seem to work even with my C110 camera so I am not really sure if I am doing somethng wrong. (I have C225, C320WS and one C110 camera)
AndreiArdelean1
commented
1 year ago I've gotten the integration to work by modifying tapo_control to use a local version of onvif-zeep-async and only motion events are triggered. I've also verified this using Postman and observing the sent events.
Also, the ONVIF integration declares CellMotionDetector, TamperDetector, LineCrossDetector, PeopleDetector, TPSmartEventDetector. All of this should be just boolean values. But, I've only been able to trigger only CellMotionDetector. Since the camera supports other types of detection events/notifications (like pet detection, glass break, vehicle, etc., within the official app) + boundary boxes of the detection inside the video feed, (apparently) are not exposed through ONVIF, I'm guessing the camera uses some Tapo specific API for this. The TamperDetector, LineCrossDetector, and PeopleDetector are most likely discontinued from the ONVIF API or something else is going on.
I'll investigate this further and post updates if I find something else.
AndreiArdelean1
commented
1 year ago I didn't manage to find a way of getting the special detection events, but the following will help with integrating the configuration of these events (enabling and sensitivity) into HA and pytapo.
Here is the request the app makes on start:
{"method":"multipleRequest","params":{"requests":[{"method":"getDetectionConfig","params":{"motion_detection":{"name":"motion_det"}}},{"method":"getDetectionRegion","params":{"motion_detection":{"table":["region_info"]}}},{"method":"getBCDConfig","params":{"sound_detection":{"name":["bcd"]}}},{"method":"getPersonDetectionConfig","params":{"people_detection":{"name":["detection"]}}},{"method":"getVehicleDetectionConfig","params":{"vehicle_detection":{"name":["detection"]}}},{"method":"getPetDetectionConfig","params":{"pet_detection":{"name":["detection"]}}},{"method":"getBarkDetectionConfig","params":{"bark_detection":{"name":["detection"]}}},{"method":"getMeowDetectionConfig","params":{"meow_detection":{"name":["detection"]}}},{"method":"getGlassDetectionConfig","params":{"glass_detection":{"name":["detection"]}}},{"method":"getTargetTrackConfig","params":{"target_track":{"name":["target_track_info"]}}},{"method":"getAlertConfig","params":{"msg_alarm":{"name":["chn1_msg_alarm_info","capability"]}}},{"method":"getAlertPlan","params":{"msg_alarm_plan":{"name":"chn1_msg_alarm_plan"}}},{"method":"getAlertTypeList","params":{"msg_alarm":{"name":"alert_type"}}},{"method":"getAlertEventType","params":{"msg_alarm":{"table":["msg_alarm_type"]}}},{"method":"getAlertConfig","params":{"msg_alarm":{"table":["usr_def_audio"]}}},{"method":"getMsgPushConfig","params":{"msg_push":{"name":"chn1_msg_push_info"}}},{"method":"getMsgPushPlan","params":{"msg_push_plan":{"name":"chn1_msg_push_plan"}}},{"method":"getTamperDetectionConfig","params":{"tamper_detection":{"name":"tamper_det"}}},{"method":"getLinecrossingDetectionConfig","params":{"linecrossing_detection":{"name":["detection","arming_schedule"]}}},{"method":"getLinecrossingDetectionRegion","params":{"linecrossing_detection":{"table":["region_info"]}}},{"method":"getMsgPushEventList","params":{"msg_push":{"table":["msg_push_event"]}}}]}}
A few examples of setting detection configs:
baby cry
{"method":"multipleRequest","params":{"requests":[{"method":"setBCDConfig","params":{"sound_detection":{"bcd":{"enabled":"on","sensitivity":"medium"}}}}]}}
person
{"method":"multipleRequest","params":{"requests":[{"method":"setPersonDetectionConfig","params":{"people_detection":{"detection":{"enabled":"off","sensitivity":"60"}}}}]}}
pet
{"method":"multipleRequest","params":{"requests":[{"method":"setPetDetectionConfig","params":{"pet_detection":{"detection":{"enabled":"off","sensitivity":"60"}}}}]}}
bark
{"method":"multipleRequest","params":{"requests":[{"method":"setBarkDetectionConfig","params":{"bark_detection":{"detection":{"enabled":"on","sensitivity":"50"}}}}]}}
glass break
{"method":"multipleRequest","params":{"requests":[{"method":"setGlassDetectionConfig","params":{"glass_detection":{"detection":{"enabled":"on","sensitivity":"60"}}}}]}}
tamper
{"method":"multipleRequest","params":{"requests":[{"method":"setTamperDetectionConfig","params":{"tamper_detection":{"tamper_det":{"enabled":"on","sensitivity":"medium"}}}}]}}
JurajNyiri
commented
1 year ago Updated the code in https://github.com/JurajNyiri/HomeAssistant-Tapo-Control/tree/expand_onvif
You should now see:
2023-04-03 08:49:23.920 WARNING (MainThread) [custom_components.tapo_control] async_parse_messages
2023-04-03 08:49:23.921 WARNING (MainThread) [custom_components.tapo_control] Found event ba835a1edb0d0cdf5bcbafab8b732021_tapo_events: {
'SubscriptionReference': None,
'Topic': {
'_value_1': 'tns1:RuleEngine/CellMotionDetector/Motion',
'Dialect': 'http://www.onvif.org/ver10/tev/topicExpression/ConcreteSet',
'_attr_1': {
}
},
'ProducerReference': None,
'Message': {
'_value_1': {
'Source': {
'SimpleItem': [
{
'Name': 'VideoSourceConfigurationToken',
'Value': 'vsconf'
},
{
'Name': 'VideoAnalyticsConfigurationToken',
'Value': 'VideoAnalyticsToken'
},
{
'Name': 'Rule',
'Value': 'MyMotionDetectorRule'
}
],
'ElementItem': [],
'Extension': None,
'_attr_1': None
},
'Key': None,
'Data': {
'SimpleItem': [
{
'Name': 'IsMotion',
'Value': 'true'
}
],
'ElementItem': [],
'Extension': None,
'_attr_1': None
},
'Extension': None,
'UtcTime': datetime.datetime(1970, 1, 1, 0, 0, tzinfo=<isodate.tzinfo.Utc object at 0x7f663048c580>),
'PropertyOperation': 'Changed',
'_attr_1': {
}
}
}
}I've already done something similar, but the only thing that changed was the Data.SimpleItem.Value (+ UtcTime). No new event was received by tapo_control, even though the notification was sent to the app. Probably the camera doesn't sent any of the new events using ONVIF.
JurajNyiri
commented
1 year ago I have added to main branch (not yet released to pypi):
I was not able to test:
setBarkDetection setPetDetection setGlassBreakDetection setMeowDetection setVehicleDetection getBarkDetection getPetDetection getGlassBreakDetection getMeowDetection getVehicleDetection getCruise
@AndreiArdelean1 could you please test above?
Edit: Released as pytapo 3.1.8.
JurajNyiri
commented
1 year ago @AndreiArdelean1 now released in https://github.com/JurajNyiri/HomeAssistant-Tapo-Control/releases/tag/5.1.0.beta.1 Please test above, my devices do not support it.
AndreiArdelean1
commented
1 year ago They all work except for getCruise. getCruise always is {'patrol': {'patrol': {'action': 'idle'}}} regardless if it is idle or doing the cruise. The HA integrations also works. 🎉
AndreiArdelean1
commented
1 year ago I've been investigating this issue and here is what I've found so far:
ONVIF:
IsMotion, IsTamper, IsLineCross, IsPeople, IsTPSmartEventIsPeople is not triggeredPet, Vehicle, Baby Crying, Glass Break, Dog Barks, Cat Meows, are not even declared in the ONVIF endpointUDP:
video/mp2t in the live stream from port 8800 (https://md.depau.eu/s/r1Ys_oWoP#Live-streaming, https://drmnsamoliu.github.io/video.html). There are no additional application/json received besides the initial ones (informing of the privacy mode overlay). I've not been able to decode the sent JSON packets, only the received ones, as they are encrypted. Most likely the highlighted zones are already included in the video. API:
{"method":"multipleRequest","params":{"requests":[{"method":"searchDateWithVideo","params":{"playback":{"search_year_utility":{"channel":[0],"end_date":"20230431","start_date":"20230401"}}}}]}}
{"method":"multipleRequest","params":{"requests":[{"method":"getSdCardStatus","params":{"harddisk_manage":{"table":["hd_info"]}}},{"method":"getCircularRecordingConfig","params":{"harddisk_manage":{"name":"harddisk"}}}]}}
{"method":"multipleRequest","params":{"requests":[{"method":"getClockStatus","params":{"system":{"name":"clock_status"}}},{"method":"getDstRule","params":{"system":{"name":"dst"}}},{"method":"getTimezone","params":{"system":{"name":["basic"]}}}]}}
{"method":"multipleRequest","params":{"requests":[{"method":"searchDateWithVideo","params":{"playback":{"search_year_utility":{"channel":[0],"end_date":"20230331","start_date":"20230301"}}}}]}}
{"method":"multipleRequest","params":{"requests":[{"method":"searchVideoWithUTC","params":{"playback":{"search_video_with_utc":{"id":1,"start_index":0,"channel":0,"start_time":1680555600,"end_time":1680641999,"end_index":99}}}}]}}
{"method":"multipleRequest","params":{"requests":[{"method":"searchDetectionList","params":{"playback":{"search_detection_list":{"start_index":0,"channel":0,"start_time":1680555600,"end_time":1680641999,"end_index":99}}}}]}}
{"method":"multipleRequest","params":{"requests":[{"method":"searchDateWithVideo","params":{"playback":{"search_year_utility":{"channel":[0],"end_date":"20230231","start_date":"20230201"}}}}]}}What can be used, for event detection is the call:
{"method":"searchDetectionList","params":{"playback":{"search_detection_list":{"start_index":0,"channel":0,"start_time":1680555600,"end_time":1680641999,"end_index":99}}}}and returning:
{'playback': {'snapshot_enable': True, 'search_detection_list': [{'start_time': 1680725544, 'end_time': 1680725662, 'alarm_type': 6}, {'start_time': 1680725693, 'end_time': 1680725802, 'alarm_type': 6}, {'start_time': 1680725826, 'end_time': 1680725856, 'alarm_type': 6}, {'start_time': 1680725917, 'end_time': 1680725947, 'alarm_type': 6}], 'total_num': 4}}A few things to note here:
start_time and end_time define a range and the camera returns the events that have at least 1s within that range (event.start_time can be before request.start_time, and the same for end_time)I've written this python script to get the events from the last 10 min to test it:
secondsFrom1970 = tapo.executeFunction(
"getClockStatus", {"system":{"name":"clock_status"}}
)["system"]["clock_status"]["seconds_from_1970"]
print(secondsFrom1970)
searchStart = secondsFrom1970 - (10 * 60) # 10 min
searchEnd = secondsFrom1970 + 10
print(tapo.executeFunction(
"searchDetectionList", {"playback":{"search_detection_list":{"start_index":0,"channel":0,"start_time":searchStart,"end_time":searchEnd,"end_index":99}}}
))Maybe this method of detection motion could be used to detect motion on https://github.com/JurajNyiri/HomeAssistant-Tapo-Control/issues/273. This could be done by:
lastEvent) from the list and later storing it to savedLastEvent.start_time of lastEvent and savedLastEvent are not the same, a new event was triggeredalarm_type of lastEvent and savedLastEvent are not the same, a new event was triggeredsavedLastEvent has completed, a new event was triggeredsecondsFrom1970 is within 30s (this is the default/minimum duration of an event) or 10s from the end_time, the event could still be active, otherwise the lastEvent can be marked as completedInstead of making a call periodically, the ONVIF motion event could be used to trigger the call to searchDetectionList. BUT, the motion event is not triggered if only an AI event is detected. If the motion sensitivity is set high enough, the 2 events would be triggered in close succession and this would probably work.
Probably the best solution would be a combination of making a call periodically and watching for ONVIF motion events.
Other possible methods not yet discovered/implemented on the camera:
NEVdataDyne
commented
1 year ago Maybe in "Other possible methods not yet discovered/implemented" you can add "intercept the calls made by the camera to Alexa servers for notification" (for people detection). For some reason Alex seems to be the only service other than Tapo to get notified when a person is detected (and this is the only event Alexa can get).
AndreiArdelean1
commented
1 year ago I've written this script (attached) to pull events from the camera. It works really well. I'd implement a proof of concept for Tapo-Control, but I'm not very familiar with HomeAssistant integrations. Maybe this method could be used alogside the existing ONVIF events for detecting motion.
Notes: The 2 files need to be under the same directory.
Archive.zip
JurajNyiri
commented
1 year ago Thank you @AndreiArdelean1 . I played with the script, it had a bug where it was calculating incorrect start time for cameras in different timezone to UTC-0. I adjusted a couple of things and released new function getEvents to pytapo 3.1.11.
I am testing with following script:
from pytapo import Tapo
import time
from datetime import datetime
import os
# Camera
user = os.environ.get("user") # admin user
password = os.environ.get("password") # cloud password
host = os.environ.get("ip") # ip of the camera, example: 192.168.1.52
tapo = Tapo(host, user, password, password)
epoch_time = int(time.time())
secondsFrom1970 = epoch_time
minSearchStart = secondsFrom1970 - (60 * 60)
searchStart = minSearchStart # can be used as opt parameter in tapo.getEvents()
searchEnd = secondsFrom1970 + 60 # maybe add a few seconds? # can be used as opt parameter in tapo.getEvents()
while True:
events = tapo.getEvents()
if events:
lastEvent = events[-1]
newLastEventDictionary = {
'startTime': lastEvent["start_time"],
'endTime': lastEvent["end_time"],
'alarmType': lastEvent["alarm_type"],
}
print(datetime.now())
print(lastEvent)
print(datetime.fromtimestamp(newLastEventDictionary['startTime']))
print(datetime.fromtimestamp(newLastEventDictionary['endTime']))
print("")
else:
print("none")
time.sleep(1)I tested on 2 C200s. One HW V1.0 and another one 3.0. The 3.0 also has tapo cloud subscription. I found that:
I tested also with your script only to verify I haven't made any mistakes when writing the new function.
Could you try it and let me know if it works with your cameras?
AndreiArdelean1
commented
1 year ago I get something like:
2023-04-13 15:57:14.501225
{'start_time': 1681390629, 'end_time': 1681390659, 'alarm_type': 2, 'startRelative': 4.0, 'endRelative': -26.0}
2023-04-13 15:57:09
2023-04-13 15:57:39startRelative > 0)start_time, end_time, or alarm_type of the last eventWhat I've noticed, if multiple sources (script and Tapo app) are requesting the events at once, one of them could return an empty list.
AndreiArdelean1
commented
1 year ago Off-topic, but I'm not sure where I should post this:
All the possible values for alarm_type from searchDetectionList:
allKnownAlarmTypes = {
1: "Timing",
2: "Motion",
3: "TAMPER",
4: "Line Crossing",
5: "Area Intrusion",
6: "Person",
7: "Baby Cry",
8: "Vehicle",
9: "Pet",
10: "Ring Alarm",
11: "Dog Bark",
12: "Cat Meow",
13: "Alarm Glass",
14: "Alarm Smoke",
15: "Deliver Package",
16: "Pickup Package",
17: "Dollbell Ring Missed",
18: "Dollbell Ring Answered",
19: "Anti Theft",
}I'm not sure which work, which don't, or what they mean. I've extracted them from the Android app. The raw values:
JurajNyiri
commented
1 year ago @AndreiArdelean1 could you please test this script with the pytapo 3.1.13 to verify it still works? I think I managed to fix the timezone issue and it seems to be working fairly well now for me.
AndreiArdelean1
commented
1 year ago It works!
fightforlife
commented
1 year ago When I try to run the script above on the latest python docker image I get the following error:
File "/usr/local/lib/python3.11/site-packages/requests/adapters.py", line 517, in send raise SSLError(e, request=request) requests.exceptions.SSLError: HTTPSConnectionPool(host='192.168.1.81', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLError(1, '[SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:1002)')))
Do you have a tip? Maybe it has something todo with the IP not being a hostname? Is there a way to set the request to insecure?
rmtrane
commented
1 year ago @AndreiArdelean1 Just to clarify, you were able to extract the AI detected events (person, pet, vehicle, baby crying, etc.)? I was playing around for a minute with the getEvents function, but couldn't get it to work. Just wanted to make sure it would be worth the time to actually dive in... Thank you!
AndreiArdelean1
commented
1 year ago Hey, yes, it is working. It did work for motion, person, and pet, but it wasn't working for tamper detection (Or I didn't manage to get it in my testing as that type of detection was a bit hard to trigger). Sounds detection (meow, bark, baby, glass break) I couldn't trigger the actual event during testing so I can't say if it is working. But, if an event is shown with the correct icon in the playback list in the official app, then you should also be able to detect it with this function.
You could:
I've only tested method 1. When investigating I had some issues with ONVIF so I couldn't test method 2.
rmtrane
commented
1 year ago Thank you for letting me know! I'm mainly interested in the sounds detection, so might try to get this to work.
(In case you're interested, I have had success in triggering the events resulting in notifications through the Tapo app by simply using youtube videos of baby crying, dog barking, etc.)
@JurajNyiri Any plans to implement something like this in the Home Assistant integration? I will probably try to do something ad-hoc, but would be really cool to have this in the integration 😊
cruckfi
commented
1 year ago I’ve read this conversation with much interest, but didn’t understand what is actually possible now within the context of the integration. I own a Tapo C310 and am interested in the person detection. How should I proceed to integrate it?
JurajNyiri
commented
1 year ago @cruckfi it is not currently available inside the integration at all. What you could do today, is write a custom script hitting the camera and sending the information to HA, for example through REST API.
I will eventually add this to the integration but I do not have any estimate as of today.
NEVdataDyne
commented
1 year ago I will eventually add this to the integration but I do not have any estimate as of today.
To me it is THE one functionality I need in HA. Right now I use Alexa to detect a person and notify HA. That means the Tapo cameras must be able to communicate with the Internet. As soon as the person detection is available in HA it means that the Tapo cameras can be put offline which is a lot better for privacy.
AndreiArdelean1
commented
1 year ago I’ve read this conversation with much interest, but didn’t understand what is actually possible now within the context of the integration. I own a Tapo C310 and am interested in the person detection. How should I proceed to integrate it?
You can also create a webhook with https://ifttt.com/tplink_tapo that notifies HA when a person is detected.
JurajNyiri
commented
1 year ago I was looking into this again in hope to implement it and tested it on C200 HW 1.0 1.3.6 Build 230424 Rel.77225n(4555) and C200 HW 3.0 1.3.6 Build 230424 Rel.77225n(4555) with this script and I am only getting the event once it stops - not when it starts. Meaning it shows up with endRelative 0 but never with missing end or start being around 0. Is this different for you @AndreiArdelean1 ?
AndreiArdelean1
commented
1 year ago 
dvpereira
commented
1 year ago @JurajNyiri I ran the script and noticed that it only returns the event about 2s AFTER the detection window ends. I tested it on my TAPO C200. I'm going to test on the C310 in a little while I'll return here.
2023-08-21 14:11:50.756539
{'start_time': 1692637890, 'end_time': 1692637908, 'alarm_type': 2, 'startRelative': 20, 'endRelative': 2}
2023-08-21 14:11:30
2023-08-21 14:11:48My C310 answer:
2023-08-21 14:21:02.550051
{'start_time': 1692638422, 'end_time': 1692638462, 'alarm_type': 2, 'startRelative': 40, 'endRelative': 0}
2023-08-21 14:20:22
2023-08-21 14:21:02I'm doing some research to try to figure out how (if) can we change this behavior...
erasmus83
commented
1 year ago Also very interested in this feature - I have C210 cameras and always happy to help test
Myrddraal
commented
9 months ago For those looking to use the built-in Tapo person detection with Home Assistant, until we can do so through this integration, I am using a workaround:
I have a Tapo TC65 and a Tapo smart socket P100. In the Tapo app, I can set the smart socket to switch on based on AI person detection. In Home Assistant, I then use the state of the smart socket as a proxy for person detection. It switches itself back off, so that the next person detection event can switch it on again.
Obviously not an ideal workaround, but it works well enough for me for now!
NEVdataDyne
commented
9 months ago That's interesting, I am currently using the person detection routine in Alexa to turn a Phillips hue light on that gets detected by HA. The most cumbersome way of detecting a person i suppose but didn't find a better way. Your method would allow me a least to ditch Alexa who tries to sell me batteries for my hue remotes when they run out...
NEVdataDyne
commented
9 months ago @Myrddraal can you check if your solution works without internet? I know the camera's person detection is done off line but I wonder if the internet is necessary for your tapo automation to work
Myrddraal
commented
9 months ago @NEVdataDyne I haven't tried, but I'm fairly sure that it does rely on an internet connection. As I understand it, you can view the camera feed on the same network, without internet, but controlling other devices requires an internet connection.
cncb-gh
commented
7 months ago Does it seem unlikely that we will ever be able to get Person Detection events? This is the main issue preventing me from going all local.
JurajNyiri
commented
7 months ago The best would be to ask tplink to add it to the onvif standard. Then it will work across all the 3rd party solutions and applications.
cncb-gh
commented
7 months ago TP-Link support said they passed on the request to R&D but you know how that goes...
akomelj
commented
6 months ago Just a small side note based on my observations:
I have a Tapo C220 cam. The cam supports two types of notification subscriptions:
I noticed, in accordance with all the above observations, that the cam does not publish events on any topic apart from Motion when pull point event polling is used.
However, when the second method is used, the cam sends additional events. I can get notifications when AI detects a person in motion (EVENT: 2024-02-11T13:07:05.000Z RuleEngine/CellMotionDetector/People PROP:Changed SRC:VideoSourceConfigurationToken, VideoAnalyticsConfigurationToken, Rule=vsconf, VideoAnalyticsToken, MyPeopleDetectorRule DATA:IsPeople=true). :+1:
I haven't tested for other event types yet (pets, cars, noise) as this is a bit harder to do, but I will update this comment if I observe any other event types on the listener.
EDITED 2024-02-15: The cam unfortunately does not publish pet-related events to web hook - i.e. cam detects a cat and shows overlay in the app but does not publish TPSmartEvent via ONVIF notification system.
rct
commented
5 months ago I just got this custom integration set up for a C120 and am I trying to digest the current state of this issue.
1st question, I think the C120 is fairly new hardware introduced in 2023 based on reviews. Is there any testing I should be doing against it?
EDIT
Two more questions:
Is your feature request related to a problem? Please describe. I want to be able to detect multiple event types. I'm not interested in actually highlighting/retrieving the rectangle where this was detected on the camera, just the detection event.
Describe the solution you'd like I want to be able to detect and distinguish between:
These notifications are sent to the native app.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context These features are available on 3MP+ cameras for free, and on 1080p cameras using the paid subscription
Here is the response from
GetEventPropertiesof the ONVIF endpoint on Tapo C225 camera:Currently, motion detection doesn't work on Tapo C225 #303, but this feature would be nice to have once it is working.