dorel14 / 3CX-Cdr-Tcp-Server

GNU General Public License v3.0
4 stars 3 forks source link

Weird results / issues #39

Closed MrGlenn-tech closed 3 weeks ago

MrGlenn-tech commented 1 month ago

Hi again,

Im getting some weird results / issues.

If i look at my CDR files folder on the 3cx server it has right now 69 Files, that should be 69 calls for today. If i inspect the database with pgadmin from my computer all i see 15 entries for today in totalt,

image image

i can see on the 3cx it self that all the files has been renamed to .old so it seems to be ok,

im having a hard time trubbelshooting this i can see some error on 3cx-cdr-tcp-server_webapi and im guessing that is the reason for the miss match in my data..

2024-06-14 11:18:00,223 INFO sqlalchemy.engine.Engine BEGIN (implicit) 2024-06-14 11:18:00,224 INFO sqlalchemy.engine.Engine SELECT call_data_records.historyid, call_data_records.callid, call_data_records.duration, call_data_records.time_start, call_data_records.time_answered, call_data_records.time_end, call_data_records.reason_terminated, call_data_records.from_no, call_data_records.to_no, call_data_records.from_dn, call_data_records.to_dn, call_data_records.dial_no, call_data_records.reason_changed, call_data_records.final_number, call_data_records.final_dn, call_data_records.bill_code, call_data_records.bill_rate, call_data_records.bill_cost, call_data_records.bill_name, call_data_records.chain, call_data_records.from_type, call_data_records.to_type, call_data_records.final_type, call_data_records.from_dispname, call_data_records.to_dispname, call_data_records.final_dispname, call_data_records.missed_queue_calls, call_data_records.id FROM call_data_records WHERE call_data_records.historyid = %(historyid_1)s 2024-06-14 11:18:00,224 INFO sqlalchemy.engine.Engine [cached since 1.615e+04s ago] {'historyid_1': 'Call 287644'} None 2024-06-14 11:18:00,228 INFO sqlalchemy.engine.Engine ROLLBACK INFO: 192.168.0.6:39688 - "GET /api/v1/cdr/historyid/Call%20287644 HTTP/1.1" 404 Not Found 2024-06-14 11:18:00,234 INFO sqlalchemy.engine.Engine BEGIN (implicit) 2024-06-14 11:18:00,235 INFO sqlalchemy.engine.Engine SELECT call_data_records_details.cdr_historyid, call_data_records_details.abandonned, call_data_records_details.handling_time_seconds, call_data_records_details.waiting_time_seconds, call_data_records_details.call_date, call_data_records_details.call_time, call_data_records_details.call_week, call_data_records_details.day_of_week, call_data_records_details.filename, call_data_records_details.id FROM call_data_records_details WHERE call_data_records_details.cdr_historyid = %(cdr_historyid_1)s 2024-06-14 11:18:00,235 INFO sqlalchemy.engine.Engine [cached since 1.615e+04s ago] {'cdr_historyid_1': 'Call 287644'} None 2024-06-14 11:18:00,236 INFO sqlalchemy.engine.Engine ROLLBACK INFO: 192.168.0.6:39704 - "GET /api/v1/cdrdetails/historyid/Call%20287644 HTTP/1.1" 404 Not Found INFO: 192.168.0.6:39706 - "POST /api/v1/cdr HTTP/1.1" 422 Unprocessable Entity

dorel14 commented 1 month ago

Hello , sorry to hear that in the database you can get the filename , can you try finding a file that is not in the database and join it to this issue so that i can try to reproduce the problem ?

Other thing : can you try giving me the part of the log after

"POST /api/v1/cdr HTTP/1.1" 422 Unprocessable Entity

I think there will be more informations after that

In new master , i put some more logs for that kind of error

MrGlenn-tech commented 4 weeks ago

Hi,

here is mor info from the logfile.

INFO: 192.168.0.6:42958 - "GET /api/v1/cdr/historyid/Call%20288831 HTTP/1.1" 404 Not Found 2024-06-17 06:01:17,500 INFO sqlalchemy.engine.Engine BEGIN (implicit) 2024-06-17 06:01:17,500 INFO sqlalchemy.engine.Engine SELECT call_data_records_details.cdr_historyid, call_data_records_details.abandonned, call_data_records_details.handling_time_seconds, call_data_records_details.waiting_time_seconds, call_data_records_details.call_date, call_data_records_details.call_time, call_data_records_details.call_week, call_data_records_details.day_of_week, call_data_records_details.filename, call_data_records_details.id FROM call_data_records_details WHERE call_data_records_details.cdr_historyid = %(cdr_historyid_1)s 2024-06-17 06:01:17,500 INFO sqlalchemy.engine.Engine [cached since 2.563e+05s ago] {'cdr_historyid_1': 'Call 288831'} None 2024-06-17 06:01:17,501 INFO sqlalchemy.engine.Engine ROLLBACK INFO: 192.168.0.6:42970 - "GET /api/v1/cdrdetails/historyid/Call%20288831 HTTP/1.1" 404 Not Found INFO: 192.168.0.6:42984 - "POST /api/v1/cdr HTTP/1.1" 422 Unprocessable Entity INFO: 192.168.0.5:57666 - "GET /healthcheck HTTP/1.1" 200 OK INFO: 192.168.0.5:51244 - "GET /healthcheck HTTP/1.1" 200 OK 2024-06-17 06:02:20,957 INFO sqlalchemy.engine.Engine BEGIN (implicit) 2024-06-17 06:02:20,957 INFO sqlalchemy.engine.Engine SELECT call_data_records.historyid, call_data_records.callid, call_data_records.duration, call_data_records.time_start, call_data_records.time_answered, call_data_records.time_end, call_data_records.reason_terminated, call_data_records.from_no, call_data_records.to_no, call_data_records.from_dn, call_data_records.to_dn, call_data_records.dial_no, call_data_records.reason_changed, call_data_records.final_number, call_data_records.final_dn, call_data_records.bill_code, call_data_records.bill_rate, call_data_records.bill_cost, call_data_records.bill_name, call_data_records.chain, call_data_records.from_type, call_data_records.to_type, call_data_records.final_type, call_data_records.from_dispname, call_data_records.to_dispname, call_data_records.final_dispname, call_data_records.missed_queue_calls, call_data_records.id FROM call_data_records WHERE call_data_records.historyid = %(historyid_1)s 2024-06-17 06:02:20,957 INFO sqlalchemy.engine.Engine [cached since 2.564e+05s ago] {'historyid_1': 'Call 288832'} None 2024-06-17 06:02:20,958 INFO sqlalchemy.engine.Engine ROLLBACK INFO: 192.168.0.6:47140 - "GET /api/v1/cdr/historyid/Call%20288832 HTTP/1.1" 404 Not Found

cdr-240617055949.288831.log.old.csv

Also attached the file,i needed to add .csv to the end to be able to upload it

dorel14 commented 4 weeks ago

Thx , i test this evening

dorel14 commented 4 weeks ago

After a test, same result for me , i need some time to look at that

dorel14 commented 3 weeks ago

Hello, good news , i have found what happen , it's fix in latest master

For all the files that have not been inserted in db , just rename them by removing the .old extension , they will be treated like others

dorel14 commented 3 weeks ago

New master available