jaros1 / Money-Network

Demo with complementary and alternative money. Implemented in ZeroNet and AngularJS. Focus on privacy, encryption, max data in client and min data on ZeroNet. Work in progress.
GNU General Public License v2.0
4 stars 4 forks source link

Receive chat message - check for money transactions in chat message #199

Closed jaros1 closed 6 years ago

jaros1 commented 7 years ago

1) receive money. auto approve receive money in MN? MN user setting? Only relevant for already known wallets. W2 has a separate confirm checkbox option for money transactions. 2) manual approve, reject or edit and return money transactions. 3) all wallets must exists and receiver must have created a wallet/account in each wallet 4) ping, open wallet link, execute_mt_request and execute_mt_response messages 5) wallets should be able to complete money transactions without more MN chat messages 6) money transaction status. MN must be able to see money transaction status. 7) notification about receive money transactions. More important than normal chat messages. Show in wallet or money pages

jaros1 commented 7 years ago

Receive money error. From issue #208

screenshot from 2017-10-13 15-52-31

jaros1 commented 7 years ago

mn-jro2-127.0.0.1-1507913135314.log

jaros1 commented 7 years ago

Looks like the error is introduced when sending money transaction. Outgoing message is json validated in send_chat_msg in chatCtrl without error, but $$hashKey is added to message doing send process. Is an angularJS property. The problem is that message is added to angularJS UI doing send operatation.

18:43:43.081 all.js:1788 ChatCtrl.send_chat_msg.step_4_send_message:
message = {
  "msgtype":"chat msg",
  "message":"Money test 3",
  "money_transactions":[{
     "wallet_url":"1LqUnXPEgcS15UGwEgkbuTbKYZqAUwQ7L1","wallet_sha256":"e488d78dc26af343688045189a714658ed0f7975d4db158a7c0c5d0a218bfac7","wallet_name":"1LqUnXPEgcS15UGwEgkbuTbKYZqAUwQ7L1",
     "action":"Send","code":"tBTC","name":"Test Bitcoin","amount":0.0001,
     "json":{"return_address":"2N5fkzSJyqFtC3fFi4s6y7Nb889GKt3AmZc"}
  }]
}

18:43:43.906 all.js:19292 ChatCtrl.send_chat_msg.step_3_check_transactions.check_transaction: Sorry. Money transaction is not yet implemented
Todo: receive chat with money transaction 18:43:43.906 all.js:19293 ChatCtrl.send_chat_msg.step_3_check_transactions.check_transaction: self.new_chat_msg_disabled = false 18:43:43.908 30-ZeroFrame.js:7 [Violation] 'message' handler took 953ms 18:43:43.942 MoneyNetworkAPI.js:1460 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: issue 1140. https://github.com/HelloZeroNet/ZeroNet/issues/1140. step 2 FileDelete returned No such file or directory 18:43:43.942 MoneyNetworkAPI.js:281 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/72a44d6a31.1507913015147 fileGet started (82). 2 pending ZeroNet API operations (81,82) 18:43:43.949 all.js:6500 MoneyNetworkZService.z_update_1_data_json get_my_user_hub callback 1: hub = 1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh, random_other_hub = 1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh 18:43:43.952 all.js:1788 MoneyNetworkZService.z_update_1_data_json get_like_json callback 2: query 1 (MS OK) = select files.filename, files.size from json, files where json.directory = '1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ' and json.file_name = 'content.json' and files.json_id = json.json_id 18:43:43.952 MoneyNetworkAPI.js:281 MoneyNetworkZService.z_update_1_data_json get_like_json callback 2: query 1 dbQuery started (83). 3 pending ZeroNet API operations (81,82,83) 18:43:44.062 40-angular.js:6241 [Violation] 'setTimeout' handler took 119ms 18:43:44.132 40-angular.js:6241 [Violation] 'setTimeout' handler took 52ms 18:43:44.159 MoneyNetworkAPI.js:295 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/72a44d6a31.1507913015147 fileGet finished. res = "Not found". elapsed time 217 ms (82). 2 pending ZeroNet API operations (81,83) 18:43:44.163 MoneyNetworkAPI.js:295 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/72a44d6a31.1507913015147 fileDelete finished. res = "OK". elapsed time 1217 ms (81). 1 pending ZeroNet API operation (83) 18:43:44.166 MoneyNetworkAPI.js:295 MoneyNetworkZService.z_update_1_data_json get_like_json callback 2: query 1 dbQuery finished. res = "OK". elapsed time 214 ms (83). No pending ZeroNet API operations 18:43:44.174 all.js:6547 MoneyNetworkZService.z_update_1_data_json get_data_json callback 4: data.hub = 1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh 18:43:44.185 all.js:1788 MoneyNetworkZService.z_update_2a_data_json_encrypt: first contact. using sha256 values of JSEncrypt pubkey as receiver_sha256. pubkey = -----BEGIN PUBLIC KEY----- MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA0pMuMJyynH1BmhMJ6vvd QZplIBgiiOQSqwu2SpYKICm+P1gGNHnICQic/Nuqi9t93rxJLfWCsl0+lCtoJLen f78xz4XzEcGPBeBFn2TbQqPO9loylNlaOgiqDG5qcSc9n7yEF0xmpReDGATwzECi JrpZBImwhUMO48iS08b4IfQaMsbnUVY8hdUeJiQ831kMkNQLtxWaeRiyn8cTbKQ6 LXCDG7GDaFN6t+x3cv/xBX06+ykuYQ0gNIBySiIz69RYzhvOkqOQggLWPF+NMW1J O6VRqvX7Sybwm51v3kGGKWeX4znvGY+GwVCpwiH+b2hbGZHIqFp9ogimGVE0WPgu nwIDAQAB -----END PUBLIC KEY-----, receiver_sha256 = 211e3bd79e715f940c710f037f229fe81f28a3bb9a983a0b3e9a946bb219c702 18:43:44.195 all.js:1671 MoneyNetworkZService.add_feedback_info: Error in chat msg JSON. cannot add feedback info to invalid outgoing message{"message":"Additional properties not allowed","params":{},"code":303,"dataPath":"/money_transactions/0/$$hashKey","schemaPath":"/properties/money_transactions/items/additionalProperties","subErrors":null} 18:43:44.196 all.js:6077 MoneyNetworkZService. add_feedback_info: Error in chat msg JSON. cannot add feedback info to invalid outgoing message.
Error {"message":"Additional properties not allowed","params":{},"code":303,"dataPath":"/money_transactions/0/$$hashKey","schemaPath":"/properties/money_transactions/items/additionalProperties","subErrors":null} 18:43:44.198 all.js:1788 MoneyNetworkZService.z_update_2a_data_json_encrypt: sending message = { "msgtype":"chat msg", "message":"Money test 3", "money_transactions":[{ "wallet_url":"1LqUnXPEgcS15UGwEgkbuTbKYZqAUwQ7L1","wallet_sha256":"e488d78dc26af343688045189a714658ed0f7975d4db158a7c0c5d0a218bfac7","wallet_name":"1LqUnXPEgcS15UGwEgkbuTbKYZqAUwQ7L1", "action":"Send","code":"tBTC","name":"Test Bitcoin","amount":0.0001, "json":{"return_address":"2N5fkzSJyqFtC3fFi4s6y7Nb889GKt3AmZc"}, "$$hashKey":"object:2095"}], "local_msg_seq":1056, "sender_sha256":"05d505471eea8ae547ab0081f382109bec68c7f125633caa000e4ff1a66f2daf" } 18:43:45.040 MoneyNetworkAPI.js:281 MoneyNetworkHubService.write_data_json: z_file_write NaN/data.json fileWrite started (84). 1 pending ZeroNet API operation (84) 18:43:45.042 30-ZeroFrame.js:7 [Violation] 'message' handler took 878ms 18:43:45.163 MoneyNetworkAPI.js:295 MoneyNetworkHubService.write_data_json: z_file_write NaN/data.json fileWrite finished. res = "OK". elapsed time 123 ms (84). No pending ZeroNet API operations 18:43:46.221 30-ZeroFrame.js:7 [Violation] 'message' handler took 1058ms 18:43:46.254 MoneyNetworkAPI.js:281 MoneyNetworkHubService.write_status_json get_my_user_hub callback 1: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/status.json fileWrite started (85). 1 pending ZeroNet API operation (85) 18:43:46.270 MoneyNetworkAPI.js:295 MoneyNetworkHubService.write_status_json get_my_user_hub callback 1: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/status.json fileWrite finished. res = "OK". elapsed time 16 ms (85). No pending ZeroNet API operations 18:43:46.271 MoneyNetworkAPI.js:281 MoneyNetworkHubService.zeronet_site_publish write_status_json callback 4: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json sitePublish started (86). 1 pending ZeroNet API operation (86) 18:43:47.417 all.js?rev=3097&lang=en:593 hideProgress 18:43:47.431 MoneyNetworkAPI.js:295 MoneyNetworkHubService.zeronet_site_publish write_status_json callback 4: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json sitePublish finished. res = "OK". elapsed time 1160 ms (86). No pending ZeroNet API operations 18:43:47.432 all.js:3815 MoneyNetworkHubService.zeronet_site_publish sitePublish callback 5: res = "ok" (86) 18:43:47.476 MoneyNetworkAPI.js:281 MoneyNetworkHubService.zeronet_site_publish sitePublish callback 5: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json fileGet started (87). 1 pending ZeroNet API operation (87) 18:43:47.484 MoneyNetworkAPI.js:295 MoneyNetworkHubService.zeronet_site_publish sitePublish callback 5: merged-MoneyNetwork/1PgyTnnACGd1XRdpfiDihgKwYRRnzgz2zh/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json fileGet finished. res = "OK". elapsed time 8 ms (87). No pending ZeroNet API operations 18:44:03.657 all.js?rev=3097&lang=en:593 hideProgress
jaros1 commented 7 years ago

Fixed JSON validation error for outgoing money transaction chat message. AngularJS adds $$hashKey to money_transactions array and $$hashKey must be removed before JSON validation and before encrypt & send operation.

jaros1 commented 7 years ago

Implementing approve money transaction. show notifications/error messages as ZeroFrame notification in top or show error message inline below "Approve Reject Edit" line?

screenshot from 2017-10-21 17-10-52

Maybe best inline?

jaros1 commented 7 years ago

Show ingoing money trans:

function format_money_transaction_message is only working OK for outgoing money transactions!

jaros1 commented 7 years ago

Incoming chat msg with money transactions:

screenshot from 2017-10-22 06-39-24

Object.object. "empty" {} object. Not yet any formatted (error) message for money transaction line. Action: Text instead of buttons after approved, rejected or edited money transactions. Add status column: blank, done, pending, error, rejected, cancelled etc. Very short status with additional information below. Show wallet balance chat msg? Relevant in some situations. Not in all. Disable buttons while processing last action. Prevent multiple clicks/actions. Like send new chat msg.

The empty {} html object must have been added in a failed Approve action. This is now a new unprocessed incoming money transactions from fuckcf.cf looks:

screenshot from 2017-10-22 07-39-35

jaros1 commented 7 years ago

Added check_mt and start_mt calls on MN. Now missing start_mt processing in wallet:

screenshot from 2017-10-24 18-24-03

jaros1 commented 7 years ago

First full send money test from jro test on old laptop (sweden) to jro on new laptop (torando). Testing with ZeroNet ports open. Problems with optional files and port closed.

Problems doing test: 1) Sender. Had to temporary disable VPN while communicating with BTC wallet (external API). Cross site error. 2) Chat msg. Receiver did not see chat msg with money transaction after OK publish. Had to chat to get lost message notification and force sender (torando) to resend money transaction message. 3) Receiver. Approve process OK in MN. Have to check w2 log to test if wallet to wallet communication is working correct.

mn-sender-jro-test-torando.log w2-sender-jro-torando.log w2-receiver-jro-sweden.log mn-receiver-jro-sweden.log

error 1: w2-receiver-jro-sweden. Approve incoming money transaction ok. Created new wallet to wallet session. New wallet to wallet session should read pubkeys message from sender jro test torando. fileGet error Not found. Using required: false in fileGet. That may be an error. Added an optionalFileInfo before fileGet to check number of peer before starting optional file download. Should abort if peer = 0. Should start a optional file download (required=true) if peer > 0

W2: jro receiver sweden. created a new wallet to wallet session. Expects demon process to read pubkeys message 562bde76d3.1508922413611 created by jro test sender torando.

11:11:16.830 MoneyNetworkAPI.js:309 MoneyNetworkAPILib.add_session: monitoring other_session_filename 562bde76d3, sessionid = eobk4CCemoFrE0w3drLQRBBGc82WIcevBqrHAc5ycUS43pS1NTC35G8HdAct
11:11:16.831 MoneyNetworkAPI.js:327 MoneyNetworkAPILib.add_session: other_session_filename 562bde76d3 should be processed by encrypt4
11:11:16.831 MoneyNetworkAPI.js:1420 new MoneyNetworkAPI: encrypt4: Encryption setup: waiting for other_session_pubkey, other_session_pubkey2

w2: receiver jro sweden: reading pubkeys message from sender jro test torando. Why failed fileGet?

11:11:18.565 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions:
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/562bde76d3.1508922413611 fileGet started (108). 1 pending ZeroNet API operation (108)
11:11:18.571 MoneyNetworkAPI.js:223 MoneyNetworkAPILib.load_offline_transactions:
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/562bde76d3.1508922413611 fileGet finished. res = "Failed". elapsed time 6 ms (108). No pending ZeroNet API operations
11:11:18.571 MoneyNetworkAPI.js:623 MoneyNetworkAPILib.load_offline_transactions:
filename merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/562bde76d3.1508922413611 was not found

error 2: jro receiver sweden. page reload. optional file cleanup at page start tries to delete not received optional file with pubkeys message from jro test sender torando. One issue is using same zeronet certificate for both jro and jro test. Same directory 1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/ 18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ but on the different machines. jro receiver sweden should not delete an not received optional file from jro test sender torando.

15:13:38.096 all.js:140128 MoneyNetworkW2Service.initialize get_offline callback 4: query1 =
select files_optional.filename from json, files_optional where directory like '1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ' and file_name = 'content.json' and files_optional.json_id = json.json_id

15:13:38.110 MoneyNetworkAPI.js:1439 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: encrypt2: issue 1140. https://github.com/HelloZeroNet/ZeroNet/issues/1140. step 2 FileDelete returned No such file or directory
15:13:38.110 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1508937217018 fileGet started (33). 2 pending ZeroNet API operations (32,33)
15:13:38.116 all.js:140139 MoneyNetworkW2Service.initialize dbQuery callback 5:
res = [{"filename":"104c1220b2.1478907651800"},{"filename":"104c1220b2.1476395486303"},{"filename":"104c1220b2.1477876434882"},{"filename":"562bde76d3.0000000000000"},{"filename":"562bde76d3.1508922413611"}]

15:13:38.117 all.js:140144 MoneyNetworkW2Service.initialize dbQuery callback 5:
files = ["104c1220b2.1478907651800","104c1220b2.1476395486303","104c1220b2.1477876434882","562bde76d3.0000000000000","562bde76d3.1508922413611"]

15:13:38.117 all.js:140171 MoneyNetworkW2Service.initialize dbQuery callback 5:
delete_files = ["104c1220b2.1478907651800","104c1220b2.1476395486303","104c1220b2.1477876434882","562bde76d3.0000000000000","562bde76d3.1508922413611"]

jaros1 commented 7 years ago

Full send money test 2. Sender is jro test in Torando. Receiver is jro in Sweden. As in test 1. Sender must disable vpn while communicating with external wallet (btc.com). Lost msg in test 1 must be publish problems. No lost msg in test 2 except first 2 publish failed. First receive failed with a JS error. Second receive failed with file not found.

w2-receiver-jro-sweden.log w2-sender-jro-test-torando.log

Added more file info get for ingoing and outgoing optional files.

jaros1 commented 7 years ago

Many errors in full send money test 3. New full send money test 4.

test4-mn-sender-sweden.log test4-w2-sender-sweden.log test4-w2-receiver-torando.log test4-mn-receiver-torando.log

jaros1 commented 7 years ago

Cannot use peer=0 as an indication for no peers and cancel fileGet operation. Almost always 0 peer in money transaction files from an other client. Tried with fileGet with required + timeout 60 with success. Use required and timeout for optional files gets.

Reading first pubkeys message in wallet to wallet communication:

18:44:36.998 MoneyNetworkAPI.js:309 MoneyNetworkAPILib.add_session: monitoring other_session_filename 8f6e501df1, sessionid = YCSYYYsOwlUwgXJYqwzpoAV163Ny1DO9EOxwLxxg85QBTiJX4gBOb4l5JMqM
18:44:36.999 MoneyNetworkAPI.js:327 MoneyNetworkAPILib.add_session: other_session_filename 8f6e501df1 should be processed by encrypt4

18:44:38.546 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions: 
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.0000000000000 optionalFileInfo started (97). 1 pending ZeroNet API operation (97)
18:44:38.552 MoneyNetworkAPI.js:223 MoneyNetworkAPILib.load_offline_transactions: 
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.0000000000000 optionalFileInfo finished. res = "OK". elapsed time 6 ms (97). No pending ZeroNet API operations
18:44:38.553 MoneyNetworkAPI.js:645 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: 
file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.0000000000000","uploaded":0,"is_pinned":1,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20043,"peer":0,"time_added":1509036224,"hash_id":3746,"time_downloaded":0,"size":18}
18:44:38.553 MoneyNetworkAPI.js:649 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: 
abort optional file merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.0000000000000 download. No peers. file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.0000000000000","uploaded":0,"is_pinned":1,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20043,"peer":0,"time_added":1509036224,"hash_id":3746,"time_downloaded":0,"size":18}
18:44:38.554 MoneyNetworkAPI.js:667 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: now = 1509036278554, time_added = 1509036224, elapsed = 54
18:44:38.555 MoneyNetworkAPI.js:628 MoneyNetworkAPILib.load_offline_transactions: filename merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.0000000000000 was not found
18:44:38.556 MoneyNetworkAPI.js:591 MoneyNetworkAPILib.demon dbQuery callback: calling cb with merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.1509036209077 and encrypt4
18:44:38.557 all.js:138666 MoneyNetworkW2Service.process_incoming_message: processing inner_path = merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.1509036209077 with encrypt4
18:44:38.557 MoneyNetworkAPI.js:1469 MoneyNetworkAPI.setup_encryption: encrypt4: Encryption setup: waiting for other_session_pubkey, other_session_pubkey2
18:44:38.558 all.js:138677 MoneyNetworkW2Service.process_incoming_message: file_timestamp = 1509036209077
18:44:38.558 all.js:138209 MoneyNetworkW2Service.z_file_get.get_optional_file_info: filename = "8f6e501df1.1509036209077", optional_file = true
18:44:38.561 all.js:138212 MoneyNetworkW2Service.z_file_get.get_optional_file_info: 
file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.1509036209077","uploaded":0,"is_pinned":1,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20044,"peer":0,"time_added":1509036224,"hash_id":56248,"time_downloaded":0,"size":548}
18:44:38.561 MoneyNetworkAPI.js:209 MoneyNetworkW2Service.z_file_get get_optional_file_info callback: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.1509036209077 fileGet started (98). 1 pending ZeroNet API operation (98)
18:44:43.875 all.js?rev=3098&lang=en:593 hideProgress
18:44:43.879 MoneyNetworkAPI.js:223 MoneyNetworkW2Service.z_file_get get_optional_file_info callback: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/8f6e501df1.1509036209077 fileGet finished. res = "OK". elapsed time 5318 ms (98). No pending ZeroNet API operations
18:44:43.881 all.js:138710 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: request = {"msgtype":"pubkeys","pubkey":"-----BEGIN PUBLIC KEY-----\nMIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDLsiqdnpx7LBkTG1mFGhf4kMnM\nS0LIBJd/JWtm4lOWAyF6Q07rlKWD0grptj3JtGOV8cGxhRb1nGxdg1/KC+DfeDpX\nzhv2j5+4MMHeho2ghbwz62UFPcaFNB3q+fAJJ/pN9IKdXmQBm8Q5+27BVNRAgWkZ\nybyPCEdT5J90zQv4nwIDAQAB\n-----END PUBLIC KEY-----","pubkey2":"Ay7+2sz4I7o/X+NPfQhtRC7PiTl2tu53Cgr9M14QKuB6"}
18:44:43.881 all.js:139590 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: response = {"msgtype":"response","error":"Unknown msgtype pubkeys"}

jaros1 commented 7 years ago

Changed fileGet processing for optional files without any peers. Now trying anyway + added a timeout processing. Full send money test 6. Read both speciel file with offline transactions + first pubkeys message:

torando: reading file with offline transactions from sweden. todo: warning with unencrypted file

12:46:47.878 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000 optionalFileInfo started (138). 2 pending ZeroNet API operations (90,138)
12:46:47.880 MoneyNetworkAPI.js:223 MoneyNetworkAPILib.load_offline_transactions: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000 optionalFileInfo finished. res = "OK". elapsed time 2 ms (138). 1 pending ZeroNet API operation (90)
12:46:47.881 MoneyNetworkAPI.js:649 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000","uploaded":0,"is_pinned":1,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20066,"peer":0,"time_added":1509101207,"hash_id":62454,"time_downloaded":0,"size":18}
12:46:47.881 MoneyNetworkAPI.js:655 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: warning. starting fileGet operation for optional file without any peers. file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000","uploaded":0,"is_pinned":1,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20066,"peer":0,"time_added":1509101207,"hash_id":62454,"time_downloaded":0,"size":18}
12:46:47.881 MoneyNetworkAPI.js:666 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: Warning: added timeout=60 to fileGet operation. old options = {"inner_path":"merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000","required":true}, new_options = {"inner_path":"merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000","required":true,"timeout":60}
12:46:47.881 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000 fileGet started (139). 2 pending ZeroNet API operations (90,139)
12:46:48.184 all.js?rev=3125&lang=en:593 hideProgress
12:46:48.224 MoneyNetworkAPI.js:223 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.0000000000000 fileGet finished. res = "OK". elapsed time 343 ms (139). 1 pending ZeroNet API operation (90)
12:46:48.224 MoneyNetworkAPI.js:1467 MoneyNetworkAPI.decrypt_json: encrypt4: Warning. received unencrypted json message [1509101154098]

torando: reading first contact pubkeys message from sweden. should be encrypted with money_transactionid

12:46:48.225 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions decrypt_json callback 3: select json.directory, files_optional.filename from files_optional, json where files_optional.filename like 'a576849b72.%'and json.json_id = files_optional.json_id order by substr(files_optional.filename, 12) dbQuery started (140). 2 pending ZeroNet API operations (90,140)
12:46:48.227 MoneyNetworkAPI.js:223 MoneyNetworkAPILib.load_offline_transactions decrypt_json callback 3: select json.directory, files_optional.filename from files_optional, json where files_optional.filename like 'a576849b72.%'and json.json_id = files_optional.json_id order by substr(files_optional.filename, 12) dbQuery finished. res = "Ok". elapsed time 2 ms (140). 1 pending ZeroNet API operation (90)
12:46:48.376 MoneyNetworkAPI.js:592 MoneyNetworkAPILib.demon dbQuery callback: calling cb with merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.1509101154098 and encrypt4
12:46:48.377 all.js:138666 MoneyNetworkW2Service.process_incoming_message: processing inner_path = merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.1509101154098 with encrypt4
12:46:48.377 MoneyNetworkAPI.js:1467 MoneyNetworkAPI.setup_encryption: encrypt4: Encryption setup: waiting for other_session_pubkey, other_session_pubkey2
12:46:48.377 all.js:138677 MoneyNetworkW2Service.process_incoming_message: file_timestamp = 1509101154098
12:46:48.377 all.js:138209 MoneyNetworkW2Service.z_file_get.get_optional_file_info: filename = "a576849b72.1509101154098", optional_file = true
12:46:48.380 all.js:138212 MoneyNetworkW2Service.z_file_get.get_optional_file_info: file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.1509101154098","uploaded":0,"is_pinned":1,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20067,"peer":0,"time_added":1509101207,"hash_id":11965,"time_downloaded":0,"size":548}
12:46:48.381 MoneyNetworkAPI.js:209 MoneyNetworkW2Service.z_file_get get_optional_file_info callback: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.1509101154098 fileGet started (141). 2 pending ZeroNet API operations (90,141)
12:46:48.693 all.js?rev=3125&lang=en:593 hideProgress
12:46:48.732 MoneyNetworkAPI.js:223 MoneyNetworkW2Service.z_file_get get_optional_file_info callback: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/a576849b72.1509101154098 fileGet finished. res = "OK". elapsed time 351 ms (141). 1 pending ZeroNet API operation (90)
12:46:48.733 all.js:138710 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: request = {"msgtype":"pubkeys","pubkey":"-----BEGIN PUBLIC KEY-----\nMIGeMA0GCSqGSIb3DQEBAQUAA4GMADCBiAKBgGH/XIabNxc4s0I8WgnuApATlTtn\nT3JPF91fExnjFnqF/eHCam+z/qyNQsW4qZYU5QgOrU6Buq4exeoTCJttg8eTcZR0\nJzsZxjigD/T0eEo2A+mA6gW67InVjxOTFVuzpOOSVkTymGe+nwRkZ4Z777WTAolp\nWIGfhIN1ma6jHi7HAgMBAAE=\n-----END PUBLIC KEY-----","pubkey2":"AgXpTdv65TXbSw9WRz8VbP/KfC7Ot0qHWmWYaQZjq9o2"}
12:46:48.734 all.js:139590 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: response = {"msgtype":"response","error":"Unknown msgtype pubkeys"}
12:46:51.594 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1477593410204 fileGet started (142). 2 pending ZeroNet API operations (90,142)
12:46:51.600 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1477593410204 fileGet finished. res = "Not found". elapsed time 6 ms (142). 1 pending ZeroNet API operation (90)
jaros1 commented 7 years ago

New fileGet implementation is not working:

10:04:09.856 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions:
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000 optionalFileInfo started (347). 2 pending ZeroNet API operations (90,347)
10:04:09.859 MoneyNetworkAPI.js:223 MoneyNetworkAPILib.load_offline_transactions:
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000 optionalFileInfo finished. res = "OK". elapsed time 2 ms (347). 1 pending ZeroNet API operation (90)
10:04:09.859 MoneyNetworkAPI.js:649 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1:
file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000","uploaded":0,"is_pinned":0,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20119,"peer":0,"time_added":1509177781,"hash_id":34355,"time_downloaded":0,"size":18}
10:04:09.859 MoneyNetworkAPI.js:655 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1:
warning. starting fileGet operation for optional file without any peers. file_info = {"inner_path":"data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000","uploaded":0,"is_pinned":0,"time_accessed":0,"site_id":38,"is_downloaded":0,"file_id":20119,"peer":0,"time_added":1509177781,"hash_id":34355,"time_downloaded":0,"size":18}
10:04:09.859 MoneyNetworkAPI.js:666 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1:
Warning: added timeout=60 to fileGet operation. old options = {"inner_path":"merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000","required":true}, new_options = {"inner_path":"merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000","required":true,"timeout":60}
10:04:09.859 MoneyNetworkAPI.js:209 MoneyNetworkAPILib.load_offline_transactions fileGet callback 1:
merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/93d291ffd3.0000000000000 fileGet started (348). 2 pending ZeroNet API operations (90,348)

expected fileGet timeout about 10:05:10. Not found

10:04:14.855 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476789800596 fileGet started (349). 3 pending ZeroNet API operations (90,348,349)
10:04:14.861 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476789800596 fileGet finished. res = "OK". elapsed time 6 ms (349). 2 pending ZeroNet API operations (90,348)
10:04:14.862 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476789800596 fileDelete started (350). 3 pending ZeroNet API operations (90,348,350)
10:04:14.869 MoneyNetworkAPI.js:1467 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: encrypt2: issue 1140. https://github.com/HelloZeroNet/ZeroNet/issues/1140. step 2 FileDelete returned No such file or directory
10:04:14.869 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476789800596 fileGet started (351). 4 pending ZeroNet API operations (90,348,350,351)
10:04:14.871 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476789800596 fileGet finished. res = "Not found". elapsed time 2 ms (351). 3 pending ZeroNet API operations (90,348,350)
10:04:14.871 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476789800596 fileDelete finished. res = "OK". elapsed time 9 ms (350). 2 pending ZeroNet API operations (90,348)
10:04:17.855 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1479692026638 fileGet started (352). 3 pending ZeroNet API operations (90,348,352)
10:04:17.859 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1479692026638 fileGet finished. res = "OK". elapsed time 4 ms (352). 2 pending ZeroNet API operations (90,348)
10:04:17.860 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1479692026638 fileDelete started (353). 3 pending ZeroNet API operations (90,348,353)
10:04:17.867 MoneyNetworkAPI.js:1467 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: encrypt2: issue 1140. https://github.com/HelloZeroNet/ZeroNet/issues/1140. step 2 FileDelete returned No such file or directory
10:04:17.867 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1479692026638 fileGet started (354). 4 pending ZeroNet API operations (90,348,353,354)
10:04:17.870 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1479692026638 fileGet finished. res = "Not found". elapsed time 3 ms (354). 3 pending ZeroNet API operations (90,348,353)
10:04:17.870 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1479692026638 fileDelete finished. res = "OK". elapsed time 10 ms (353). 2 pending ZeroNet API operations (90,348)
10:05:04.154 all.js?rev=3125&lang=en:593 hideProgress
10:05:05.371 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476391620041 fileGet started (355). 3 pending ZeroNet API operations (90,348,355)
10:05:05.374 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request callback 0: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476391620041 fileGet finished. res = "OK". elapsed time 3 ms (355). 2 pending ZeroNet API operations (90,348)
10:05:05.374 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476391620041 fileDelete started (356). 3 pending ZeroNet API operations (90,348,356)
10:05:05.382 MoneyNetworkAPI.js:1467 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: encrypt2: issue 1140. https://github.com/HelloZeroNet/ZeroNet/issues/1140. step 2 FileDelete returned No such file or directory
10:05:05.382 MoneyNetworkAPI.js:209 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476391620041 fileGet started (357). 4 pending ZeroNet API operations (90,348,356,357)
10:05:05.384 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request fileDelete callback 2: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476391620041 fileGet finished. res = "Not found". elapsed time 2 ms (357). 3 pending ZeroNet API operations (90,348,356)
10:05:05.384 MoneyNetworkAPI.js:223 MoneyNetworkAPI.send_message.delete_request fileGet callback 1: merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/aaca9a8ff7.1476391620041 fileDelete finished. res = "OK". elapsed time 10 ms (356). 2 pending ZeroNet API operations (90,348)

10:05:15.585 all.js?rev=3125&lang=en:593 hideProgress
jaros1 commented 7 years ago

Test8 failed. optional files from sweden (vpn off=>on) not received by torando (vpn off). Expected optional files not in content.db. Maybe the problem is using identical content.json in both ZeroNet instances (sweden & torando). Inner_path is identical. List with optional files are not identical. Retest with two different certificates ...

test8-mn-sender-sweden.log test8-w2-sender-sweden.log

test8-w2-receiver-torando.log test8-mn-receiver-torando.log

content-sweden.txt content-torando.txt

jaros1 commented 7 years ago

Test 10

test10-w2-receiver-torando.log test10-mn-receiver-torando.log test10-w2-sender-sweden.log test10-mn-sender-sweden.log

jaros1 commented 7 years ago

Test 11

test11-w2-receiver-torando.log test11-mn-receiver-torando.log

test11-w2-sender-sweden.log test11-mn-sender-sweden.log

No optional files was received. There is 1 ms difference between content.json file at sender sweden and content.json file at receiver torando.

content-torando.txt content-sweden.txt

adding a normal file status.json to w2. Maybe change in status.json file will force zeronet to distribute the changed content.json file (new optional files)

jaros1 commented 7 years ago

Looks like adding a status.json to w2 helped for content.json distribution. Still file not found error for optional file with offine transactions. Try a few more tests to see content.json distribution problem has been solved. Fallback solution. Ask MN to request the missing file in a hidden private chat message.

jaros1 commented 7 years ago

Test17. added z_file_get to MoneyNetworkAPI. MN has been migrated. W2 must be migrated. Error: content.json was not replicated from sweden to torando.

test17-w2-sender-sweden.log test17-mn-sender-sweden.log test17-w2-receiver-torando.log test17-mn-receiver-torando.log

content.json was receiver after 4 hours. sweden comp. resumed after suspend. Torando comp was not running. test failed.

jaros1 commented 7 years ago

Test 18. Sender created money transaction without VPN and set VPN=sweden. Receiver VPN=torando from start. Test OK, pubkeys message was read, but some other issues.

test18-w2-sender-sweden.log test18-mn-sender-sweden.log test18-w2-receiver-todando.log test18-mn-receiver-torando.log

1) sender/sweden: Logged in in MN as x and reloaded W2. OK MoneyNetworkAPI session. Logged out and in in MN as y. Ping errors. New W2/MN handshake with test OK. Sending money transaction without any problems. 2) receiver/torando: status.json receive error in MN. MN should only read status.json from MN user data hubs. Not read status.json from wallet data hubs.

torando: error. MN is reading status.json for a wallet data hub. Should only read status.json from MN user data hubs.

17:32:38.677 all.js:1789 MoneyNetworkService.event_file_done: hub = 1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ, filename = data/users/1CCiJ97XHgVeJrkbnzLgfXvYRr8QEWxnWF/status.json
17:32:38.678 all.js:1789 MoneyNetworkService.event_file_done: filename = data/users/1CCiJ97XHgVeJrkbnzLgfXvYRr8QEWxnWF/status.json
17:32:38.683 all.js:1789 MoneyNetworkService.event_file_done z_file_get callback 1: checking for deleted chat files
17:32:38.683 all.js:1789 MoneyNetworkService.event_file_done z_file_get callback 1: res.files_optional = {"1e6ac65976.1475975808814":{"sha512":"1401f4ae10ee0c16ab591f3605dd887cc6db9220bbbdb7bedc36964551e4d933","size":1316},"1e6ac65976.1477438393862":{"sha512":"693bf484424f903bfa1c2410a5ddc277be2f7e61601b80e97cec24c725c18032","size":1508},"1e6ac65976.1478453682633":{"sha512":"67c73adad851d7a50636b0251b36a3e7b8a5af6d6a0389e5513e657f7bf40016","size":1316},"1e6ac65976.1479929226228":{"sha512":"f093012e5c660fdaa75536c4dd79832eb3711b11dd0e43618f7d72375299e370","size":1508},"1e6ac65976.1480125625769":{"sha512":"0a5251c62985a25643b0fe9f0ac5529b2dfe11a56ec9bd3d0dc14b9b80a6b1de","size":1508},"77b3ed762e.0000000000000":{"sha512":"771c5e72f4587a027be9d0409c493b96f8c1da83843db156e1d4c70581a2f66b","size":80},"77b3ed762e.1509294757636":{"sha512":"9e4cd0b0442a4de5fa8250e6cd5649017e9d349c31dadfd1c1df5b91cf7a341f","size":548}}, within_page_context = false
17:32:38.759 all.js:15036 Uncaught TypeError: Cannot read property 'length' of undefined
    at all.js:15036
    at Object.cb2 (MoneyNetworkAPI.js:1560)
    at ZeroFrame.onMessage (30-ZeroFrame.js:42)
    at 30-ZeroFrame.js:7
(anonymous) @ all.js:15036
cb2 @ MoneyNetworkAPI.js:1560
ZeroFrame.onMessage @ 30-ZeroFrame.js:42
(anonymous) @ 30-ZeroFrame.js:7
postMessage (async)
Wrapper.sendInner @ all.js?rev=3125&lang=en:1382
Wrapper.onMessageWebsocket @ all.js?rev=3125&lang=en:883
(anonymous) @ all.js?rev=3125&lang=en:816
torando: todo: unknown msgtype pubkeys

17:33:58.261 all.js:138730 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2:
request = {"msgtype":"pubkeys","pubkey":"-----BEGIN PUBLIC KEY-----\nMIGeMA0GCSqGSIb3DQEBAQUAA4GMADCBiAKBgGrxGiqRwAR4AYWUTCx+fTGtELbM\n6Wcau6MHphq0crXVb1pjOBd+dJRuRHOURbTRqmimflDUPIB51YTOuiKGH3kEYMIL\nOMunRC1ZEwHATFsVTM30qodEuJUIUgDtkBn7u1Oxo2d82RaRWNmIIdMPnU6xZEMc\nYjqgpB8/YOTTUszVAgMBAAE=\n-----END PUBLIC KEY-----","pubkey2":"AsGjdFhq82P8wGGjlz7n+Xkjsh7Av0hc4jmIXE90d46U"}
17:33:58.261 all.js:139607 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: response = {"msgtype":"response","error":"Unknown msgtype pubkeys"}
jaros1 commented 7 years ago

Test 19. Test OK, received first pubkeys message with extra debug info

jaros1 commented 7 years ago

Looks like VPN must be active in both sender/sweden and receiver/torando to receive wallet pubkeys message.

Timeout for file with offline timestamp => reading pubkeys message anyway. a) should not process any offline messages before file with offline timestamps has been read. b) if no offline timestamp. do not read files with timestamp < session start.

jaros1 commented 7 years ago

w2 session: receive pubkeys message: pubkeys message ok. ready to crosscheck money transaction(s) with other wallet session

jaros1 commented 7 years ago

Test 24. ready to compare money transactions:

test24-w2-receiver-torando.log test24-w2-sender-sweden.log

// sender=sweden, receiver=torando
// sweden would like to send money to torando and is asking torando for approval and a bitcoin address
// torando has received money transaction and added a address.
// sweden has not yet received address from torando.
// otherwise the transaction is identical in sweden and torando wallets

sweden = [{
    "action": "Send",
    "code": "tBTC",
    "amount": 0.0001,
    "json": {"return_address": "2NG8wLQf5uYiGn8RX4NYPz6HRssenNvVdSj"}
}];
torando = [{
    "action": "Send",
    "code": "tBTC",
    "amount": 0.0001,
    "json": {
        "return_address": "2NG8wLQf5uYiGn8RX4NYPz6HRssenNvVdSj",
        "address": "2MznAqaYAd4ZKXbrLcyRwfUm1HezaPBUXsU"
    }
}];
jaros1 commented 7 years ago

Test 29. added extra json schema for addresses message. Expected addresses msg to be validated OK. But looks like publish failed in sender w2. Only one failed publish. Publish should retry until success.

test29-w2-sender-sweden.log test29-w2-receiver-torando.log

jaros1 commented 7 years ago

Test 34. New addresses message was sent from torando to sweden. Processing failed. Unknown message addresses :-)

test34-w2-sender-sweden.log test34-w2-receiver-torando.log

Transaction receiver torando is sending addresses message to transaction sender sweden:

18:08:28.926 all.js:139822 MoneyNetworkW2Service.process_incoming_message.pubkeys: 
pubkeys message ok. ready to crosscheck money transaction(s) with other wallet session before sending money transactions to external API (btc.com)
18:08:28.926 all.js:139823 MoneyNetworkW2Service.process_incoming_message.pubkeys: 
session_info.money_transactions = [{"action":"Send","code":"tBTC","amount":0.0001,"json":{"return_address":"2N7CKRXvJ159WJfAg7fQQPoJZEDyeuV9LZ4","address":"2NE3FrBQyNb1pHDXhZwQzSQJUc16FqoybkV"}}]
18:08:28.927 all.js:139824 MoneyNetworkW2Service.process_incoming_message.pubkeys: identify receiver. sender is master, receiver is client. master = false, client = true
18:08:28.927 all.js:139876 MoneyNetworkW2Service.process_incoming_message.pubkeys: request2 = {"msgtype":"addresses","jsons":[{"address":"2NE3FrBQyNb1pHDXhZwQzSQJUc16FqoybkV"}]}
18:08:28.928 MoneyNetworkAPI.js:1864 MoneyNetworkAPI.send_message: encrypt4: request = {"msgtype":"addresses","jsons":[{"address":"2NE3FrBQyNb1pHDXhZwQzSQJUc16FqoybkV"}]}

Transaction sender sweden received unknown addresses message from torando:

18:08:32.388 all.js:138771 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: 
request = {"msgtype":"addresses","jsons":[{"address":"2NE3FrBQyNb1pHDXhZwQzSQJUc16FqoybkV"}]}
18:08:32.389 all.js:139912 MoneyNetworkW2Service.process_incoming_message decrypt_json callback 2: 
response = {"msgtype":"response","error":"Unknown msgtype addresses"}
jaros1 commented 7 years ago

addresses message should be renamed. added subsystem to json schema defintions in MoneyNetworkAPI. Calling systems (MN, W2 etc) should inject extra json schema definitions with a subsystem name (default wallet) and supply subsystem in validate_json and send_message calls.

jaros1 commented 7 years ago

Test 35 - testing changes in MoneyNetworkAPI schema definitions. and addresses msg renamed to w2_check_mt. Expects invalid msgtype.

test35-w2-receiver-torando.log test35-w2-sender-sweden.log

jaros1 commented 7 years ago

Test 36. still testing changes in MoneyNetworkAPI json schema definitions and new w2_check_mt msg

test36-w2-receiver-torando.log test36-w2-sender-sweden.log

jaros1 commented 7 years ago

Test 37

test37-w2-sender-sweden.log test37-w2-receiver-torando.log

error. w2_check_mt message was not distributed from torando to sweden. looks like content.json was not distributed from torando to sweden. content-sweden.txt content-torando.txt

jaros1 commented 7 years ago

Test 39

test39-w2-sender-sweden.log test39-w2-receiver-torando.log

jaros1 commented 7 years ago

Test 40 test40-w2-sender-sweden.log test40-w2-receiver-torando.log

jaros1 commented 7 years ago

Test 45 Retesting money transactions after many changes in MoneyNetworkAPI. Expects many problems in js code ...

test45-w2-sender-sweden.log test45-w2-receiver-torando.log

jaros1 commented 7 years ago

Test 47. retesting MoneyNetworkAPI changes. test failed. sweden did not receive w2_check_mt message 7fd09cfaf8-o.1509785537477 from torando.

test47-w2-sender-sweden.log test47-w2-receiver-torando.log

content-json-torando.txt content-json-sweden.txt

Checking content.json files on the two clients. torando content.json is 1 ms newer than sweden content.json. Missing file 7fd09cfaf8-o.1509785537477 is in newest torando content.json. screenshot from 2017-11-04 10-23-30

Checking UI server log for any explanation ...

jaros1 commented 7 years ago

UI server log sweden:

torando has just published 09:52:17 new data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json with new optional file 7fd09cfaf8-o.1509785537477

[09:52:16] WorkerManager:1PgyTn..z2zh New task: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, peer lock: None, priority: 2, optional_hash_id: None, tasks started: 1
[09:52:17] Site:1HXzvt..w7NJ Update for data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json looks valid, saving...
[09:52:17] Site:1HXzvt..w7NJ Patched successfully: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/status.json (diff: 0.000s, verify: 0.000s, write: 0.001s, on_done: 0.001s)
[09:52:17] Site:1HXzvt..w7NJ Publishing data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json to 3/15 peers (connected: 4) diffs: ['status.json'] (0.09k)...
[09:52:17] Site:1HXzvt..w7NJ Peer:173.239.230.28 already received this update for data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, skipping
[09:52:21] Site:1PgyTn..z2zh Bad files: {'data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json': 2}
[09:52:21] Site:1PgyTn..z2zh Retry 1 bad files
[09:52:28] Site:1HXzvt..w7NJ Successfuly data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json published to 2 peers, publishing to 3 more peers in the background
[09:52:40] WorkerManager:1PgyTn..z2zh 37.203.209.19:39492: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 0, workers: 5
[09:52:40] WorkerManager:1PgyTn..z2zh Slow task: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, (workers: 6, optional_hash_id: None, peers: 0, failed: 1, asked: 0)
[09:52:47] Site:1HXzvt..w7NJ data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json: verify sign error: VerifyError: Valid signs: 0/1 in ContentManager.py line 861
[09:52:47] FileServer Update for data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json is invalid: Valid signs: 0/1
[09:52:47] RateLimit Added to queue (14.69s left): 16 update 1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json 
[09:52:56] WorkerManager:1PgyTn..z2zh Slow task: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, (workers: 5, optional_hash_id: None, peers: 0, failed: 1, asked: 0)
[09:52:56] Site:1HXzvt..w7NJ Announced types ['ip4'] in mode more to 1 trackers in 0.349s, errors: [], slow: []
[09:53:02] RateLimit Calling: 16 update 1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json
[09:53:02] Site:1HXzvt..w7NJ data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json: verify sign error: VerifyError: Valid signs: 0/1 in ContentManager.py line 861
[09:53:02] FileServer Update for data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json is invalid: Valid signs: 0/1
[09:53:10] WorkerManager:1HXzvt..w7NJ 77.241.139.79:37344: Verify failed: data/users/1Mg62SVtQAiRSAfRBvWGKyPqioXZSfwDDW/wallet.json, error: Download failed, failed peers: 9, workers: 1
[09:53:10] WorkerManager:1PgyTn..z2zh 212.27.18.166:28073: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 1, workers: 4
[09:53:10] WorkerManager:1PgyTn..z2zh 183.27.96.134:15441: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 2, workers: 3
[09:53:10] WorkerManager:1PgyTn..z2zh 183.27.96.243:15441: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 3, workers: 2
[09:53:10] WorkerManager:1PgyTn..z2zh gbr6xj5fdxczy6jr.onion:39492: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 4, workers: 1
[09:53:10] WorkerManager:1PgyTn..z2zh t27vym4lfo3xjuvc.onion:39492: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 5, workers: 0
[09:53:10] WorkerManager:1HXzvt..w7NJ ljvtyp4ipykefote.onion:39492: Verify failed: data/users/1Mg62SVtQAiRSAfRBvWGKyPqioXZSfwDDW/wallet.json, error: Download failed, failed peers: 10, workers: 0
[09:53:11] WorkerManager:1PgyTn..z2zh Slow task: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, (workers: 5, optional_hash_id: None, peers: 0, failed: 6, asked: 0)
[09:53:12] Site:1PgyTn..z2zh data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json: verify sign error: VerifyError: Valid signs: 0/1 in ContentManager.py line 861
[09:53:12] WorkerManager:1PgyTn..z2zh 173.239.230.28:45260: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Valid signs: 0/1, failed peers: 6, workers: 0
[09:53:12] WorkerManager:1PgyTn..z2zh 127.0.0.1:60838: Verify failed: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, error: Download failed, failed peers: 7, workers: 4
[09:53:12] WorkerManager:1PgyTn..z2zh 104.199.246.69:15441: Verify correct: data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json
[09:53:12] Site:1PgyTn..z2zh data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json loadContent same json file, skipping
[09:53:12] Site:1PgyTn..z2zh data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json loadContent same json file, skipping

New content.json file was not distributed from torando to sweden. 1 ms dif in modified timestamps. I have seen this issue with 1 ms dif in modified timestamps in content.json several times before with same issue. Newest content.json file is not distributed.

Sweden content.json (oldest):

{
 "address": "1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ",
 "cert_auth_type": "web",
 "cert_sign": "G9KWZvNAg3yVm3F3ICPQCOjnA+lZQOFLvYWBJp7BaRAMDrdIAqyv/x8PYNwlWQ4KvznJPOmjknSxxPkHfnD84tE=",
 "cert_user_id": "jro@zeroid.bit",
 "files": {
  "status.json": {
   "sha512": "a84a76dfca3849cf7b930852c724cd0f5ab58bb173e64b4f666abc2bfc889b33",
   "size": 31
  },
  "wallet.json": {
   "sha512": "5033a27b0aba76b024e04f037eff88a121781dd33d292fc229734f0b9dff6c64",
   "size": 869
  }
 },
 "files_optional": {
  "7fd09cfaf8-o.1509785536712": {
   "sha512": "9a53ceadb1336c504692dbd223ba1d2c089d2018122a00e5146a6110a87a8974",
   "size": 548
  },
  "c6f8666c5b-i.1477976389761": {
   "sha512": "5ce44bfd2791b58cea417692c10cedc22698cfbe6615e29bf8ca04735fe7e300",
   "size": 1316
  },
  "c6f8666c5b-i.1479193655354": {
   "sha512": "7a5b61ce3aa612fbe6fcdaca85d6e0f4524144c60e3857324560890f426e9142",
   "size": 1316
  },
  "c6f8666c5b-i.1480073346388": {
   "sha512": "08993fa11262ab18c88badb97605f6d70386bf67ac70ec13f1051f66b658d3e9",
   "size": 1316
  }
 },
 "inner_path": "data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json",
 "modified": 1509785536,
 "optional": "^.*-.*$",
 "signs": {
  "18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ": "G7etvqxwJRx+jy7v2QG+GgZ0KklUIGfJM7S4nBPcs1BLCQ0Emm/ANc99bQADsr2fmRy+q4RCuY31LtXIh7X7Kuw="
 }
}

Torando content.json (newest):

{
 "address": "1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ",
 "cert_auth_type": "web",
 "cert_sign": "G9KWZvNAg3yVm3F3ICPQCOjnA+lZQOFLvYWBJp7BaRAMDrdIAqyv/x8PYNwlWQ4KvznJPOmjknSxxPkHfnD84tE=",
 "cert_user_id": "jro@zeroid.bit",
 "files": {
  "status.json": {
   "sha512": "ea18a2cce60357f5a647eef13bd0701a418f63795083226dbabd7f62e32a8e48",
   "size": 31
  },
  "wallet.json": {
   "sha512": "5033a27b0aba76b024e04f037eff88a121781dd33d292fc229734f0b9dff6c64",
   "size": 869
  }
 },
 "files_optional": {
  "7fd09cfaf8-o.1509785536712": {
   "sha512": "9a53ceadb1336c504692dbd223ba1d2c089d2018122a00e5146a6110a87a8974",
   "size": 548
  },
  "7fd09cfaf8-o.1509785537477": {
   "sha512": "765f493bc022b38138817e508ca5301d31d603273604748c07d1a2547b0a3e22",
   "size": 1424
  }
 },
 "inner_path": "data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json",
 "modified": 1509785537,
 "optional": "^.*-.*$",
 "signs": {
  "18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ": "HCEb8ZkEG29y8BHxK4sjascvZuk/Z20tl4pz++r5j8bJTqog0O2KRqCnJtG65eZ+UkR8MCY/aE6PSlSbz1wwVAk="
 }
}
jaros1 commented 7 years ago

Test48:

test48-w2-sender-sweden.log test48-w2-receiver-torando.log

2 seconds dif between the two content.json files. torando newest.

test48-content-json-sweden.txt test48-content-json-torando.txt

jaros1 commented 7 years ago

Test 49:

test49-w2-receiver-torando.log test49-w2-sender-sweden.log

test49-content-json-torando.txt test49-content-json-sweden.txt

1) torando could not read pubkeys message from sweden. timeout after 60 seconds. must retry fileGet operation for -e external and -o offline optional files. Maybe only a temporary problem. And other clients maybe helping with distribution. Add retry code from load_offline_transactions to z_file_get.

2) Zeronet issue. ratelimit min 15 seconds between changes in zeroNet files. Should be ensured by queue but maybe not working when using two different running zeronet sites that sign and publish in parallel. Check last content modified timestamp before new publish. Force min 20 seconds between publish in wallet sites and 25 seconds between publish in MoneyNetwork site.

jaros1 commented 7 years ago

Test 50: test50-mn-sender-sweden.log test50-w2-sender-sweden.log test50-mn-receiver-torando.log test50-w2-receiver-torando.log test50-content-json-torando.txt test50-content-json-sweden.txt

jaros1 commented 7 years ago

Added publish queue to MN. Testing if problem with not distributed content files (ratelimit 15 seconds https://github.com/HelloZeroNet/ZeroNet/issues/1173) has been solved.

jaros1 commented 7 years ago

Test84: testing publish queue. problem with not distributed content.json files should have been solved

test84-w2-sender-sweden.log test84-mn-sender-sweden.log test84-w2-receiver-torando.log test84-mn-receiver-torando.log

Test failed:

sweden: reading pubkeys message from torando. failed

16:30:00.273 MoneyNetworkAPI.js:639 MoneyNetworkAPILib.demon dbQuery callback: calling cb with merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/ddef064cf8-o.1510068582359 and encrypt3
16:30:00.275 all.js:138700 MoneyNetworkW2Service.process_incoming_message: processing inner_path = merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/ddef064cf8-o.1510068582359 with encrypt3
16:30:00.277 all.js:138705 MoneyNetworkW2Service.process_incoming_message: file_timestamp = 1510068582359
16:30:00.278 all.js:139955 MoneyNetworkW2Service.process_incoming_message: Cannot read property 'response' of null
16:30:00.279 all.js:139956 TypeError: Cannot read property 'response' of null
    at process_incoming_message (all.js:138709)
    at step_3_run_cb (MoneyNetworkAPI.js:640)
    at step_1_fileget (MoneyNetworkAPI.js:651)
    at Object. (MoneyNetworkAPI.js:673)
    at ZeroFrame.onMessage (all.js:27016)
    at all.js:26982

Looks like fileGet and decrypt in demon process is not working in sweden wallet. added some extra debug info and better error handling

jaros1 commented 7 years ago

Test85: send money is not working.

test85-w2-sender-sweden.log test85-mn-sender-sweden.log

jaros1 commented 7 years ago

Test87:

test87-w2-sender-sweden.log test87-mn-sender-sweden.log test87-w2-receiver-torando.log test87-mn-receiver-torando.log

Test failed:

sweden: failed to read pubkeys message from torando. fileGet and decrypt should have been done in message_demon process

18:47:12.621 MoneyNetworkAPI.js:643 MoneyNetworkAPILib.message_demon dbQuery callback: calling cb with merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/63ee6a6f1a-o.1510076828598 and encrypt3
18:47:12.622 all.js:138700 MoneyNetworkW2Service.process_incoming_message: 
processing inner_path = merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/63ee6a6f1a-o.1510076828598 with encrypt3
18:47:12.622 all.js:138705 MoneyNetworkW2Service.process_incoming_message: file_timestamp = 1510076828598
18:47:12.623 all.js:138708 MoneyNetworkW2Service.process_incoming_message: no request. fileGet or decrypt must have failed. extra = {}

Problem: was injecting process_incoming_message cb both on global and on MoneyNetworkAPI instance leven. cb_fileget and cb_decrypt was missing on MoneyNetworkAPI instance level. Removed and using only global cb and options

jaros1 commented 7 years ago

Test89.

test89-w2-sender-sweden.log test89-mn-sender-sweden.log test89-w2-receiver-torando.log test89-mn-receiver-torando.log

Test failed. invallid fileget/decrypt setup in torando w2 session. should use global fileget/decrypt setting. add warning i MoneyNetworkAPI?

torando: reading pubkeys message from sweden

19:18:42.901 MoneyNetworkAPI.js:618 MoneyNetworkAPILib.message_demon dbQuery callback: using MoneyNetworkAPI instance callback. fileget = undefined, decrypt = undefined
19:18:42.901 MoneyNetworkAPI.js:646 MoneyNetworkAPILib.message_demon dbQuery callback: calling cb with merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/1CCiJ97XHgVeJrkbnzLgfXvYRr8QEWxnWF/534fb82623-o.1510078649203 and encrypt4
19:18:42.901 all.js:138700 MoneyNetworkW2Service.process_incoming_message: processing inner_path = merged-MoneyNetwork/1HXzvtSLuvxZfh6LgdaqTk4FSVf7x8w7NJ/data/users/1CCiJ97XHgVeJrkbnzLgfXvYRr8QEWxnWF/534fb82623-o.1510078649203 with encrypt4
19:18:42.901 all.js:138705 MoneyNetworkW2Service.process_incoming_message: file_timestamp = 1510078649203
19:18:42.902 all.js:138708 MoneyNetworkW2Service.process_incoming_message: no request. fileGet or decrypt must have failed. extra = {}
jaros1 commented 7 years ago

Test90. OK. Publish queue is working. Sender sweden received w2_check_mt message from torando

test90-w2-sender-sweden.log test90-mn-sender-sweden.log test90-w2-receiver-torando.log test90-mn-receiver-torando.log

jaros1 commented 7 years ago

Test 91. implementing receive w2_check_mt in w2. Test failed. Still content.json distribution problems. Pubkeys message from sender torando to receiver sweden was not received.

test91-mn-receiver-sweden.log test91-mn-sender-torando.log

test91-w2-sender-torando.log test91-w2-receiver-sweden.log

test91-ui-server-receiver-sweden.log test91-ui-server-sender-torando.log

test91-1HX-18Db-content-json-sender-torando.log test91-1HX-1CC-content-json-sender-torando.log test91-1hx-18Db-content-json-receiver-sweden.txt test91-1HX-1CC-content-json-receiver-sweden.txt

Content.json file was not distributed from torando to sweden. dif in modified timestamp as 26 seconds: [11:18:51] Site:1HXzvt..w7NJ Peer:a3nby76u3rnfbiqk.onion already received this update for data/users/18DbeZgtVCcLghmtzvg4Uv8uRQAwR8wnDQ/content.json, skipping

Increasing publish queue interval from 16 to 30 seconds

jaros1 commented 7 years ago

Test94:

test94-w2-receiver-torando.log test94-mn-receiver-torando.log test94-w2-sender-sweden.log test94-mn-sender-sweden.log

Problem with publish from sender sweden. MN publish_demon is waiting forever for W2 publish to finish. W2 log after this problem. 1) W2 session must always send published message to MN 2) W2 session must retry failed publish (changed VPN from DK to Sweden while publishing) 3) Add check_publish message. MN is checking if wallet session still is publishing (cb_id). 4) publish_demon should abort waiting for published message after seconds

jaros1 commented 7 years ago

ad 1. I think the problem maybe a exception in queue_publish code. SON.stringify error Blocked a frame with origin "null" from accessing a cross-origin frame. Now try catch in all queue_publish code blocks to ensure that cb in queue_publish is alreays run. ad 2. There is publish retry code in W2 after 30, 60, 120 etc seconds. ad 3. Added check_publish message. Sending after 20, 40 and 60 seconds ad 4. Finish waiting for wallet publish after 60 seconds

jaros1 commented 7 years ago

Test 95. OK. Fixing a little error in process incoming w2_check_mt js code

jaros1 commented 7 years ago

Test 96. Test OK. Receive incoming w2_check_mt code OK. todo: send w2_start_mt message