scrtlabs / discovery-docker-network

Docker Network for the Discovery release of the Enigma Protocol
https://enigma.co
GNU Affero General Public License v3.0
21 stars 2 forks source link

Deploy/Compute task is published, but the worker does not pick it up #13

Closed lacabra closed 5 years ago

lacabra commented 5 years ago

Describe the bug I have observed this several times before and I find it strange, but now I observe some sort of pattern. It goes like this:

To Reproduce Steps to reproduce the behavior:

  1. Launch the discovery-integration-tests network: NODES=3 ./launch.bash
  2. Run the following tests:
    01_init.spec.js
    02_deploy_calculator.spec.js 
    02_deploy_erc20.spec.js 

Expected behavior The second deployment task should succeed like the first one.

Network output Add any other context about the problem here.

p2p_1        | [Tue May 07 2019 17:38:21 GMT+0000 (Coordinated Universal Time)] INFO [+] JsonRpc: getWorkerEncryptionKey
p2p_1        | [Tue May 07 2019 17:38:21 GMT+0000 (Coordinated Universal Time)] DEBUG [PROXY_DISPATCH] sending dispatched rpc request
p2p_1        | [rpc] subscribed to target topic = QmcrQZ6RJdpYuGvZqD5QEHAv6qX4BrQLJLQPQUrTrzdcgm7eea57fea1c5c4a5d793a80ffac229fc54c6d194ENnxtjB1hiF5
p2p_3        | [Tue May 07 2019 17:38:21 GMT+0000 (Coordinated Universal Time)] INFO [WORK_TOPIC_PUBLISH] NewTaskEncryptionKey
p2p_1        | [Tue May 07 2019 17:38:21 GMT+0000 (Coordinated Universal Time)] DEBUG published [7eea57fea1c5c4a5d793a80ffac229fc54c6d194]
core_3       | 17:38:21 [INFO] LOG DERIVE: Ok(NewTaskEncryptionKey { result: DHKey { dh_key: "7bd08f0d6ff9b49b92a971c9935a29ce2bf0c3e6c56952a397182330e278675294a40550f644e87741a76fed49fc4e344dfd18e9202f2d79537604494530a2ec", sig: "954951bd78d616eb6ccaa367303eac5f3843d5bc1a5c4580ab94e1496ba71bd83c0c26e319bcc6c919483a1dc9847b0ef6b1672e1c4ab8a4aa1f20e45484b50d1c" } })
p2p_3        | [Tue May 07 2019 17:38:21 GMT+0000 (Coordinated Universal Time)] DEBUG published workerEncryptionKey=[7bd08f0d6ff9b49b92a971c9935a29ce2bf0c3e6c56952a397182330e278675294a40550f644e87741a76fed49fc4e344dfd18e9202f2d79537604494530a2ec] encryption key
p2p_3        | [Tue May 07 2019 17:38:21 GMT+0000 (Coordinated Universal Time)] DEBUG published [QmcrQZ6RJdpYuGvZqD5QEHAv6qX4BrQLJLQPQUrTrzdcgm7eea57fea1c5c4a5d793a80ffac229fc54c6d194ENnxtjB1hiF5]
contract_1   | eth_blockNumber
principal_1  | [? ] Blocks @ previous: 53, current: 56, next: 63 [? ]
principal_1  | [? ] Epoch still active [? ]
contract_1   | eth_sign
contract_1   | eth_call
contract_1   | eth_sendTransaction
contract_1   | 
contract_1   |   Transaction: 0xcb405d75dca956659be01d9923f8c865e0ec006805a164e732e7a8d168171041
contract_1   |   Gas usage: 45676
contract_1   |   Block Number: 57
contract_1   |   Block Time: Tue May 07 2019 17:38:22 GMT+0000 (Coordinated Universal Time)
contract_1   | 
contract_1   | eth_getTransactionReceipt
contract_1   | eth_sendTransaction
contract_1   | 
contract_1   |   Transaction: 0x85c83d2bf95ca64b329d36502571c1add8b150638b9be89ea6790f068e3bdd49
contract_1   |   Gas usage: 181503
contract_1   |   Block Number: 58
contract_1   |   Block Time: Tue May 07 2019 17:38:22 GMT+0000 (Coordinated Universal Time)
contract_1   | 
contract_1   | eth_getTransactionReceipt
p2p_1        | [Tue May 07 2019 17:38:22 GMT+0000 (Coordinated Universal Time)] INFO [+] JsonRpc: DeploySecretContract
p2p_1        | [Tue May 07 2019 17:38:22 GMT+0000 (Coordinated Universal Time)] DEBUG [PROXY_DISPATCH] sending dispatched rpc request
p2p_1        | [Tue May 07 2019 17:38:22 GMT+0000 (Coordinated Universal Time)] DEBUG published [7eea57fea1c5c4a5d793a80ffac229fc54c6d194]
contract_1   | eth_blockNumber
principal_1  | [? ] Blocks @ previous: 53, current: 58, next: 63 [? ]
principal_1  | [? ] Epoch still active [? ]
contract_1   | eth_call
contract_1   | eth_blockNumber
principal_1  | [? ] Blocks @ previous: 53, current: 58, next: 63 [? ]
principal_1  | [? ] Epoch still active [? ]
lenak25 commented 5 years ago

Hi @lacabra ,

Could you please share the following details:

  1. The logs of a the first good deploy scenario.
  2. Is the json rpc request sent in both cases to the same worker? If not, to which worker each request sent?
  3. Who was the selected worker in the first deploy?
  4. Were there any epoch changes in the whole test case?

Thanks

lacabra commented 5 years ago

@lenak25:

  1. logs attached below.
  2. The client always connects to p2p_1, and will always initiate its requests to the network to this worker.
  3. I had to rerun the network to pull all the info you requested. In this last run, first contract is assigned to p2p_1 second contract is assigned to p2p_2
  4. No epoch changes

Network logs:

p2p_1        | [Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)] INFO [+] JsonRpc: getWorkerEncryptionKey
p2p_1        | [Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)] DEBUG [PROXY_DISPATCH] sending dispatched rpc request
p2p_1        | [rpc] subscribed to target topic = QmcrQZ6RJdpYuGvZqD5QEHAv6qX4BrQLJLQPQUrTrzdcgm66be25f50b0fa29e932565751d259aea8283d7d9Y0t6r0ZcTTFK
p2p_1        | [Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)] INFO [WORK_TOPIC_PUBLISH] NewTaskEncryptionKey
p2p_1        | [Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)] DEBUG published [66be25f50b0fa29e932565751d259aea8283d7d9]
core_1       | 18:57:04 [INFO] LOG DERIVE: Ok(NewTaskEncryptionKey { result: DHKey { dh_key: "f44abbaa2e09c48c2085a600b8fc132c4355f3db0430dcd58620c103ce8701e10eb2f2dbb2e5a0c28f2fbe83355ba61936ae4dd4ddfe179015cc28c8409d9dea", sig: "06de57ba722f53431087c053852aba6ad5e55b6f3d5fdd8fa9522c689bb9b7425ff2cb1f0ca22b2e9986e3cb4f405d47236205ff6fb7d3968a12c432b943b4ae1b" } })
p2p_1        | [Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)] DEBUG published workerEncryptionKey=[f44abbaa2e09c48c2085a600b8fc132c4355f3db0430dcd58620c103ce8701e10eb2f2dbb2e5a0c28f2fbe83355ba61936ae4dd4ddfe179015cc28c8409d9dea] encryption key
p2p_1        | [Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)] DEBUG published [QmcrQZ6RJdpYuGvZqD5QEHAv6qX4BrQLJLQPQUrTrzdcgm66be25f50b0fa29e932565751d259aea8283d7d9Y0t6r0ZcTTFK]
contract_1   | eth_sign
contract_1   | eth_call
contract_1   | eth_sendTransaction
contract_1   | 
contract_1   |   Transaction: 0xa750f2ba7f7c73c573af7441d5bd78cf58cc1156eee85a3183bdc2a6c72b7211
contract_1   |   Gas usage: 45676
contract_1   |   Block Number: 54
contract_1   |   Block Time: Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)
contract_1   | 
contract_1   | eth_getTransactionReceipt
contract_1   | eth_sendTransaction
contract_1   | 
contract_1   |   Transaction: 0xa6bf93c4eeba5701b1fee2611f02740f9a2e596706f8556937ad0e1d31c65597
contract_1   |   Gas usage: 196503
contract_1   |   Block Number: 55
contract_1   |   Block Time: Tue May 07 2019 18:57:04 GMT+0000 (Coordinated Universal Time)
contract_1   | 
contract_1   | eth_getTransactionReceipt
p2p_1        | [Tue May 07 2019 18:57:05 GMT+0000 (Coordinated Universal Time)] INFO [+] JsonRpc: DeploySecretContract
p2p_1        | [Tue May 07 2019 18:57:05 GMT+0000 (Coordinated Universal Time)] DEBUG [PROXY_DISPATCH] sending dispatched rpc request
p2p_1        | [Tue May 07 2019 18:57:05 GMT+0000 (Coordinated Universal Time)] INFO [WORK_TOPIC_PUBLISH] DeploySecretContract
p2p_1        | [Tue May 07 2019 18:57:05 GMT+0000 (Coordinated Universal Time)] DEBUG published [66be25f50b0fa29e932565751d259aea8283d7d9]
core_1       | 18:57:05 [INFO] LOG DERIVE: [102, 190, 37, 245, 11, 15, 162, 158, 147, 37, 101, 117, 29, 37, 154, 234, 130, 131, 215, 217]
core_1       | 18:57:05 [INFO] LOG DERIVE: "AgAAAMcKAAAHAAYAAAAAALAzX9O8HMqPgE65imQgWS0F57jM7mMWexZIwnbpFnD9AgX/BP//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABwAAAAAAAAAHAAAAAAAAAOz4RVDrshLLiL16Rh4Gsdlr/1zpm3RtK4XPkWvhEgPfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACD1xnnferKFHD2uvYqTXdDA8iZ22kCD5xw7h38CMfOngAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABmviX1Cw+inpMlZXUdJZrqgoPX2QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAqAIAALcZdDGFteQ5BnSDZJVgz05hA2ZRsrcyEmSpBtvItdyHIDtN2u6iAJUTERcGbgfHO6ZKgo5OnTprQcq7+lAln7bq3BC26X4SrXvf6uuxTeJp+AGbYvUhrGWN27FGNI/TeKN6DWl9hTL3qXCQ0ufZofjUlfhnTqPnL4d/Bq3q/W87R0KBsQpsFbzl5BXW684JBqEXL03ixH+Wa/BnKdpQAq2oYOAni1egafHBCKjnkqIsuPZkWuCNrfHoO56rFqcdwGJNxUh9RBfs2MKvB7LPWcnMUTEOK4QsFYR1UOAmXkSLmnT/SsHirnv9zRpLrOSq9reU0VXTIgSWKLeaOufrlSHNIZsFsH+Sc7h7FY4XDtoMYbgucwRN8GLBrR3RCAvfPsfutohuol7+nhpBp2gBAAA1Th7krBLxkbglM0sijTeNiMhYHQ2nDT4H0/UVlVha0QgxDIqcfctRKUv8UPJCk6EpOTZpHprN/Nd5bk4c7h473JE/E96NaNeX5lk6eMUR8AqdcEE+zPS173LCIhpyHmQ2igYIMe7B2okI9TIGF/Nx+PsTNh/C6oZKt3Kh8jcKUnZvz4JhbJbiBM9INm2P9OTq+oaZLPTPbRSkeVCk/igGg6mMXNyyxv/qY8ZrFJUPSVY1IfglI0okZrUY3zcpeHXUniATQixVIEvVBI6hlcptjLJgntYs73eXJkd7RIORECtglWHOWcgHahsw6PlKPxV9g3l8MfD+C47rVaIpPDxzJzKNZwVfm0wYMpomIZ5w3KgFtIanCGhC42gVlueQB2C1XabnGfRmXGgaETyewpoRlR9i1jCEc8q/QlHa5F3Q+DtRs78AKthv2JFHlreNSyEZsv0TiSwXMa+Sakq7cKYiAZtiN7OFTiem3qUG1HZXd7ImTF7OwmrE"
contract_1   | eth_blockNumber
principal_1  | [? ] Blocks @ previous: 53, current: 55, next: 63 [? ]
principal_1  | [? ] Epoch still active [? ]
core_1       | 18:57:05 [INFO] LOG DERIVE: ASResult { ca: "-----BEGIN CERTIFICATE-----\nMIIFSzCCA7OgAwIBAgIJANEHdl0yo7CUMA0GCSqGSIb3DQEBCwUAMH4xCzAJBgNV\nBAYTAlVTMQswCQYDVQQIDAJDQTEUMBIGA1UEBwwLU2FudGEgQ2xhcmExGjAYBgNV\nBAoMEUludGVsIENvcnBvcmF0aW9uMTAwLgYDVQQDDCdJbnRlbCBTR1ggQXR0ZXN0\nYXRpb24gUmVwb3J0IFNpZ25pbmcgQ0EwIBcNMTYxMTE0MTUzNzMxWhgPMjA0OTEy\nMzEyMzU5NTlaMH4xCzAJBgNVBAYTAlVTMQswCQYDVQQIDAJDQTEUMBIGA1UEBwwL\nU2FudGEgQ2xhcmExGjAYBgNVBAoMEUludGVsIENvcnBvcmF0aW9uMTAwLgYDVQQD\nDCdJbnRlbCBTR1ggQXR0ZXN0YXRpb24gUmVwb3J0IFNpZ25pbmcgQ0EwggGiMA0G\nCSqGSIb3DQEBAQUAA4IBjwAwggGKAoIBgQCfPGR+tXc8u1EtJzLA10Feu1Wg+p7e\nLmSRmeaCHbkQ1TF3Nwl3RmpqXkeGzNLd69QUnWovYyVSndEMyYc3sHecGgfinEeh\nrgBJSEdsSJ9FpaFdesjsxqzGRa20PYdnnfWcCTvFoulpbFR4VBuXnnVLVzkUvlXT\nL/TAnd8nIZk0zZkFJ7P5LtePvykkar7LcSQO85wtcQe0R1Raf/sQ6wYKaKmFgCGe\nNpEJUmg4ktal4qgIAxk+QHUxQE42sxViN5mqglB0QJdUot/o9a/V/mMeH8KvOAiQ\nbyinkNndn+Bgk5sSV5DFgF0DffVqmVMblt5p3jPtImzBIH0QQrXJq39AT8cRwP5H\nafuVeLHcDsRp6hol4P+ZFIhu8mmbI1u0hH3W/0C2BuYXB5PC+5izFFh/nP0lc2Lf\n6rELO9LZdnOhpL1ExFOq9H/B8tPQ84T3Sgb4nAifDabNt/zu6MmCGo5U8lwEFtGM\nRoOaX4AS+909x00lYnmtwsDVWv9vBiJCXRsCAwEAAaOByTCBxjBgBgNVHR8EWTBX\nMFWgU6BRhk9odHRwOi8vdHJ1c3RlZHNlcnZpY2VzLmludGVsLmNvbS9jb250ZW50\nL0NSTC9TR1gvQXR0ZXN0YXRpb25SZXBvcnRTaWduaW5nQ0EuY3JsMB0GA1UdDgQW\nBBR4Q3t2pn680K9+QjfrNXw7hwFRPDAfBgNVHSMEGDAWgBR4Q3t2pn680K9+Qjfr\nNXw7hwFRPDAOBgNVHQ8BAf8EBAMCAQYwEgYDVR0TAQH/BAgwBgEB/wIBADANBgkq\nhkiG9w0BAQsFAAOCAYEAeF8tYMXICvQqeXYQITkV2oLJsp6J4JAqJabHWxYJHGir\nIEqucRiJSSx+HjIJEUVaj8E0QjEud6Y5lNmXlcjqRXaCPOqK0eGRz6hi+ripMtPZ\nsFNaBwLQVV905SDjAzDzNIDnrcnXyB4gcDFCvwDFKKgLRjOB/WAqgscDUoGq5ZVi\nzLUzTqiQPmULAQaB9c6Oti6snEFJiCQ67JLyW/E83/frzCmO5Ru6WjU4tmsmy8Ra\nUd4APK0wZTGtfPXU7w+IBdG5Ez0kE1qzxGQaL4gINJ1zMyleDnbuS8UicjJijvqA\n152Sq049ESDz+1rRGc2NVEqh1KaGXmtXvqxXcTB+Ljy5Bw2ke0v8iGngFBPqCTVB\n3op5KBG3RjbF6RRSzwzuWfL7QErNC8WEy5yDVARzTA5+xmBc388v9Dm21HGfcC8O\nDD+gT9sSpssq0ascmvH49MOgjt1yoysLtdCtJW/9FZpoOypaHx0R+mJTLwPXVMrv\nDaVzWh5aiEx+idkSGMnX\n-----END CERTIFICATE-----", certificate: "-----BEGIN CERTIFICATE-----\nMIIEoTCCAwmgAwIBAgIJANEHdl0yo7CWMA0GCSqGSIb3DQEBCwUAMH4xCzAJBgNV\nBAYTAlVTMQswCQYDVQQIDAJDQTEUMBIGA1UEBwwLU2FudGEgQ2xhcmExGjAYBgNV\nBAoMEUludGVsIENvcnBvcmF0aW9uMTAwLgYDVQQDDCdJbnRlbCBTR1ggQXR0ZXN0\nYXRpb24gUmVwb3J0IFNpZ25pbmcgQ0EwHhcNMTYxMTIyMDkzNjU4WhcNMjYxMTIw\nMDkzNjU4WjB7MQswCQYDVQQGEwJVUzELMAkGA1UECAwCQ0ExFDASBgNVBAcMC1Nh\nbnRhIENsYXJhMRowGAYDVQQKDBFJbnRlbCBDb3Jwb3JhdGlvbjEtMCsGA1UEAwwk\nSW50ZWwgU0dYIEF0dGVzdGF0aW9uIFJlcG9ydCBTaWduaW5nMIIBIjANBgkqhkiG\n9w0BAQEFAAOCAQ8AMIIBCgKCAQEAqXot4OZuphR8nudFrAFiaGxxkgma/Es/BA+t\nbeCTUR106AL1ENcWA4FX3K+E9BBL0/7X5rj5nIgX/R/1ubhkKWw9gfqPG3KeAtId\ncv/uTO1yXv50vqaPvE1CRChvzdS/ZEBqQ5oVvLTPZ3VEicQjlytKgN9cLnxbwtuv\nLUK7eyRPfJW/ksddOzP8VBBniolYnRCD2jrMRZ8nBM2ZWYwnXnwYeOAHV+W9tOhA\nImwRwKF/95yAsVwd21ryHMJBcGH70qLagZ7Ttyt++qO/6+KAXJuKwZqjRlEtSEz8\ngZQeFfVYgcwSfo96oSMAzVr7V0L6HSDLRnpb6xxmbPdqNol4tQIDAQABo4GkMIGh\nMB8GA1UdIwQYMBaAFHhDe3amfrzQr35CN+s1fDuHAVE8MA4GA1UdDwEB/wQEAwIG\nwDAMBgNVHRMBAf8EAjAAMGAGA1UdHwRZMFcwVaBToFGGT2h0dHA6Ly90cnVzdGVk\nc2VydmljZXMuaW50ZWwuY29tL2NvbnRlbnQvQ1JML1NHWC9BdHRlc3RhdGlvblJl\ncG9ydFNpZ25pbmdDQS5jcmwwDQYJKoZIhvcNAQELBQADggGBAGcIthtcK9IVRz4r\nRq+ZKE+7k50/OxUsmW8aavOzKb0iCx07YQ9rzi5nU73tME2yGRLzhSViFs/LpFa9\nlpQL6JL1aQwmDR74TxYGBAIi5f4I5TJoCCEqRHz91kpG6Uvyn2tLmnIdJbPE4vYv\nWLrtXXfFBSSPD4Afn7+3/XUggAlc7oCTizOfbbtOFlYA4g5KcYgS1J2ZAeMQqbUd\nZseZCcaZZZn65tdqee8UXZlDvx0+NdO0LR+5pFy+juM0wWbu59MvzcmTXbjsi7HY\n6zd53Yq5K244fwFHRQ8eOB0IWB+4PfM7FeAApZvlfqlKOlLcZL2uyVmzRkyR5yW7\n2uo9mehX44CiPJ2fse9Y6eQtcfEhMPkmHXI01sN+KwPbpA39+xOsStjhP9N1Y1a2\ntQAVo+yVgLgV2Hws73Fc0o3wC78qPEA+v2aRs/Be3ZFDgDyghc/1fgU+7C+P6kbq\nd4poyb6IW8KCJbxfMJvkordNOgOUUxndPHEi/tb/U7uLjLOgPA==\n-----END CERTIFICATE-----", report: ASReport { id: "251481899929949409354467512751427557593", timestamp: "2019-05-07T18:57:05.828037", isv_enclave_quote_status: "GROUP_OUT_OF_DATE", platform_info_blob: "1502006504000F00000505020401010000000000000000000008000009000000020000000000000AC7B6A47FE191EDBDC649C9D82BD1929B74324D6A8DD4DB4CCF426C1D6C08973156D37A37803491E21485E4B68083465ED1A6AF323876AABE578273FBE03B57B345", isv_enclave_quote_body: "AgAAAMcKAAAHAAYAAAAAALAzX9O8HMqPgE65imQgWS0F57jM7mMWexZIwnbpFnD9AgX/BP//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABwAAAAAAAAAHAAAAAAAAAOz4RVDrshLLiL16Rh4Gsdlr/1zpm3RtK4XPkWvhEgPfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACD1xnnferKFHD2uvYqTXdDA8iZ22kCD5xw7h38CMfOngAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABmviX1Cw+inpMlZXUdJZrqgoPX2QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA" }, report_string: "{\"id\":\"251481899929949409354467512751427557593\",\"timestamp\":\"2019-05-07T18:57:05.828037\",\"version\":3,\"isvEnclaveQuoteStatus\":\"GROUP_OUT_OF_DATE\",\"platformInfoBlob\":\"1502006504000F00000505020401010000000000000000000008000009000000020000000000000AC7B6A47FE191EDBDC649C9D82BD1929B74324D6A8DD4DB4CCF426C1D6C08973156D37A37803491E21485E4B68083465ED1A6AF323876AABE578273FBE03B57B345\",\"isvEnclaveQuoteBody\":\"AgAAAMcKAAAHAAYAAAAAALAzX9O8HMqPgE65imQgWS0F57jM7mMWexZIwnbpFnD9AgX/BP//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABwAAAAAAAAAHAAAAAAAAAOz4RVDrshLLiL16Rh4Gsdlr/1zpm3RtK4XPkWvhEgPfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACD1xnnferKFHD2uvYqTXdDA8iZ22kCD5xw7h38CMfOngAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABmviX1Cw+inpMlZXUdJZrqgoPX2QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA\"}", signature: "3bcb1702845950601e51f3917131211aaedc6a6b3ace04e566d797aa5181974afec3165537b28d5bc5dd1d921dc852857bc8f333d82c41f83ea771f16c2e54594d255f75c47148554a7092129618d7b3259c92bdabec827ed69730e5ff76309c945182656d6fddd42a5efbc03f8a20dea60368a2076c9b28895e55f984268837173827bdf973400b037c61acd6a61a4a139f0388e4f358e417453176f930502c8e4ba68f4150f721ddfcd292d0df034036bbf325b5fe0d6541c073e3da3ba70a11fd0e3533aa5164a68be739f7c4f8d05d67da4c471c406fb92e42078b64b6479ee0e6778a644c6ff15e824f841061a56f68ceb37fea1c45b635d0906c8837ff", validate: true }
core_1       | 18:57:05 [INFO] LOG DERIVE: ASResponse { id: 1, jsonrpc: "2.0", result: ASResult { ca: "-----BEGIN CERTIFICATE-----\nMIIFSzCCA7OgAwIBAgIJANEHdl0yo7CUMA0GCSqGSIb3DQEBCwUAMH4xCzAJBgNV\nBAYTAlVTMQswCQYDVQQIDAJDQTEUMBIGA1UEBwwLU2FudGEgQ2xhcmExGjAYBgNV\nBAoMEUludGVsIENvcnBvcmF0aW9uMTAwLgYDVQQDDCdJbnRlbCBTR1ggQXR0ZXN0\nYXRpb24gUmVwb3J0IFNpZ25pbmcgQ0EwIBcNMTYxMTE0MTUzNzMxWhgPMjA0OTEy\nMzEyMzU5NTlaMH4xCzAJBgNVBAYTAlVTMQswCQYDVQQIDAJDQTEUMBIGA1UEBwwL\nU2FudGEgQ2xhcmExGjAYBgNVBAoMEUludGVsIENvcnBvcmF0aW9uMTAwLgYDVQQD\nDCdJbnRlbCBTR1ggQXR0ZXN0YXRpb24gUmVwb3J0IFNpZ25pbmcgQ0EwggGiMA0G\nCSqGSIb3DQEBAQUAA4IBjwAwggGKAoIBgQCfPGR+tXc8u1EtJzLA10Feu1Wg+p7e\nLmSRmeaCHbkQ1TF3Nwl3RmpqXkeGzNLd69QUnWovYyVSndEMyYc3sHecGgfinEeh\nrgBJSEdsSJ9FpaFdesjsxqzGRa20PYdnnfWcCTvFoulpbFR4VBuXnnVLVzkUvlXT\nL/TAnd8nIZk0zZkFJ7P5LtePvykkar7LcSQO85wtcQe0R1Raf/sQ6wYKaKmFgCGe\nNpEJUmg4ktal4qgIAxk+QHUxQE42sxViN5mqglB0QJdUot/o9a/V/mMeH8KvOAiQ\nbyinkNndn+Bgk5sSV5DFgF0DffVqmVMblt5p3jPtImzBIH0QQrXJq39AT8cRwP5H\nafuVeLHcDsRp6hol4P+ZFIhu8mmbI1u0hH3W/0C2BuYXB5PC+5izFFh/nP0lc2Lf\n6rELO9LZdnOhpL1ExFOq9H/B8tPQ84T3Sgb4nAifDabNt/zu6MmCGo5U8lwEFtGM\nRoOaX4AS+909x00lYnmtwsDVWv9vBiJCXRsCAwEAAaOByTCBxjBgBgNVHR8EWTBX\nMFWgU6BRhk9odHRwOi8vdHJ1c3RlZHNlcnZpY2VzLmludGVsLmNvbS9jb250ZW50\nL0NSTC9TR1gvQXR0ZXN0YXRpb25SZXBvcnRTaWduaW5nQ0EuY3JsMB0GA1UdDgQW\nBBR4Q3t2pn680K9+QjfrNXw7hwFRPDAfBgNVHSMEGDAWgBR4Q3t2pn680K9+Qjfr\nNXw7hwFRPDAOBgNVHQ8BAf8EBAMCAQYwEgYDVR0TAQH/BAgwBgEB/wIBADANBgkq\nhkiG9w0BAQsFAAOCAYEAeF8tYMXICvQqeXYQITkV2oLJsp6J4JAqJabHWxYJHGir\nIEqucRiJSSx+HjIJEUVaj8E0QjEud6Y5lNmXlcjqRXaCPOqK0eGRz6hi+ripMtPZ\nsFNaBwLQVV905SDjAzDzNIDnrcnXyB4gcDFCvwDFKKgLRjOB/WAqgscDUoGq5ZVi\nzLUzTqiQPmULAQaB9c6Oti6snEFJiCQ67JLyW/E83/frzCmO5Ru6WjU4tmsmy8Ra\nUd4APK0wZTGtfPXU7w+IBdG5Ez0kE1qzxGQaL4gINJ1zMyleDnbuS8UicjJijvqA\n152Sq049ESDz+1rRGc2NVEqh1KaGXmtXvqxXcTB+Ljy5Bw2ke0v8iGngFBPqCTVB\n3op5KBG3RjbF6RRSzwzuWfL7QErNC8WEy5yDVARzTA5+xmBc388v9Dm21HGfcC8O\nDD+gT9sSpssq0ascmvH49MOgjt1yoysLtdCtJW/9FZpoOypaHx0R+mJTLwPXVMrv\nDaVzWh5aiEx+idkSGMnX\n-----END CERTIFICATE-----", certificate: "-----BEGIN CERTIFICATE-----\nMIIEoTCCAwmgAwIBAgIJANEHdl0yo7CWMA0GCSqGSIb3DQEBCwUAMH4xCzAJBgNV\nBAYTAlVTMQswCQYDVQQIDAJDQTEUMBIGA1UEBwwLU2FudGEgQ2xhcmExGjAYBgNV\nBAoMEUludGVsIENvcnBvcmF0aW9uMTAwLgYDVQQDDCdJbnRlbCBTR1ggQXR0ZXN0\nYXRpb24gUmVwb3J0IFNpZ25pbmcgQ0EwHhcNMTYxMTIyMDkzNjU4WhcNMjYxMTIw\nMDkzNjU4WjB7MQswCQYDVQQGEwJVUzELMAkGA1UECAwCQ0ExFDASBgNVBAcMC1Nh\nbnRhIENsYXJhMRowGAYDVQQKDBFJbnRlbCBDb3Jwb3JhdGlvbjEtMCsGA1UEAwwk\nSW50ZWwgU0dYIEF0dGVzdGF0aW9uIFJlcG9ydCBTaWduaW5nMIIBIjANBgkqhkiG\n9w0BAQEFAAOCAQ8AMIIBCgKCAQEAqXot4OZuphR8nudFrAFiaGxxkgma/Es/BA+t\nbeCTUR106AL1ENcWA4FX3K+E9BBL0/7X5rj5nIgX/R/1ubhkKWw9gfqPG3KeAtId\ncv/uTO1yXv50vqaPvE1CRChvzdS/ZEBqQ5oVvLTPZ3VEicQjlytKgN9cLnxbwtuv\nLUK7eyRPfJW/ksddOzP8VBBniolYnRCD2jrMRZ8nBM2ZWYwnXnwYeOAHV+W9tOhA\nImwRwKF/95yAsVwd21ryHMJBcGH70qLagZ7Ttyt++qO/6+KAXJuKwZqjRlEtSEz8\ngZQeFfVYgcwSfo96oSMAzVr7V0L6HSDLRnpb6xxmbPdqNol4tQIDAQABo4GkMIGh\nMB8GA1UdIwQYMBaAFHhDe3amfrzQr35CN+s1fDuHAVE8MA4GA1UdDwEB/wQEAwIG\nwDAMBgNVHRMBAf8EAjAAMGAGA1UdHwRZMFcwVaBToFGGT2h0dHA6Ly90cnVzdGVk\nc2VydmljZXMuaW50ZWwuY29tL2NvbnRlbnQvQ1JML1NHWC9BdHRlc3RhdGlvblJl\ncG9ydFNpZ25pbmdDQS5jcmwwDQYJKoZIhvcNAQELBQADggGBAGcIthtcK9IVRz4r\nRq+ZKE+7k50/OxUsmW8aavOzKb0iCx07YQ9rzi5nU73tME2yGRLzhSViFs/LpFa9\nlpQL6JL1aQwmDR74TxYGBAIi5f4I5TJoCCEqRHz91kpG6Uvyn2tLmnIdJbPE4vYv\nWLrtXXfFBSSPD4Afn7+3/XUggAlc7oCTizOfbbtOFlYA4g5KcYgS1J2ZAeMQqbUd\nZseZCcaZZZn65tdqee8UXZlDvx0+NdO0LR+5pFy+juM0wWbu59MvzcmTXbjsi7HY\n6zd53Yq5K244fwFHRQ8eOB0IWB+4PfM7FeAApZvlfqlKOlLcZL2uyVmzRkyR5yW7\n2uo9mehX44CiPJ2fse9Y6eQtcfEhMPkmHXI01sN+KwPbpA39+xOsStjhP9N1Y1a2\ntQAVo+yVgLgV2Hws73Fc0o3wC78qPEA+v2aRs/Be3ZFDgDyghc/1fgU+7C+P6kbq\nd4poyb6IW8KCJbxfMJvkordNOgOUUxndPHEi/tb/U7uLjLOgPA==\n-----END CERTIFICATE-----", report: ASReport { id: "251481899929949409354467512751427557593", timestamp: "2019-05-07T18:57:05.828037", isv_enclave_quote_status: "GROUP_OUT_OF_DATE", platform_info_blob: "1502006504000F00000505020401010000000000000000000008000009000000020000000000000AC7B6A47FE191EDBDC649C9D82BD1929B74324D6A8DD4DB4CCF426C1D6C08973156D37A37803491E21485E4B68083465ED1A6AF323876AABE578273FBE03B57B345", isv_enclave_quote_body: "AgAAAMcKAAAHAAYAAAAAALAzX9O8HMqPgE65imQgWS0F57jM7mMWexZIwnbpFnD9AgX/BP//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABwAAAAAAAAAHAAAAAAAAAOz4RVDrshLLiL16Rh4Gsdlr/1zpm3RtK4XPkWvhEgPfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACD1xnnferKFHD2uvYqTXdDA8iZ22kCD5xw7h38CMfOngAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABmviX1Cw+inpMlZXUdJZrqgoPX2QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA" }, report_string: "{\"id\":\"251481899929949409354467512751427557593\",\"timestamp\":\"2019-05-07T18:57:05.828037\",\"version\":3,\"isvEnclaveQuoteStatus\":\"GROUP_OUT_OF_DATE\",\"platformInfoBlob\":\"1502006504000F00000505020401010000000000000000000008000009000000020000000000000AC7B6A47FE191EDBDC649C9D82BD1929B74324D6A8DD4DB4CCF426C1D6C08973156D37A37803491E21485E4B68083465ED1A6AF323876AABE578273FBE03B57B345\",\"isvEnclaveQuoteBody\":\"AgAAAMcKAAAHAAYAAAAAALAzX9O8HMqPgE65imQgWS0F57jM7mMWexZIwnbpFnD9AgX/BP//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABwAAAAAAAAAHAAAAAAAAAOz4RVDrshLLiL16Rh4Gsdlr/1zpm3RtK4XPkWvhEgPfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACD1xnnferKFHD2uvYqTXdDA8iZ22kCD5xw7h38CMfOngAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABmviX1Cw+inpMlZXUdJZrqgoPX2QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA\"}", signature: "3bcb1702845950601e51f3917131211aaedc6a6b3ace04e566d797aa5181974afec3165537b28d5bc5dd1d921dc852857bc8f333d82c41f83ea771f16c2e54594d255f75c47148554a7092129618d7b3259c92bdabec827ed69730e5ff76309c945182656d6fddd42a5efbc03f8a20dea60368a2076c9b28895e55f984268837173827bdf973400b037c61acd6a61a4a139f0388e4f358e417453176f930502c8e4ba68f4150f721ddfcd292d0df034036bbf325b5fe0d6541c073e3da3ba70a11fd0e3533aa5164a68be739f7c4f8d05d67da4c471c406fb92e42078b64b6479ee0e6778a644c6ff15e824f841061a56f68ceb37fea1c45b635d0906c8837ff", validate: true } }
core_1       | 18:57:05 [INFO] LOG DERIVE: Ok(GetRegistrationParams { result: RegistrationParams { signing_key: "66be25f50b0fa29e932565751d259aea8283d7d9", report: "7b226964223a22323531343831383939393239393439343039333534343637353132373531343237353537353933222c2274696d657374616d70223a22323031392d30352d30375431383a35373a30352e383238303337222c2276657273696f6e223a332c22697376456e636c61766551756f7465537461747573223a2247524f55505f4f55545f4f465f44415445222c22706c6174666f726d496e666f426c6f62223a22313530323030363530343030304630303030303530353032303430313031303030303030303030303030303030303030303030383030303030393030303030303032303030303030303030303030304143374236413437464531393145444244433634394339443832424431393239423734333234443641384444344442344343463432364331443643303839373331353644333741333738303334393145323134383545344236383038333436354544314136414633323338373641414245353738323733464245303342353742333435222c22697376456e636c61766551756f7465426f6479223a2241674141414d634b414141484141594141414141414c417a58394f38484d715067453635696d51675753304635376a4d376d4d5765785a49776e6270466e44394167582f42502f2f41414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414277414141414141414141484141414141414141414f7a345256447273684c4c694c31365268344773646c722f317a706d3352744b3458506b57766845675066414141414141414141414141414141414141414141414141414141414141414141414141414141414141434431786e6e6665724b4648443275765971545864444138695a32326b434435787737683338434d664f6e674141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141426d7669583143772b696e704d6c5a5855644a5a7271676f5058325141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141414141227d", signature: "3bcb1702845950601e51f3917131211aaedc6a6b3ace04e566d797aa5181974afec3165537b28d5bc5dd1d921dc852857bc8f333d82c41f83ea771f16c2e54594d255f75c47148554a7092129618d7b3259c92bdabec827ed69730e5ff76309c945182656d6fddd42a5efbc03f8a20dea60368a2076c9b28895e55f984268837173827bdf973400b037c61acd6a61a4a139f0388e4f358e417453176f930502c8e4ba68f4150f721ddfcd292d0df034036bbf325b5fe0d6541c073e3da3ba70a11fd0e3533aa5164a68be739f7c4f8d05d67da4c471c406fb92e42078b64b6479ee0e6778a644c6ff15e824f841061a56f68ceb37fea1c45b635d0906c8837ff" } })
contract_1   | eth_call
p2p_1        | [Tue May 07 2019 18:57:05 GMT+0000 (Coordinated Universal Time)] DEBUG [VERIFY_NEW_TASK] successful verification of task 88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc
p2p_1        | [Tue May 07 2019 18:57:05 GMT+0000 (Coordinated Universal Time)] DEBUG [onVerifyTask] saved to db task 88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc
core_1       | 18:57:05 [INFO] LOG DERIVE: Ok(GetPTTRequest { result: Request { request: "83a46461746181a75265717565737491dc0020cc88cc987accf7ccd35eccabcccaccd95915ccb93bccfd3d2bccc330cc8f06ccb7197478ccb0ccdfccca26cc8f04cc97ccdca269649c50ccb078ccea7340cc9221ccbe2d76ccaea67075626b6579dc0040cc90ccf2ccfb4745cce8cc994823ccaecc8bcca84370cca1cc8bccc9ccb9cc95cce0ccebccdccc9c30cc8cccf41d37cc9e0929ccab4a6343cceacca3cccacccd00ccd8ccb5cc9d44ccb47bccba71ccbe11ccd9cc82ccafcc835c75220738520253ccdc67", sig: "235e962e8dcce622d5348b44d7b731fb2b918e5ab1061a48b7e05920b71284ee3ac0fa84524fb5a2f1fc68fb96932bb414d9394e1291c5f4a7804799884abdfb1c" } })
principal_1  | Got get_state_keys request: StateKeyRequest { data: StringWrapper("83a46461746181a75265717565737491dc0020cc88cc987accf7ccd35eccabcccaccd95915ccb93bccfd3d2bccc330cc8f06ccb7197478ccb0ccdfccca26cc8f04cc97ccdca269649c50ccb078ccea7340cc9221ccbe2d76ccaea67075626b6579dc0040cc90ccf2ccfb4745cce8cc994823ccaecc8bcca84370cca1cc8bccc9ccb9cc95cce0ccebccdccc9c30cc8cccf41d37cc9e0929ccab4a6343cceacca3cccacccd00ccd8ccb5cc9d44ccb47bccba71ccbe11ccd9cc82ccafcc835c75220738520253ccdc67"), sig: StringWrapper("235e962e8dcce622d5348b44d7b731fb2b918e5ab1061a48b7e05920b71284ee3ac0fa84524fb5a2f1fc68fb96932bb414d9394e1291c5f4a7804799884abdfb1c") }
principal_1  | Found addresses in message: [Hash256([136, 152, 122, 247, 211, 94, 171, 202, 217, 89, 21, 185, 59, 253, 61, 43, 195, 48, 143, 6, 183, 25, 116, 120, 176, 223, 202, 38, 143, 4, 151, 220])]
principal_1  | Generated hash image: [0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 0, 0, 0, 0, 32, 136, 152, 122, 247, 211, 94, 171, 202, 217, 89, 21, 185, 59, 253, 61, 43, 195, 48, 143, 6, 183, 25, 116, 120, 176, 223, 202, 38, 143, 4, 151, 220, 0, 0, 0, 0, 0, 0, 0, 64, 144, 242, 251, 71, 69, 232, 153, 72, 35, 174, 139, 168, 67, 112, 161, 139, 201, 185, 149, 224, 235, 220, 156, 48, 140, 244, 29, 55, 158, 9, 41, 171, 74, 99, 67, 234, 163, 202, 205, 0, 216, 181, 157, 68, 180, 123, 186, 113, 190, 17, 217, 130, 175, 131, 92, 117, 34, 7, 56, 82, 2, 83, 220, 103, 0, 0, 0, 0, 0, 0, 0, 12, 80, 176, 120, 234, 115, 64, 146, 33, 190, 45, 118, 174] for request: PrincipalMessage { data: Request(Some([Hash256([136, 152, 122, 247, 211, 94, 171, 202, 217, 89, 21, 185, 59, 253, 61, 43, 195, 48, 143, 6, 183, 25, 116, 120, 176, 223, 202, 38, 143, 4, 151, 220])])), pubkey: [144, 242, 251, 71, 69, 232, 153, 72, 35, 174, 139, 168, 67, 112, 161, 139, 201, 185, 149, 224, 235, 220, 156, 48, 140, 244, 29, 55, 158, 9, 41, 171, 74, 99, 67, 234, 163, 202, 205, 0, 216, 181, 157, 68, 180, 123, 186, 113, 190, 17, 217, 130, 175, 131, 92, 117, 34, 7, 56, 82, 2, 83, 220, 103], id: [80, 176, 120, 234, 115, 64, 146, 33, 190, 45, 118, 174] }
principal_1  | Running worker selection using Epoch: Epoch { nonce: 0x2, seed: 0xd1035f844e55368581688268d54b623ec2f3f27e63cf6e9a7e2cca2a6b854083, worker_params: InputWorkerParams { block_number: 0x34, workers: [0x12d3f1811eeba50fec9d812989303b59e2c2b8d9, 0x11168a2d518d094d9491a98b8e898b7f37b12951, 0x66be25f50b0fa29e932565751d259aea8283d7d9], stakes: [0x14f46b0400, 0x14f46b0400, 0x14f46b0400] } }
principal_1  | Found selected worker: 0x66be25f50b0fa29e932565751d259aea8283d7d9
principal_1  | State key not found in cache, fetching sealed document.
principal_1  | [+] Home dir is /root
principal_1  | Back from Ocall: /root/.enigma
principal_1  | [+] Home dir is /root
principal_1  | Back from Ocall: /root/.enigma
principal_1  | Sealed document: "/root/.enigma/state-keys/88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc.sealed" written successfully.
principal_1  | Initial key stored successfully
principal_1  | The partially encrypted response: "83a46461746181b1456e63727970746564526573706f6e7365dc008855ccb9ccfe000a4fcce71560ccedcc85cce4cce5ccfd44cc9656463eccc6ccc4ccd3ccffccddcca24b26ccdbcc85ccf0304a1f093929cc98cce04ecca35fccf32332cc9f3dccd44e4bccd9ccce38cce52accbbccafccdbccd7cca0ccb6cca055ccfeccf6cc83ccfd16ccdfccb2ccd740311e2921ccfc2c49cce573ccd6cca4ccad13ccdbccdfccfcccc0ccdeccb877ccd17fcca42341644547cc963274374dcce6770a58cc8f2f44cccc4ccc8637ccbf66ccf376cce7cca2ccb40355032518ccfc60cca3ccc44ecc892acc864aa269649c50ccb078ccea7340cc9221ccbe2d76ccaea67075626b6579dc00402611cc8c551277cc94783accf1cccdcc8736ccd6210f5fccc56638cc8831ccd96fccc66e70ccf8ccb8ccc5cc9772cc8a7360ccb1ccfa6a74cc9d006fccc2cce1cc9854ccbb5c756b41cce2ccc1ccca543e6dccf53fcce2cca852ccc5ccbd"
p2p_1        | [Tue May 07 2019 18:57:06 GMT+0000 (Coordinated Universal Time)] DEBUG Connecting to principal node: http://172.21.0.3:3040
core_1       | building state for 1 contracts
contract_1   | eth_call
contract_1   | eth_blockNumber
principal_1  | [? ] Blocks @ previous: 53, current: 55, next: 63 [? ]
principal_1  | [? ] Epoch still active [? ]
core_1       | 18:57:06 [INFO] LOG DERIVE: []
core_1       | 18:57:06 [INFO] LOG DERIVE: Ok(PTTResponse { result: Errors([]) })
p2p_1        | [Tue May 07 2019 18:57:06 GMT+0000 (Coordinated Universal Time)] DEBUG finished GET_STATE_KEYS for 88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc
contract_1   | eth_call
contract_1   | eth_blockNumber
principal_1  | [? ] Blocks @ previous: 53, current: 55, next: 63 [? ]
principal_1  | [? ] Epoch still active [? ]
core_1       | 18:57:07 [INFO] LOG DERIVE: Ok(DeploySecretContract { result: DeployResult { pre_code_hash: "be27ffa8be0fd19c15a6637094c288a45c7326b96f5460dbd2ee460276e2bffa", used_gas: 35838, output: "...", delta: IpcDelta { contract_address: None, key: 0, data: Some([107, 92, 54, 252, 115, 89, 147, 166, 221, 10, 120, 226, 173, 140, 172, 112, 80, 255, 176, 200, 48, 78, 153, 185, 72, 81, 177, 40, 246, 170, 241, 234, 193, 37, 14, 240, 157, 51, 247, 160, 7, 6, 174, 47, 189, 69, 178, 153, 94, 60, 185, 201, 197, 253, 185, 3, 155, 217, 181, 214, 0, 31, 8, 11, 233]) }, ethereum_address: "0000000000000000000000000000000000000000", ethereum_payload: "", signature: "a1b0d07b227236db48323a18ff14a8f1031a7811fdb2c1aa37292cc9fa571a8e01cd354c7395620224f608b1a702940f52406d3460141c69148a2f4e035206c41b" } })
p2p_1        | [Tue May 07 2019 18:57:07 GMT+0000 (Coordinated Universal Time)] INFO [TASK_FINISHED] status = [SUCCESS] id: 88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc
p2p_1        | [Tue May 07 2019 18:57:07 GMT+0000 (Coordinated Universal Time)] DEBUG published [/taskresults/0.1]
p2p_3        | [Tue May 07 2019 18:57:07 GMT+0000 (Coordinated Universal Time)] DEBUG [RECEIVED_RESULT] taskId {88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc} 
p2p_3        | status {SUCCESS}
p2p_2        | [Tue May 07 2019 18:57:07 GMT+0000 (Coordinated Universal Time)] DEBUG [RECEIVED_RESULT] taskId {88987af7d35eabcad95915b93bfd3d2bc3308f06b7197478b0dfca268f0497dc} 
p2p_2        | status {SUCCESS}
lacabra commented 5 years ago

I ran it another time: first contract is assigned to p2p_1 (succeeds) second contract is assigned to p2p_3 (fails)

The strange thing to me is that the for the second contract, the exchange of the workerEncryptionKey works just fine, but the actual deployment does not.

lenak25 commented 5 years ago

Thanks @lacabra ! Yes, it is indeed strange, as it seems that the worker does hear requests and it's hard to understand why the WorkerEncryptionKey goes well, while the DeploySecretContract does not. Does the second deploy always fails (did it fail in the test which produced the latest log you've attached - when the selected worker for the second deploy was p2p_2)? Any chance you can send me the entire log produced in the test (I want to see the initialization logs of all the workers, etc) - when the second deploy fails - via email?

lacabra commented 5 years ago

Right, that's precisely what I don't understand: how the WorkerEncryptionKey goes well, while the DeploySecretContract does not. All the tests I have done today are consistent: the first deployment succeeds (regardless of which node gets it, p2p_1 in the two cases above, but p2p_3 in the network output included below), and the second one fails (again, regardless of who's assigned to it (2 and 3 above, 2 below)).

I don't see anything else wrong with the output, available here. This is a bit harder than the real output because the coloring scheme by container is lost.

You should be able to run it yourself, just clone the repo, copy .env-template to .env, make any changes to .env and run ./launch.bash as per the README.

lacabra commented 5 years ago

I have been debugging this, and I have observed the following:

The publishing node does seem to publish, and the subscribed node is indeed subscribed (I can manually go to that node and publish on that topic, and that node gets its own message), but the message does not seem to be transmitted on the network. I can go onto a third node and observe the following: this third node does not get the message from the publishing node, but if the third node publishes to that topic, the subscribed node does get the message. Furthermore, the publishing node is then aware that both nodes are subscribed to that topic, but the message does not reach them.

So it seems that either: a) the publishing node does not really publish (very unlikely) b) whatever is published is not transmitted over the network

lacabra commented 5 years ago

Fixed via: