search

justincpresley / ndn-hydra

ndn-hydra: A Python-coded NDN distributed repository with five focused attributes: resiliency, scalability, usability, efficiency, and security.
Apache License 2.0
3 stars 7 forks source link

Inserted file not found #13

Closed yoursunny closed 3 years ago

yoursunny commented 3 years ago

Environment

Steps to reproduce

In first console:

ndn-hydra -rp /hydra -n $(hostname -s) -s $RANDOM

# only one instance of the repo server is running

In second console:

root@2997f67aae11:~/ndn-hydra# dd if=/dev/urandom of=/tmp/1.bin bs=1M count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156227 s, 67.1 MB/s
root@2997f67aae11:~/ndn-hydra# python3 ./client/main.py insert -r /hydra -f /1.bin -p /tmp/1.bin/1.bin/v=3/seg=1
size: 1048576
5ed8
Created 128 chunks under name /client/upload/1.bin
/hydra/insert
Client finished Insert Command!
root@2997f67aae11:~/ndn-hydra# python3 ./client/main.py fetch -r /hydra -f /1.bin -p /tmp/1.fetch
Distributed Repo does not have that file.
Client finished Fetch Command!
root@2997f67aae11:~/ndn-hydra# python3 ./client/main.py query -r /hydra -q /files
Query command received no data packet back
Client finished Query Command!
root@2997f67aae11:~/ndn-hydra# python3 ./client/main.py query -r /hydra -q /sid
Distributed Repo does not know that query.
Client finished Query Command!
root@2997f67aae11:~/ndn-hydra# python3 ./client/main.py query -r /hydra -q /sids
List of All Session IDs
['13008']
Client finished Query Command!
root@2997f67aae11:~/ndn-hydra# python3 ./client/main.py query -r /hydra -q /file/1.bin
File Does Not Exists in The Repo
Client finished Query Command!

session.log

1625948295.388497  INFO      Read handle: listening to /hydra/fetch
1625948295.388819  INFO      Read handle: listening to /hydra/sid/13008/fetch
1625948295.389026  INFO      Query handle: listening to /hydra/query
1625948295.389241  INFO      Query handle: listening to /hydra/sid/13008/query
1625948295.400569  INFO      SVSync: started svsync
1625948295.400656  INFO      SVSyncCore: started svsync core
1625948295.400753  INFO      SVSyncCore: started listening to /hydra/group
1625948295.400795  INFO      AsyncScheduler: started scheduler for an async function
1625948295.400894  INFO      SVSync: started listening to /13008/hydra/group
1625948295.401673  INFO      SVSyncCore: sent sync /hydra/group/201=
1625948315.469537  INFO      SVSync: publishing data /13008/hydra/group/epoch-1
1625948315.470440  INFO      Cache save: /13008/hydra/group/epoch-1
1625948315.473041  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%01
1625948335.539984  INFO      SVSync: publishing data /13008/hydra/group/epoch-2
1625948335.540899  INFO      Cache save: /13008/hydra/group/epoch-2
1625948335.543484  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%02
1625948355.612031  INFO      SVSync: publishing data /13008/hydra/group/epoch-3
1625948355.612900  INFO      Cache save: /13008/hydra/group/epoch-3
1625948355.615472  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%03
1625948375.681854  INFO      SVSync: publishing data /13008/hydra/group/epoch-4
1625948375.682397  INFO      Cache save: /13008/hydra/group/epoch-4
1625948375.684686  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%04
1625948395.752082  INFO      SVSync: publishing data /13008/hydra/group/epoch-5
1625948395.752965  INFO      Cache save: /13008/hydra/group/epoch-5
1625948395.755531  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%05
1625948403.057636  INFO      [cmd][FETCH] nacked client due to no file in repo
1625948403.067120  INFO      Read handle: data not found /hydra/fetch/1.bin/seg=0
1625948415.821233  INFO      SVSync: publishing data /13008/hydra/group/epoch-6
1625948415.821755  INFO      Cache save: /13008/hydra/group/epoch-6
1625948415.824136  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%06
1625948418.953714  INFO      [cmd][QUERY] query received: files
1625948418.954684  ERROR     Task exception was never retrieved
future: <Task finished name='Task-23' coro=<NDNApp._receive() done, defined at /usr/local/lib/python3.9/site-packages/ndn/app.py:70> exception=NameError("name 'FileList' is not defined")>
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/ndn/app.py", line 105, in _receive
    await self._on_interest(name, param, app_param, sig, raw_packet=data)
  File "/usr/local/lib/python3.9/site-packages/ndn/app.py", line 512, in _on_interest
    node.callback(name, param, app_param, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/ndn_hydra/handle_protocol/query_handle.py", line 74, in _on_interest
    filelist = FileList()
NameError: name 'FileList' is not defined
1625948426.185772  INFO      [cmd][QUERY] unknown query received
1625948431.278076  INFO      [cmd][QUERY] query received: sids
1625948435.890416  INFO      SVSync: publishing data /13008/hydra/group/epoch-7
1625948435.890979  INFO      Cache save: /13008/hydra/group/epoch-7
1625948435.893412  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%07
1625948455.958560  INFO      SVSync: publishing data /13008/hydra/group/epoch-8
1625948455.959066  INFO      Cache save: /13008/hydra/group/epoch-8
1625948455.961420  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%08
1625948457.911642  INFO      [cmd][QUERY] query received: file
1625948475.974022  INFO      SVSync: publishing data /13008/hydra/group/epoch-9
1625948475.974773  INFO      Cache save: /13008/hydra/group/epoch-9
1625948475.976929  INFO      SVSyncCore: sent sync /hydra/group/201=%CA%06%2F13008%CB%01%09

Binary logs: ndn-repo-hydra-13008.tar.gz

justincpresley commented 3 years ago

This should be fixed with the latest branch. Thank you for your feedback.