Closed gwgknudayanga closed 1 year ago
hope this helps.
A saccade generator synthetic input class could be useful for reproducing datasets like N-Caltech101. I'll take a look next time working on v2e. In the meantime, I think someone else could write such class and suggest a push with it.
Thank you so much for all the valuable information and guidelines!!
Hi, Further, could you please help me to understand the following concerns regarding saccade camera trajectory? -In the v2e paper it is mentioned that "Each image in the Caltech 101 dataset was recorded by a DVS for 300 ms using three 100 ms-long tri-angular saccade". -As i expect to generate events for static images (which is related to structural damages), since it is required a set of frames for the event generation, I checked out the code for ESIM ( (https://github.com/uzh-rpg/rpg_esim) and was able to get some frames for a static image with random camera motion. But according to the paper i also want to use the saccade motion for the camera. In the original paper also it is said that "three micro-saccades tracing out an isosceles triangle was used on each (static) image" to generate set of from a static image. If i want to do this same thing in ESIM , Normally, how should i provide the corresponding trajectory for the camera for saccades tracing out an isosceles triangle? In the original paper three micro saccades are mentioned as in the table in shown in the following link. Here it seems there are no translations of the camera and only rotations. starting and end orientations of the camera is related to a one micro saccades is for example (-0.5 deg,0.5 deg,0) to (0.5,0.5,0) degree). https://www.frontiersin.org/files/Articles/159859/fnins-09-00437-HTML/image_m/fnins-09-00437-t001.jpg
0 0 0 0 -0.0044 0.0044 0.0000 1 100000000 0 0 0 -0.0044 0 0 1 200000000 0 0 0 0.0044 0.0044 -0.0000 1.0000 300000000 0 0 0 0.0044 -0.0044 0.0000 1
Thank you !!
I'm sorry I can't help with this issue, hope you worked it out.
Hi,
we are planning to use v2e to generate events for static images and videos(collected as 6Hz frames by a drone). Herewith i am requesting your support to understand following things related to v2e.
Normally event camera has a temporal resolution of 1us (microsecond). Can we have 1us temporal resolution for a video of 1 second period with v2e event synthesizer?
If the timestamp step is 1ms, then that means we can have 1000 time bins/steps for a one second video? if it is we can maximum of 1000 events for one pixel for a video of 1s.Isn't it?
In the v2e paper, it is mentioned that 'The upsampled frames corresponds to timestamps'. So, if then the time stamp step is 1ms, then it should have 1000 time stamps for 1 second video, isn't it? If it is, That means it should contain 1000 upsampled frames. But according to the example given in the paper (60Hz video with DVS timestamp step 1ms) the number of upsampled frames is 17 (not 1000 as i thought it should be). So could you please explain where my understanding went wrong?
is it still possible to generate events when we have only one image (still image) by simulating some kind of virtual camera movement with v2e? Could you please share the code which how still images are converted to a small video using the saccade motion so that it can be fed for event generation?
Is there anyway that we can refer the code that you used to generate events for N-Caltech 101, MVSEC data sets using v2e? Because, with that we can comfortable understand how to access the v2e event database, how to compose voxel grids by organizing the v2e events accordingly and also how to synthesize events for static image with v2e. Thank you so much.
Rgds, Udayanga