alinaresb
commented
1 year ago Hi Noah, we are up to upload hd5 files for the digits, already splitter and ready to use. I'll back to you soon.
De: Noah @.> Enviado: lunes, 12 de junio de 2023 17:44 Para: RTC-research-group/LIPSFUS-Event-driven-dataset @.> Cc: Subscribed @.***> Asunto: [RTC-research-group/LIPSFUS-Event-driven-dataset] How to get the event data containing a single word？ (Issue #2)
As far as I know， an AEDAT file was recorded for the whole presentation from the word ”one” to the ”fox” sentence [1]. I want to get the event data that contains a single word, which requires knowing the start and end points of each word in the AEDAT files. I carefully read the code about the data processing but I didn‘t ’find relevant information or code to achieve this purpose. The Matlab code under the NoisyRoom folder just splits the AEDAT file into video and audio data but does not split the words. The create_visual_frame_dataset.py under the scripts folder processes the AEDAT file containing a single word, because the file_name in the code already contains label information, but the code in MATLAB does not add the label information to the file name. I observed in show_dataset_examples.py that the AEDAT file name after word segmentation should be like Alejandro_0degrees_BCIroom_word_audio_Eight_th_4600_prets_100000_ts_30555117_32055117.aedat. However, I don't know what to do to get it, maybe I'm overlooking something.
Finally, obtaining event data containing a single word is important for the use of this dataset, and it would be helpful if the authors could provide relevant information or code.
[1] Rios-Navarro A, Piñero-Fuentes E, Canas-Moreno S, et al. LIPSFUS: A neuromorphic dataset for audio-visual sensory fusion of lip reading[J]. arXiv preprint arXiv:2304.01080, 2023.
— Reply to this email directly, view it on GitHubhttps://github.com/RTC-research-group/LIPSFUS-Event-driven-dataset/issues/2, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADWOVSX5XEOVEDZE5OJOWY3XK42NHANCNFSM6AAAAAAZDSKLWE. You are receiving this because you are subscribed to this thread.Message ID: @.***>
Noah-Jrh
As far as I know， an AEDAT file was recorded for the whole presentation from the word ”one” to the ”fox” sentence [1]. I want to get the event data that contains a single word, which requires knowing the start and end points of each word in the AEDAT files. I carefully read the code about the data processing but I didn‘t ’find relevant information or code to achieve this purpose. The Matlab code under the NoisyRoom folder just splits the AEDAT file into video and audio data but does not split the words. The create_visual_frame_dataset.py under the scripts folder processes the AEDAT file containing a single word, because the file_name in the code already contains label information, but the code in MATLAB does not add the label information to the file name. I observed in show_dataset_examples.py that the AEDAT file name after word segmentation should be like Alejandro_0degrees_BCIroom_word_audio_Eight_th_4600_prets_100000_ts_30555117_32055117.aedat. However, I don't know what to do to get it, maybe I'm overlooking something.
Finally, obtaining event data containing a single word is important for the use of this dataset, and it would be helpful if the authors could provide relevant information or code.
[1] Rios-Navarro A, Piñero-Fuentes E, Canas-Moreno S, et al. LIPSFUS: A neuromorphic dataset for audio-visual sensory fusion of lip reading[J]. arXiv preprint arXiv:2304.01080, 2023.