search

dorienh / jesse

4 stars 0 forks source link

Hop size when reading data #13

Open dorienh opened 3 years ago

dorienh commented 3 years ago

I have a suspicion that the hop size > 1 in the data preloading.

Can we check that hope size = 1?

Examining the X_train tensors it does not seem like they are hopped. But maybe I am missing something and it's randomized.

Which there were comments in this class! 


# 

[[0.4495, 0.3710, 0.4673,  ..., 0.0000, 0.0000, 1.0000],
        [0.5688, 0.4324, 0.5621,  ..., 1.0000, 0.2884, 0.0000],
        [0.9572, 0.7592, 1.0000,  ..., 1.0000, 0.7755, 1.0000],
        ...,
        [0.9235, 0.7494, 0.9281,  ..., 1.0000, 0.7755, 1.0000],
        [0.8869, 0.7838, 0.9771,  ..., 1.0000, 0.7755, 1.0000],
        [0.6086, 0.4865, 0.4281,  ..., 1.0000, 0.6783, 0.0000]],
       dtype=torch.float64)

[[0.4740, 0.4275, 0.5392,  ..., 1.0000, 0.3670, 0.0000],
        [0.6177, 0.4693, 0.5817,  ..., 1.0000, 0.6783, 0.0000],
        [0.5199, 0.4177, 0.5163,  ..., 1.0000, 0.2884, 0.0000],
        ...,
        [0.1835, 0.1400, 0.1569,  ..., 0.0000, 0.0000, 0.3862],
        [0.3425, 0.2776, 0.1830,  ..., 0.0000, 0.0000, 0.0000],
        [0.5719, 0.5283, 0.6536,  ..., 1.0000, 0.6783, 0.0000]],
       dtype=torch.float64)
Luckygyana commented 3 years ago

hop_size??

I know about hop_sizein audio processing but in Timeseries. Can you let me know what do you mean by hop_size here?

Luckygyana commented 3 years ago

My bad, By mistake I closed the issue

dorienh commented 3 years ago

I have a feeling, I could be wrong, that the data is currently processed as follows:

1 2 3 4 5 6 7 8 9 10 ...

with a last_x_days = 3

inputs are: 1 2 3 -> predict at 4 4 5 6 -> predict at 7 7 8 9 -> predict at 10

instead of:

1 2 3 -> 4 2 3 4 -> 5 3 4 5 -> 6 4 5 6 -> 7 ...

Does that clarify a bit?

On Fri, 4 Jun 2021 at 15:20, Gyanendra Das @.***> wrote:

My bad, By mistake I closed the issue

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/dorienh/jesse/issues/13#issuecomment-854430898, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABEES6Z2UPUK5VM5OS2PPYLTRB5C5ANCNFSM454A2T5Q .

-- Dorien Herremans, PhD Assistant Professor, ISTD & DAI Director, SUTD Game Lab Lead, AMAAI (Audio, Music and AI Lab) http://dorienherremans.com

Singapore University of Technology and Design Information Technology and Design Pillar Office 1.502-18

Luckygyana commented 3 years ago

Yeah I got it. I hope I did something wrong in input, I will check it