SocialComplexityLab / life2vec

MIT License
479 stars 67 forks source link

Model weights #2

Closed charlielito closed 6 months ago

charlielito commented 8 months ago

Are you planning to release the model weights?

SocialComplexityLab commented 8 months ago

We want to share as much data as possible – to be as open as possible, but we also have to ensure the privacy of people in the study, so the answer is “perhaps”: we need to do some more work to understand what we we can share and what we cannot.

From: Carlos Andrés Álvarez Restrepo @.> Date: Tuesday, December 26, 2023 at 6:58 PM To: SocialComplexityLab/life2vec @.> Cc: Subscribed @.***> Subject: [SocialComplexityLab/life2vec] Model weights (Issue #2)

Are you planning to release the model weights?

— Reply to this email directly, view it on GitHubhttps://github.com/SocialComplexityLab/life2vec/issues/2, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHM64POHI44FQW2T5LU2IYTYLMF2XAVCNFSM6AAAAABBDPYDYOVHI2DSMVQWIX3LMV43ASLTON2WKOZSGA2TMNRQGAYTMOI. You are receiving this because you are subscribed to this thread.Message ID: @.***>

matiasfreitas commented 8 months ago

I would like to have also the model weights. The dataset would be amazing, but I think it isn't possible due to privacy concerns.

carlomarxdk commented 6 months ago

There are no plans to publicly release the model weights, since if you have them and look at the gradients of the model - you can reconstruct chunks of the training dataset. We might release weights of the follow up models if we manage to include some kind of privacy preserving mechanism during the pretraining stage - but so far, life2vec model does not have any. Meanwhile, you can request an access to the model weights and data via https://www.dst.dk/en/TilSalg/Forskningsservice/Dataadgang.

You can find the simple implementation of the model with the dummy data at https://github.com/carlomarxdk/life2vec-light.