Xtra-Computing / FedTree

A tree-based federated learning system (MLSys 2023)
https://fedtree.readthedocs.io/en/latest/index.html
Apache License 2.0
140 stars 38 forks source link

Error imputing more than 10 different data paths (files - .csv) #58

Closed WilliamLindskog closed 1 year ago

WilliamLindskog commented 1 year ago

Hi,

when running horizontal FL, I set several data files to data as in my previous issue. It would seem, when working with Forest Cover Type data set, that adding more than 10 different paths leads to:

*** stack smashing detected ***, terminated.

Is there a way to scale this beyond 10 different paths or am I mainly limited by my hardware?

Best regards, W

QinbinLi commented 1 year ago

Hi @WilliamLindskog ,

I have tried more than 10 paths and it works fine. Did you pull the latest version of FedTree? In a previous commit, I have increased the capacity for the parser. You may try to increase the size of val and rebuild the library and try again.

Junyi-99 commented 1 year ago

Hi, I also met the same problem.