search

8080labs / pyforest

pyforest - feel the bliss of automated imports
https://8080labs.com
MIT License
1.1k stars 196 forks source link

Incompatible with dask in processes scheduler #26

Closed mortoys closed 4 months ago

mortoys commented 4 years ago 
from pyforest import *
import dask

def inc1(a):
    return a + 1

def inc2(a):
    return np.add(a, 1)

print(dask.compute(map(dask.delayed(inc1), [1,2,3]), scheduler='processes')[0])
print(dask.compute(map(dask.delayed(inc2), [1,2,3]), scheduler='processes')[0])

inc1 work, inc2 don't

FlorianWetschoreck commented 4 years ago

Thank you for the bug report. Can you please supply the output of the script? And on which operating system are you running the code?

mortoys commented 4 years ago 
Fatal Python error: Cannot recover from stack overflow.

Current thread 0x000000010d7d6dc0 (most recent call first):
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 204 in commit_frame
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 486 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 881 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rFatal Python error: qalpha/Cannot recover from stack overflow.l
ib/python3
.7/Current thread 0xp000000010d7d6dc0i (most recent call first):
c  File k"le./pUys"e, line r504s in /slauvmeo
t  File i"a/nU/smeirnsi/clounmdoat3i/aenn/vmsi/nriqcaolnpdhaa3//leinbv/sp/yrtqhaolnp3h.a7//lpiibc/kplyet.hpoyn"3, line .2047 in /cpoimcmkilte_.fprya"m, line e662
 in   File s"a/vUes_erresd/ulcuem
o  File t"i/aUns/emrisn/ilcuomnodtai3a/ne/nmvisn/ircqoanldpah3a//elnivbs//pryqtahlopnh3a./7l/ipbi/cpkylteh.opny3"., line 7486/ in psiacvkel
e  File ."p/yU"s, line e549r in ss/alvuem
o  File t"i/aUns/emrisn/ilcuomnodtai3a/ne/nmvisn/ircqoanldpah3a//elnivbs//pryqtahlopnh3a./7l/ipbi/cpkylteh.opny3"., line 7881/ in p_ibcaktlceh._psye"t, line i882t in e_mbsa
t  File c"h/_Usseetrist/elmusm
o  File t"i/aUns/emrisn/ilcuomnodtai3a/ne/nmvisn/ircqoanldpah3a//elnivbs//pryqtahlopnh3a./7l/ipbi/cpkylteh.opny3"., line 7856/ in psiacvkel_edict
  File ".py", line 856 in save_dict
  File "/Us/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y504" in , line s504a in vsea
v  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y662" in , line s662a in vsea_vree_druecdeu
c  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y549" in , line s549a in vsea
v  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y882" in , line _882b in a_tbcaht_cshe_tsietteimtse
m  File s"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y856" in , line s856a in vsea_vdei_cdti
c  File t"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y504" in , line s504a in vsea
v  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y662" in , line s662a in vsea_vree_druecdeu
c  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y549" in , line s549a in vsea
v  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vsr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "882, line  in 882_ in b_abtacthc_hs_esteittietmesm
s  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "856, line  in 856s in asvaev_ed_idcitc
t  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "504, line  in 504s in asvaev
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "662, line  in 662s in asvaev_er_erdeudcuec
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaiann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 549549 in  in ssaavvee

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 882882 in  in __bbaattcchh__sseettiitteemmss

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 856856 in  in ssaavvee__ddiicctt

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 504504 in  in ssaavvee

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 662662 in  in ssaavvee__rreedduuccee

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 549549 in  in ssaavvee

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhoonn33..77//ppiicckkllee..ppyy"", line , line 882882 in  in __bbaattcchh__sseettiitteemmss

  File   File ""//UUsseerrss//lluummoottiiaann//mmiinniiccoonnddaa33//eennvvss//rrqqaallpphhaa//lliibb//ppyytthhono3n.37./7p/ipcikclkel.ep.yp"y, line "856, line  in 856s in asvaev_ed_idcitc
t  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "504, line  in 504s in asvaev
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "662, line  in 662s in asvaev_er_erdeudcuec
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "549, line  in 549s in asvaev
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "882, line  in 882_ in b_abtacthc_hs_esteittietmesm
s  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "856, line  in 856s in asvaev_ed_idcitc
t  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "504, line  in 504s in asvaev
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "662, line  in 662s in asvaev_er_erdeudcuec
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.ep.yp"y, line "549, line  in 549s in asvaev
e  File
"  File /"U/sUesresr/sl/ulmuomtoitaina/nm/imniinciocnodnad3a/3e/nevnsv/sr/qraqlaplhpah/al/ilbi/bp/yptyhtohno3n.37./7p/ipcikclkel.pey."p, line y882" in , line _882b in a_tbcaht_cshe_tsietteimtse
m  File s"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y856" in , line s856a in vsea_vdei_cdti
c  File t"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y504" in , line s504a in vsea
v  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y662" in , line s662a in vsea_vree_druecdeu
c  File e"
/  File U"s/eUrsse/rlsu/mloutmioatni/amni/nmiicnoincdoan3d/ae3n/vesn/vrsq/arlqpahlap/hlai/bl/ipby/tphyotnh3o.n73/.p7i/cpkilcek.lpey."p, line y549" in , line s549a in vsea
v  File e"
/  File U"s/eUrsse/lrusm/oltuimaont/imainn/imcionnidcao3n/dean3v/se/nrvqsa/lrpqhaal/plhiab//lpiybt/hpoynt3h.o7n/3p.i7c/kpliec.kplye"., line p882y in "_, line b882a in t_cbha_tsceht_isteetmist
e  File m"s/
U  File s"e/rUss/elrusm/oltuimaont/imainn/imcionnidcao3n/dean3v/se/nrvqsa/lrpqhaal/plhiab//lpiybt/hpoynt3h.o7n/3p.i7c/kpliec.kplye"., line p856y in "sa, line v856e in _sdaivcet_
d  File i"c/tU
s  File e"r/sU/sleurmso/tliuamno/tmiianni/cmoinndiac3o/nednav3s//ernqvasl/prhqaa/llpihba//plyitbh/opny3t.h7o/np3i.c7k/lpei.cpkyl"e, line .504p in ys"a, line v504e in
s  File a"v/eU
s  File e"r/sU/sleurmso/tliuamno/tmiianni/cmoinndiac3o/nednav3s//ernqvasl/prhqaa/llpihba//plyitbh/opny3t.h7o/np3i.c7k/lpei.cpkyl"e, line .662p in ys"a, line v662e in _sraevdeu_cree
d  File u"c/eU
s  File e"r/sU/sleurmso/tliuamno/tmiianni/cmoinndiac3o/nednav3s//ernqvasl/prhqaa/llpihba//plyitbh/opny3t.h7o/np3i.c7k/lpei.cpkyl"e, line .549p in ys"a, line v549e in
s  File a"v/eU
s  File e"r/sU/sleurmso/tliuamno/tmiianni/cmoinndiac3o/nednav3s//ernqvasl/prhqaa/llpihba//plyitbh/opny3t.h7o/np3i.c7k/lpei.cpkyl"e, line .882p in y_"b, line a882t in c_hb_astecthi_tseemtsi
t  File e"m/sU
s  File e"r/sU/sleurmso/tliuamno/tmiianni/cmoinndiac3o/nednav3s//ernqvasl/prhqaa/llpihba//plyitbh/opny3t.h7o/np3i.c7k/lpei.cpkyl"e, line .856p in ys"a, line v856e in _sdaivcet_
d  File i"c/tU
s  File e"r/sU/sleurmso/tliuamno/tmiianni/cmoinndiac3o/nednav3s//ernqvasl/prhqaa/llpihba//plyitbh/opny3t.h7o/np3i.c7k/lpei.cpkyl"e, line .504p in ys"a, line v504e in
s  File a"v/eU
s  ...
ers/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalphFatal Python error: a/lib/pCannot recover from stack overflow.y
thon3.7/pi
ckleCurrent thread 0x.000000010d7d6dc0p (most recent call first):
y  File "", line 549 in /sUasveer
s  File /"l/uUmsoetrisa/nl/ummiontiicaonn/dmai3n/iecnovnsd/ar3q/aelnpvhsa//rlqiabl/pphyat/hloinb3/.p7y/tphiocnk3l.e7./ppyi"c, line k204l in ec.opmym"i, line t882_ in f_rbaamtec
h  File _"s/eUtsietresm/sl
u  File m"o/tUisaenr/sm/ilnuimcootnidaan3//meinnvisc/ornqdaal3p/hean/vlsi/br/qpayltphhao/nl3i.b7//ppyitchkolne3..p7y/"p, line i486c in kslaev.ep
y  File "", line /856U in ssearvse/_lduimcott
i  File a"n//Umsienrisc/olnudmao3t/ieannv/sm/irnqiaclopnhdaa/3l/iebn/vpsy/trhqoanl3p.h7a//pliicbk/lpey.tphyo"n, line 3881. in 7_/bpaitcckhl_es.eptyi"t, line e504m in ss
a  File v"e/
U  File s"e/rUss/elrusm/oltuimaont/imainn/imcionnidcao3n/dean3v/se/nrvqsa/lrpqhaal/plhiab//lpiybt/hpoynt3h.o7n/3p.i7c/kpliec.kplye"., line p856y in "s, line a662v in es_adviec_tr
e  File d"u/cUes
e  File r"s//Ulsuemrost/ilaunm/omtiinainc/omnidnai3c/oenndvas3//reqnavlsp/hraq/allipbh/ap/yltihbo/np3y.t7h/opni3c.k7l/ep.ipcyk"l, line e504. in psya"v, line e549
 in   File s"a/vUes
e  File r"s//Ulsuemrost/ilaunm/omtiinainc/omnidnai3c/oenndvas3//reqnavlsp/hraq/allipbh/ap/yltihbo/np3y.t7h/opni3c.k7l/ep.ipcyk"l, line e662. in psya"v, line e882_ in r_ebdautcceh
_  File s"e/tUisteermss/
l  File u"m/oUtsiearns//mliunmioctoinadna/3m/iennivcso/nrdqaa3l/pehnav/sl/irbq/aplypthhao/nl3i.b7//ppyitchkolne3..p7y/"p, line i549c in kslaev.ep
y  File ""/, line U856s in esras/vleu_mdoitcita
n/  File m"i/nUisceornsd/al3u/meontvisa/nr/qmailnpihcao/nldiab3//peyntvhso/nr3q.a7l/pphiac/kllieb./ppyy"t, line h882o in n_3b.a7t/cphi_cskeltei.tpeyms"
, line   File 504" in /sUasveer
s  File /"l/uUmsoetrisa/nl/umimnoitcioannd/am3i/neincvosn/draq3a/lepnhvas//lriqba/lppyhtah/olni3b./7p/yptihcoknl3e..7p/yp"i, line c856k in lsea.vpey_"d, line i662c in ts
a  File v"e/_Urseedrusc/el
u  File m"o/tUisaenr/sm/ilnuimcootnidaan3//meinnvisc/ornqdaal3p/hean/vlsi/br/qpayltphhoan/3l.i7b//ppiyctkhloen.3p.y7"/, line p504i in cskalvee.
p  File y""/, line U549s in esrasv/el
u  File m"o/tUisaenr/sm/ilnuimcootnidaan3//meinvnsi/cornqdaal3p/hean/vlsi/b/pythornq3a.l7p/hpai/clkilbe/.ppyyt"h, line o662n in 3s.a7v/ep_ircekdluec.ep
y  File "", line /882U in s_ebrast/clhu_msoettiiatne/mmsi
n  File i"c/oUndsae3r/se/nlvusm/ortqiaalnp/hmai/nliicbo/npdyat3h/oenn3v.s7//rpqiaclkplhea./plyi"b, line /549p in ystahvoen
3  File ."7//Upsiecrksl/el.upmyo"t, line i856a in ns/amvien_idciocntd
a  File 3"//eUnsvesr/sr/qlaulmpohtai/alni/bm/ipnyitchoonnd3a.37//epnivcsk/lreq.aplyp"h, line a882/ in l_ibba/tpcyht_hsoent3i.t7e/mpsi
c  File k"l/eU.speyr"s, line /504l in usmaovtei
a  ...
n/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 662 in save_reduce
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 549 in save
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 882 in _batch_setitems
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 856 in save_dict
  File "/Users/lumotian/miniconda3/envs/rqalpha/lib/python3.7/pickle.py", line 504 in save

MacBook Pro macOS 10.15.1

mortoys commented 4 years ago

dask 2.8.1 pandas 0.25.3 pyforest 0.1.4 numpy 1.17.4

FlorianWetschoreck commented 4 years ago

Thank you for the bug report. We discussed this internally but had no idea on how to even start working on this problem. If you can come up with a solution that would be great.

So long, we will flag this as "help wanted" and will see if someone comes up with a solution.

In the mean time, you can also just import np explicitely because it will overwrite pyforest. So, you should be able to use

from pyforest import *
import numpy as np

Does this work for you?

RafeyIqbalRahman commented 4 years ago

@lumyuto I ran your code on Google Colab and got the following error:

PicklingError: Could not pickle object as excessively deep recursion required.

This error is related to the Dask library itself.