search

ciepielajan / Vaex--NY-CityCabs-data-2009-2020

0 stars 0 forks source link

Inspiracje #2

Open ciepielajan opened 3 years ago

ciepielajan commented 3 years ago

Veax flask dash dashboard https://medium.com/plotly/interactive-and-scalable-dashboards-with-vaex-and-dash-9b104b2dc9f0

ciepielajan commented 3 years ago

Merge Multiple CSV with different column name but same definition

https://stackoverflow.com/questions/55698344/merge-multiple-csv-with-different-column-name-but-same-definition

parsers = {
   "schema1": lambda f: pd.read_csv(f,skiprows=1,header=None,names=['id','name','value'],usecols=[0,1,2]),
   "schema2": lambda f: pd.read_csv(f,skiprows=1,header=None,names=['id','value','name'],usecols=[0,1,3]) 
}

map = {
    "file2.csv": "schema2",
    "file1.csv": "schema1"}

pd.concat([parsers[v](k) for k,v in map.items()], sort=False)
ciepielajan commented 3 years ago

zbiór przydatnych funkcji vaex

https://www.kdnuggets.com/2021/05/vaex-pandas-1000x-faster.html