benmiroglio / pymatch

MIT License
276 stars 129 forks source link

Matcher can not use spark data frame #49

Open yiwuxing opened 3 years ago

yiwuxing commented 3 years ago

when i use Matcher method test and control parameter need pd.DataFrame,but when I query by hive, my data is sparkdataframe,and it is too big can't use to_pandas. how can I use, when my data is sparkdataframe?