i am trying to perform the left join operation on these two dataframes (df1 = df1.LeftJoin(df2.Select([]string{"col1","col2","col3", "col4", "col5"}), "col1", "col2")) .where df1 consists of around 50k rows and df2 consists of around 91k rows.but it is taking around 19 minutes to complete this left join operation.is there any way to optimize the execution time of this operation or am i doing it in a wrong way?
any suggestions on this performance issue would be great?
hi,
i am trying to perform the left join operation on these two dataframes (df1 = df1.LeftJoin(df2.Select([]string{"col1","col2","col3", "col4", "col5"}), "col1", "col2")) .where df1 consists of around 50k rows and df2 consists of around 91k rows.but it is taking around 19 minutes to complete this left join operation.is there any way to optimize the execution time of this operation or am i doing it in a wrong way?
any suggestions on this performance issue would be great?