michelle123lam / lloom

Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM (CHI 2024 paper). LLooM automatically surfaces high-level concepts to analyze unstructured text.
https://stanfordhci.github.io/lloom
BSD 3-Clause "New" or "Revised" License
60 stars 14 forks source link

Fix index issues in scoring #9

Closed priyanmuthu closed 5 months ago

priyanmuthu commented 5 months ago

When concatenating dataframes, the index is preserved. In the case of concatenating scores into dataframes, it is better to ignore_index since all the incoming dataframes have the same index. This causes a lot of issues, when doing more analysis using the score_df.

priyanmuthu commented 5 months ago

Though this a simple change, it took me hours to figure out -- maybe because I'm bad with dataframes.