barun-saha / slide-deck-ai

Co-create a PowerPoint presentation with Generative AI
https://huggingface.co/spaces/barunsaha/slide-deck-ai
MIT License
65 stars 11 forks source link

Step numbers depicted rather than relevant icons #31

Closed barun-saha closed 2 months ago

barun-saha commented 2 months ago

In the icons slide, sometimes step numbers, e.g., 2, are used as icons. It would be helpful to display a more relevant icon.

barun-saha commented 2 months ago

The LLM is provided a list of available icons and is prompted to select from them. However, sometimes the LLM generates new names, which (i.e., icon files) are non-existent. In such scenarios, the item number is displayed as the icon. (The icons for numbers 0 through 9 are available).

An alternative was explored, where the LLM was prompted to generate the icon names independently, without referring to any list. When creating the slides, those names were compared with existing file names, and the ones with the highest similarity were chosen. However, since the available list of icons is small, the chosen icons often had less relevance to the target names. So, a similarity-based selection does not seem very useful. The other alternative is to combine both the approaches: select an icon based on highest similarity when the generated (file) name does not exist.

barun-saha commented 2 months ago

The last approach is used and deployed for the time being. When the LLM generates an icon name unavailable to this application, a similar icon is used instead.