StephanAkkerman / FluentAI

Automating language learning with the power of Artificial Intelligence. This repository presents FluentAI, a tool that combines Fluent Forever techniques with AI-driven automation. It streamlines the process of creating Anki flashcards, making language acquisition faster and more efficient.
https://akkerman.ai/FluentAI/
MIT License
9 stars 1 forks source link

Evaluate fasttext performance for semantic sim. #45

Closed StephanAkkerman closed 3 weeks ago

StephanAkkerman commented 3 weeks ago
  1. Description:

    • Problem: We did not check which of the .bin files perform better

    • Solution: Test both for the evaluation

    • Prerequisites: None

  2. Tasks:

    • Add both .bin files to the eval of semantic sim.
  3. Additional context Add any other context or screenshots about the feature request here.

StephanAkkerman commented 3 weeks ago

Wiki Evaluation Results: method pearson_corr spearman_corr 0 glove 0.234448 0.226851 1 fasttext 0.394658 0.376460 2 minilm 0.382895 0.370939 3 spacy 0.148808 0.144997

default model method pearson_corr spearman_corr 0 fasttext 0.411245 0.39675