Arabic Language Support

[DulayelNotaifi]

Description:

The current STORM code supports generating Arabic articles. I verified this by integrating the Bing API and GPT-4. The following command was used to generate Arabic articles:

python examples/run_storm_wiki_gpt.py \
    --output-dir $OUTPUT_DIR \
    --retriever bing \
    --do-research \
    --do-generate-outline \
    --do-generate-article \
    --do-polish-article

After inputting an Arabic title, The output was Arabic article, and I verified that Arabic articles function in the UI version too (screenshot attached).

However, there are some remaining challenges and areas for improvement:

• Arabic Input Support: The deployed version currently lacks support for Arabic input.
• UI Enhancements: Adjustments are needed to handle Right-to-Left (RTL) languages, resolving text alignment and display issues.
• Improvement of Arabic Article Quality: There is a need to further enhance the overall quality of the generated Arabic articles.

[shaoyijia]

Thanks for trying it out! It's very interesting to see you have an initial working version for Arabic.

The deployed version currently lacks support for Arabic input.

We don't plan to deploy multilingual version at present.

@DulayelNotaifi, Do you know any forum that we could probably reach out to more developers who know Arabic?

[DulayelNotaifi]

Unfortunately I don't know a specific forum