Enhance job stats - Githubissues

finaldie / auto-news

A personal news aggregator to pull information from multi-sources + LLM (ChatGPT/Gemini/Ollama via LangChain) to help us reading efficiently with less noises, the sources including: Tweets, RSS, YouTube, Web Articles, Reddit, and personal Journal notes.

MIT License

519 stars 56 forks source link

Enhance job stats #8

Closed finaldie closed 1 year ago

finaldie commented 1 year ago

Major changes:

Collect job stats from each step for all the sources
Display stats when airflow job finished (new pulling DAG)

Upcoming:

Push stats into the local database and Notion database