NyanNyanovich / nyan

Automatic news aggregator in Telegram / Автоматический агрегатор новостей в Телеграме
https://t.me/nyannews
Apache License 2.0
184 stars 27 forks source link
aggregator clustering embeddings news news-aggregator newsfeed newsfeed-aggregator python telegram telegram-channel

НЯН

Tests Status https://t.me/nyannews License

изображение

НЯН (Nyan) is a news aggregator that scrapes news from different Telegram channels, clusters similar posts, and forms a united feed. All sources are split into several groups, so anyone can understand whether they can trust them.

Channel itself: NyanNews

Extensive description (in Russian): Whitepaper

Detailed instruction (in Russian): Как поднять свой НЯН

Install

Install git and pip

sudo apt-get install git python3-pip

Clone repo

git clone https://github.com/NyanNyanovich/nyan

Install Python requirements

pip3 install -r requirements.txt

Download models

bash download_models.sh

Install Docker and Docker Compose.

Provide Telegram API credentials to configs/client_config.json.

Run

Run Mongo container

docker-compose up

Run crawler

bash crawl.sh

Run server

bash send.sh