-Implemented logic to remove deduplicate URLs from scraped Telegram channels.
-Introduced functionality to save URLs to a Master CSV files (total_urls.csv) in root directory to be used in other scripts.
-Included capability to update a Master CSV file (total_urls.csv) with all unique URLs from multiple channels.
-Added print statements to display the number of URLs scrapped, how many new URLs were added and total URLs in both channel-specific and master CSV files after each update.
Error Handling:
-Improved error handling to skip invalid Telegram URLs and handle exceptions gracefully during scraping.
Enhancements:
-Optimized file handling by appending new URLs to existing files and updating without duplicates.
Refactoring and Cleanup:
-Removed unnecessary dependencies (like Pandas) to streamline the script.
-Implemented logic to remove deduplicate URLs from scraped Telegram channels. -Introduced functionality to save URLs to a Master CSV files (total_urls.csv) in root directory to be used in other scripts. -Included capability to update a Master CSV file (total_urls.csv) with all unique URLs from multiple channels. -Added print statements to display the number of URLs scrapped, how many new URLs were added and total URLs in both channel-specific and master CSV files after each update.
-Improved error handling to skip invalid Telegram URLs and handle exceptions gracefully during scraping.
-Optimized file handling by appending new URLs to existing files and updating without duplicates.
-Removed unnecessary dependencies (like Pandas) to streamline the script.