The FutbinCrawler is a Python application designed to automate the process of fetching and updating player prices from the Futbin website based on a list of player names provided in a CSV file.
CSV Input: The application reads a CSV file containing a list of player names to fetch prices for.
Web Scraping: Utilizes Selenium for web scraping to extract player prices from the Futbin website.
Headless Mode: Supports headless mode for running the web browser in the background without a visible GUI.
User-Agent Spoofing: Configurable option to spoof the user-agent, making the requests appear more like a regular browser.
Clone the Repository:
git clone https://github.com/parsarmx/futbin.git
cd futbin/
Install Dependencies:
pip install -r requirements.txt
Download WebDriver: Download the appropriate WebDriver (e.g., ChromeDriver) and place it in the project directory.
Configuration message me to get the .env file
Prepare CSV File: Create a CSV file with a single column containing the player names you want to fetch prices for. there is a template in 'client' dir
Run the Script:
python main.py