search

datavorous / yars

Yet Another Reddit Scrapper (without API keys) | Scrap search results, posts and images from subreddits filtered by hot, new etc and bulk download any user's data.
MIT License
21 stars 11 forks source link

Making the GUI version of the scraper. #5

Open alihassancods opened 1 month ago

alihassancods commented 1 month ago

I would like to create a GUI version of this scraper using the PyQt5 library in Python. Adding a graphical interface will make the scraper more user-friendly and visually appealing. After sometime, we can also integrate data visualization and analysis features to enhance its functionality. Please assign this task to me so I can begin working on it.

datavorous commented 1 month ago

@alihassancods Make sure the gui interface acts as a seperate module. Please mention what features do you wish to implement? My suggestions: Keep search boxes for subreddit/user search Add drop downs for top/hot/new categorisation Export buttons

How do you wish to render the text and images ? In a common area or different panels?

Would you mind to share the design you have in mind, using some rough layouts?

How do you plan to integrate the gui interface? Callable from within the code or something else?

Your idea sounds very cool, please give some more info!

Also assigned.

alihassancods commented 1 month ago

Thank you for assigning this task to me. I've noted your suggestions and have started planning the interface based on them. I'm considering creating a separate folder named 'app' alongside the 'yars' folder so that users can access the GUI via 'app/app.py'. Developers will still be able to use the 'yars' directory if they prefer to work directly with the module.

Regarding image rendering, I haven't finalized a plan yet. Currently, I'm thinking of exporting the image data as JSON with URLs. If users want to download the images, we could implement a bulk downloader feature.

I'll share the UI designs soon.

alihassancods commented 1 month ago

image Here is the initial UI design, I can also add the check buttons to filter the data to be exported in files.

datavorous commented 1 month ago

@alihassancods Looks good, will there be any preview of the extracted info? Maybe a markdown render? Otherwise it's pretty good as of now. A status/loading indicator and data transfer speed showing component would be nice too. You may start working on it now

alihassancods commented 1 month ago

Sure, I'm starting the development soon.

datavorous commented 1 month ago

@alihassancods any updates?

datavorous commented 1 month ago

@alihassancods It is preferable to use tkinter and tkbootstrap and not pyqt6, what are you using?