Added support for downloading files from a specific website.

[rishabhnambiar]

I have added a 'site:' parameter for the search query which filters results from the given website only. Fixes #6

Example: ctdl python -w=github.com will download pdfs only from github.com.

• [x] CLI argument as -w for setting the specific website.
• [x] GUI changes
• [x] Customize downloads from github.com by changing /blob/ to /raw/

[nikhilkumarsingh]

Please modify the print statement at line number 155 in ctdl.py .

[nikhilkumarsingh]

I think we need to customize ctdl for downloading files from github.com . For example, Google will return links like this: https://github.com/emilmont/Artificial-Intelligence-and-Machine-Learning/blob/master/ML/ex8/ex8.pdf

But this is a HTML page. Actual raw data is at this link: https://github.com/emilmont/Artificial-Intelligence-and-Machine-Learning/raw/master/ML/ex8/ex8.pdf

So, you will need to replace /blob/ with /raw/ in URLs received from search function if website is set to github.com .

[rishabhnambiar]

Oh! Nice catch, I will fix that issue now. I have also added the GUI changes @nikhilkumarsingh.

[rishabhnambiar]

@nikhilkumarsingh, I have added support for github.com. I have checked the url for github.com and corrected it in the validate_links() function after the links have been validated. Any other issues?

[nikhilkumarsingh]

You can make the link validation generic. No need to send website name because github results can appear in general cases as well.

[rishabhnambiar]

Haha yes sorry I don't know how I missed that, It's done! @nikhilkumarsingh

[nikhilkumarsingh]

Line 100, gquery = "filetype:{0} {1} site:{2}".format(file_type, query, website) can be improved as: gquery = "filetype:{0} site:{1} {2}".format(file_type, website, query)

[rishabhnambiar]

@nikhilkumarsingh, Is this correct? I checked for NoneType and then declared the query accordingly.

[nikhilkumarsingh]

Please make changes only to ctdl.py . Just revert your commits in gui.py. PR #8 will cover the GUI modifications since it also fixes some bugs.

[rishabhnambiar]

Yes okay, I've reverted the changes in gui.py.

[nikhilkumarsingh]

Set a message that "No files found" if no valid links are obtained.

[rishabhnambiar]

I set the message, but it still shows "Download complete." from downloader.py To make that go away, I'll have to import ctdl in downloader. Should I do it?

[nikhilkumarsingh]

Why use downloader.py if no valid links are found? You can simply show a message and do sys.exit() .

[rishabhnambiar]

Done!