Tishacy / SciDownl

An unofficial api for downloading papers from SciHub via DOI, PMID, title
MIT License
206 stars 43 forks source link

[BUG] Downloads twice #27

Open mpr1255 opened 10 months ago

mpr1255 commented 10 months ago

How can I stop it downloading twice??

➜  temp scidownl download --doi https://doi.org/10.1145/3375633
[INFO] | 2023/12/11 16:17:57 | Run scihub tasks. Tasks information:
[INFO] | 2023/12/11 16:17:57 |          DOI(s): ['https://doi.org/10.1145/3375633']
[INFO] | 2023/12/11 16:17:57 |          Output: /Users/ma/temp
[INFO] | 2023/12/11 16:17:57 |      SciHub Url: <auto.availability_first>
[INFO] | 2023/12/11 16:17:58 | Found 8 valid SciHub domains in total: ['http://sci-hub.ru', 'https://sci-hub.st', 'https://sci-hub.ru', 'https://sci-hub.mobi', 'http://sci-hub.mobi', 'https://sci-hub.se', 'http://sci-hub.se', 'http://sci-hub.st']
[INFO] | 2023/12/11 16:17:58 | Saved 8 SciHub domains to local db.
[INFO] | 2023/12/11 16:17:58 | Choose scihub url [0]: http://sci-hub.ru
[INFO] | 2023/12/11 16:17:58 | <- Request: scihub_url=http://sci-hub.ru, source=DoiSource[type=doi, id=doi.org/10.1145/3375633], proxies={}
[INFO] | 2023/12/11 16:18:00 | -> Response: status_code=200, content_length=7554
[INFO] | 2023/12/11 16:18:00 | * Extracted information: {'url': 'http://sci-hub.ru/downloads/2021-06-09/4a/beschastnikh2020.pdf', 'title': 'Visualizing Distributed System Executions. ACM Transactions on Software Engineering and Methodology, 29(2), 1–38'}
100% [==================================================] 2522115/2522115
[INFO] | 2023/12/11 16:18:03 | ↓ Successfully download the url to: Visualizing Distributed System Executions. ACM Transactions on Software Engineering and Methodology, 29(2), 1–38.pdf
[INFO] | 2023/12/11 16:18:03 | Choose scihub url [0]: http://sci-hub.ru
[INFO] | 2023/12/11 16:18:03 | <- Request: scihub_url=http://sci-hub.ru, source=DoiSource[type=doi, id=doi.org/10.1145/3375633], proxies={}
[INFO] | 2023/12/11 16:18:05 | -> Response: status_code=200, content_length=7554
[INFO] | 2023/12/11 16:18:05 | * Extracted information: {'url': 'http://sci-hub.ru/downloads/2021-06-09/4a/beschastnikh2020.pdf', 'title': 'Visualizing Distributed System Executions. ACM Transactions on Software Engineering and Methodology, 29(2), 1–38'}
100% [==================================================] 2522115/2522115
[INFO] | 2023/12/11 16:18:06 | ↓ Successfully download the url to: Visualizing Distributed System Executions. ACM Transactions on Software Engineering and Methodology, 29(2), 1–38.pdf
➜  temp n
➜  temp scidownl domain.list
+----------------------+----------------+---------------+
| Url                  |   SuccessTimes |   FailedTimes |
|----------------------+----------------+---------------|
| http://sci-hub.ru    |              2 |             0 |
| https://sci-hub.st   |              0 |             0 |
| https://sci-hub.ru   |              0 |             0 |
| https://sci-hub.mobi |              0 |             0 |
| http://sci-hub.mobi  |              0 |             0 |
| https://sci-hub.se   |              0 |             0 |
| http://sci-hub.se    |              0 |             0 |
| http://sci-hub.st    |              0 |             0 |
+----------------------+----------------+---------------+
➜  temp scidownl download --doi https://doi.org/10.1145/3375633 --out 10.1145_3375633.pdf
[INFO] | 2023/12/11 16:20:50 | Run scihub tasks. Tasks information:
[INFO] | 2023/12/11 16:20:50 |          DOI(s): ['https://doi.org/10.1145/3375633']
[INFO] | 2023/12/11 16:20:50 |          Output: 10.1145_3375633.pdf
[INFO] | 2023/12/11 16:20:50 |      SciHub Url: <auto.availability_first>
[INFO] | 2023/12/11 16:20:50 | Choose scihub url [0]: http://sci-hub.ru
[INFO] | 2023/12/11 16:20:50 | <- Request: scihub_url=http://sci-hub.ru, source=DoiSource[type=doi, id=doi.org/10.1145/3375633], proxies={}
[INFO] | 2023/12/11 16:20:52 | -> Response: status_code=200, content_length=7554
[INFO] | 2023/12/11 16:20:52 | * Extracted information: {'url': 'http://sci-hub.ru/downloads/2021-06-09/4a/beschastnikh2020.pdf', 'title': 'Visualizing Distributed System Executions. ACM Transactions on Software Engineering and Methodology, 29(2), 1–38'}
100% [==================================================] 2522115/2522115
[INFO] | 2023/12/11 16:20:54 | ↓ Successfully download the url to: 10.1145_3375633.pdf
[INFO] | 2023/12/11 16:20:54 | Choose scihub url [0]: http://sci-hub.ru
[INFO] | 2023/12/11 16:20:54 | <- Request: scihub_url=http://sci-hub.ru, source=DoiSource[type=doi, id=doi.org/10.1145/3375633], proxies={}
[INFO] | 2023/12/11 16:20:55 | -> Response: status_code=200, content_length=7554
[INFO] | 2023/12/11 16:20:55 | * Extracted information: {'url': 'http://sci-hub.ru/downloads/2021-06-09/4a/beschastnikh2020.pdf', 'title': 'Visualizing Distributed System Executions. ACM Transactions on Software Engineering and Methodology, 29(2), 1–38'}
100% [==================================================] 2522115/2522115
[INFO] | 2023/12/11 16:20:57 | ↓ Successfully download the url to: 10.1145_3375633.pdf
➜  temp n
➜  temp scidownl domain.list
+----------------------+----------------+---------------+
| Url                  |   SuccessTimes |   FailedTimes |
|----------------------+----------------+---------------|
| http://sci-hub.ru    |              4 |             0 |
| https://sci-hub.st   |              0 |             0 |
| https://sci-hub.ru   |              0 |             0 |
| https://sci-hub.mobi |              0 |             0 |
| http://sci-hub.mobi  |              0 |             0 |
| https://sci-hub.se   |              0 |             0 |
| http://sci-hub.se    |              0 |             0 |
| http://sci-hub.st    |              0 |             0 |
+----------------------+----------------+---------------+
➜  temp scidownl download --doi 10.1016/j.vascn.2018.01.499 --out test.pdf
[INFO] | 2023/12/11 16:22:19 | Run scihub tasks. Tasks information:
[INFO] | 2023/12/11 16:22:19 |          DOI(s): ['10.1016/j.vascn.2018.01.499']
[INFO] | 2023/12/11 16:22:19 |          Output: test.pdf
[INFO] | 2023/12/11 16:22:19 |      SciHub Url: <auto.availability_first>
[INFO] | 2023/12/11 16:22:19 | Choose scihub url [0]: http://sci-hub.ru
[INFO] | 2023/12/11 16:22:19 | <- Request: scihub_url=http://sci-hub.ru, source=DoiSource[type=doi, id=10.1016/j.vascn.2018.01.499], proxies={}
[INFO] | 2023/12/11 16:22:21 | -> Response: status_code=200, content_length=7786
[INFO] | 2023/12/11 16:22:21 | * Extracted information: {'url': 'http://sci-hub.ru/tree/39/25/3925104e34c91e178a498a5ed59f4dba.pdf', 'title': 'Echocardiography and contractility indices simultaneously evaluated in telemetered beagle dogs  A HESI sponsored cross company evaluation. Journal of Pharmacological and Toxicological Methods, 93, 15'}
100% [==================================================] 70282/70282
[INFO] | 2023/12/11 16:22:22 | ↓ Successfully download the url to: test.pdf
[INFO] | 2023/12/11 16:22:22 | Choose scihub url [0]: http://sci-hub.ru
[INFO] | 2023/12/11 16:22:22 | <- Request: scihub_url=http://sci-hub.ru, source=DoiSource[type=doi, id=10.1016/j.vascn.2018.01.499], proxies={}
[INFO] | 2023/12/11 16:22:23 | -> Response: status_code=200, content_length=7786
[INFO] | 2023/12/11 16:22:23 | * Extracted information: {'url': 'http://sci-hub.ru/tree/39/25/3925104e34c91e178a498a5ed59f4dba.pdf', 'title': 'Echocardiography and contractility indices simultaneously evaluated in telemetered beagle dogs  A HESI sponsored cross company evaluation. Journal of Pharmacological and Toxicological Methods, 93, 15'}
100% [==================================================] 70282/70282
[INFO] | 2023/12/11 16:22:24 | ↓ Successfully download the url to: test.pdf
➜  temp scidownl domain.list
+----------------------+----------------+---------------+
| Url                  |   SuccessTimes |   FailedTimes |
|----------------------+----------------+---------------|
| http://sci-hub.ru    |              6 |             0 |
| https://sci-hub.st   |              0 |             0 |
| https://sci-hub.ru   |              0 |             0 |
| https://sci-hub.mobi |              0 |             0 |
| http://sci-hub.mobi  |              0 |             0 |
| https://sci-hub.se   |              0 |             0 |
| http://sci-hub.se    |              0 |             0 |
| http://sci-hub.st    |              0 |             0 |
+----------------------+----------------+---------------+