search

plazi / arcadia-project

2 stars 1 forks source link

South African Journal of Botany #226

Closed myrmoteras closed 1 year ago

myrmoteras commented 1 year ago

@CNaseband can you please check, whether you can write a template for South African Journal of Botany? Volume 133 backward is open access. https://www.sciencedirect.com/journal/south-african-journal-of-botany , and if so, get all to 2000? There are also older ones. but may be do this later?

CNaseband commented 1 year ago

At this point in time it is not yet possible. That one is published by Elsevier again, who use Amazon Services and hide their content behind a lot of JavaScript and crypto, just have a look at the appended URL portions that are calculated:

?X-Amz-Security-Token=IQoJb3JpZ2luX2VjEMH%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJGMEQCIHV6oSSa80HGkY8j5WUpZ8Fwyen8e0qg5hKhyPiNeMgLAiBFfoHgI%2FO%2F4pDe8ko9YtrbCaExVSKjNTHOz4GSaNT3%2BCq8BQjq%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F8BEAUaDDA1OTAwMzU0Njg2NSIMhctvkeHRsv1mhd4bKpAF8AtE8MXoMkQo7%2FP1REbJmp0oHnifDBVIWp4swW8yBPS%2FeOs280AyIUGYMmva%2F6hlBX12Xc1aHwP%2BLzCKBACf6Fok%2F8SAvYD3%2B%2FAd%2BwohAjSkrFVtRqxtrbvjmkgdIWk8%2FKxkNgF7%2B3cz9WJU7DAf4OHdXFCrM3zjuTfuE%2Fsl1xApOSzXpaqCVk7gK2vNjjiTgRuTL4m2bRVp8N08B8DrfMGINi1%2B56qw5nMKzwmqyJHHNacqTxlKpesXiJQ%2BEUdEYYRiYpaqItkBtFaTyHDqtKrS2nyfAYnCNNkMDeTwgSI%2B4szyPt3FYEmbGJQKMtblI2E34skUDNoqZuCyWjL%2FUuU2QoG1hAw6kAvEpZNI8Wgm9M3na%2FKwqofHYyj1D8BzZKznk7xMceIQInDTgTKOGYrYeL4HhywviyYBYD2r9NtLXzOp%2FvNm1ei%2FudYOcy6lV8FYoO1BzZHZczRjlwbkgHD4I1NnGRgrg%2BUMkLuaHlIeHVxkYchnLleAhkrh3ozHL4b9hp2yIc%2FnvUIHtGWILO9CADw5GLyHaXS026R01FJquNPhlRSt%2BVCI8Ze24S5f%2BQr0FAzRrb38G6pO3SGsrLba2tcosHAs5llLTGCYnwJ9bpmEg2nAdnSwX%2Fq36V6UTRr1nPwk%2F5LpExH9VxDQvcXRz1YIlixYfQYtubDIVhOLSyZqs6lyo3a%2B2cttM8r8awZifvornB7XSzhDjpeUD%2BxwDNFuPZcmCXMpJoNgCOOLrDwMVzjwZyhU7bshq%2BOfa7rn%2B1LAIQVCYwLHlbdaml0Qr%2Fc7A%2FYuQHZEOfBBYFCywzoLtv7H77y4qkQAhO52KMlYACqZx8CMNPB85nsVpp%2Bw%2Fsk429%2BjtwSLGqykt4kwgJO3owY6sgEJzQ%2BpjWQjWqYnWeTQ9wOVI43gg8hEMKnkWvCltBMRfPOtRYbdmagaMvB0oQkMfd4eoIoPkuMJaYScAI%2FNIrOpukfxoLdFWiLuji9mfQDcbrRDthfqE0zDRvPyC0TP1ggzcuCTsb9jVZKqCAEQnYOaqPQjUAzXSavKzRWDv6PT7LfSp88N8S80H1UtotcePCfFTtMVUs9%2B9XABDtYRRlXhC9UgiC6FwLWmMR%2BvqMbQm5kH&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230524T090835Z&X-Amz-SignedHeaders=host&X-Amz-Expires=299&X-Amz-Credential=ASIAQ3PHCVTYTWV2W7UE%2F20230524%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=79999b8d2ad2aa87b6643e34dd3e7bf39f49e8c66f3bd5d39efb6c755519f0ca&hash=2b6210fbbd913f7eb2cfbf6716fa82a4b3a876bb863da98d9d48e9c2364467b0&host=68042c943591013ac2b2430a89b270f6af2c76d8dfd086a07176afe7c76c2c61&pii=S0254629914001227&tid=spdf-ac979e06-7d92-4b98-82a8-ba80a8058baf&sid=5290d73f380b2443b25bd112cab5d1664e15gxrqb&type=client&tsoh=d3d3LnNjaWVuY2VkaXJlY3QuY29t&ua=0203570405525453575e&rr=7cc4651848618ff8&cc=de

I have an idea for a solution but it is a long shot from now, possibly taking 1 or 2 quaters. Currently affected by this are: Elsevier and ScienceDirect.

myrmoteras commented 1 year ago

why does it take so long?

CNaseband commented 1 year ago

It is fundamentally different from the other solutions. With open access it is usually enough to search for a link and see what is on the other side. (a PDF) In this case you are send to a calculation (which we can not perform), send through some other hoops and then at some time end up at the content. Technically it is still "access" by definition, but a quite douche one ~quite fitting Elsevier's reputation~ My way to solve this would be to start a normal browser window and trying to remote control it. This is quite likely to work, but a separate application, quite slow in comparison to my standing solution for others, likely not fit for a server environment and it would probably require some paid external programs. So all in all not too great.

CNaseband commented 1 year ago

Example

The link you are presented:

https://www.sciencedirect.com/science/article/pii/S0254629914001227/pdfft?md5=a3e882f3847d92ea1ff5ba824a48d04f&pid=1-s2.0-S0254629914001227-main.pdf

The actual link after being referred to other pages and websites 3 times: https://pdf.sciencedirectassets.com/273500/1-s2.0-S0254629914X00049/1-s2.0-S0254629914001227/main.pdf?X-Amz-Security-Token=IQoJb3JpZ2luX2VjEMH%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJIMEYCIQDXTPPdXsHdj2zeX%2BCQyq9eK5y0ZBdtbjLndAAIBpjGZwIhAP6nqYsSe31C0D8UdserAfSODfhm2KHy%2FE2zQ9ffWSwjKrsFCOn%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEQBRoMMDU5MDAzNTQ2ODY1IgxHJqQ5oJrdIuRMHoUqjwXzVosePfcyleCHJ1e0OJnAB%2B111Lo9GSte8uaqDNIaPMHXT9wGWMSaskf%2Fm0IONrBwqvglxfjxIyLWPILwWTU4%2BQYBljAQCnYFNl%2FgzZR1w1h%2FdeJ8mH12fgEUP4T6sDKiIeWlVRxibDxH1%2BOBGek46EJarqkKHZEoqCHdeqJj8q7ptlxTl4mvEmv3HVxUAIrJJf%2F23mYeISO3U9xn5sUDLqokE4%2BBFk6ybykt4qLstsNHtOLn2NB%2By1WFZW4CjGZwE5ynGQM54k6Au43UFBK%2FH8vHKeOFsn%2BzNFb38FFkOY3tYxKz86V5%2FCv%2BWz%2BR9%2BLNhqFGV5rXn%2BZ8iw%2Fjd5SHzZM70mq6znhBnVL6TbNy%2Fixt0J761iPiqdgZH75JeQtm22ag253K%2BaDG%2BlXS8otXA8MSIegu5RdpEQQeVAwPpUIzryyty%2BAQTYrZfhhrBg92hKy7AtqZSy%2BTLOhdYkdhn9e0NciJiKV45oorYRCClju9rISLW6DHbn4E5hRgC4lkABL7hiUcC3pfb1Cxy2ufm3foj3kcVBuFKXySD7DGQq235XL6ljFfvOW0KGPYk2D3i%2FDbOBkh1PXBkrhnGS2VR4R7Ni2MOSw7dUxqo8q7iN1eRjlawc2dx2RjFCv1sw43agyosK8DHOK4L6%2BQEG1dn1lwlBD80Phxngm3IInPh%2Foaq1RoG6euR3zNgYU%2FVQehLltqdsOpPV3QdbicNMfH%2BpUKP8V4rs8a7NI%2FPh2J4gR7X3nC19EKgun%2BTDYQv%2Bs6pRTWbDQxS69iExxon4sK%2FpIxrtt1bM2vMbRpmmkr%2FPa3xoMZBLv%2FRvSiupTv1SuIWz%2BYh0S0XO5Ep5%2BYErg2tp1ImfH91WpEtso6zvTTMOKRt6MGOrAB5QwuTRbx39BHwOkSRP6OT5ToNqlNTyRPNDfc4wY8gdKQjf%2BRm2JskPz0ODCB9MA2fsyrbG9yAhGUeH%2FVNPOXZB%2BAdNKcOLYxcPPFAUiTc1HXaHpn7bl%2F0wxHJgwx6nTTiCcMRx4Rz04BiSmAhD9EBFUpJbEgkF4ztSAQJhW7gjbYHT8Lpa%2BOqlaedEp0RGkBN8YDOWo2NQXpebv%2FZZQ4WbPSQtMUVHNBr68XRrz3cHM%3D&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20230524T094241Z&X-Amz-SignedHeaders=host&X-Amz-Expires=300&X-Amz-Credential=ASIAQ3PHCVTYW7KV3S52%2F20230524%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Signature=a5b9014f0b56f976ed76a6edab74e794ea65c0cf9ae72c8c91775df06c0537ee&hash=f9025ee556eb5a7bbd13b95bacdefb12113b1c2ca2e362d0b05172e1a23d0b04&host=68042c943591013ac2b2430a89b270f6af2c76d8dfd086a07176afe7c76c2c61&pii=S0254629914001227&tid=spdf-ab50f912-265f-4667-8940-ba952bd4a568&sid=17cc4ee571e4c44a827a1cb441650a3c15cagxrqb&type=client&tsoh=d3d3LnNjaWVuY2VkaXJlY3QuY29t&ua=0203570405525b515605&rr=7cc4970cc9f92c26&cc=de

Getting or even generating to first link? Easy! The second is crypto and without knowing the components its a bust.