Closed bjohas closed 6 years ago
This is working for me:
$ ./translate_url 'https://www.sciencedirect.com/search?qs=TVET%20Africa&show=50&sortBy=relevance'
{
"url": "https://www.sciencedirect.com/search?qs=TVET%20Africa&show=50&sortBy=relevance",
"session": "B51H2G9fZtPfZdN",
"items": {
"https://www.sciencedirect.com/science/article/pii/S1877042815008873": "Design and Development Performance-based into Mobile Learning for TVET",
"https://www.sciencedirect.com/science/article/pii/S0738059306000770": "To vocationalise or not to vocationalise? Perspectives on current trends and issues in technical and vocational education and training (TVET) in Africa",
"https://www.sciencedirect.com/science/article/pii/S187704281504759X": "Employability Skills in TVET Curriculum in Nigeria Federal Universities of Technology",
[…]
Apologies for being unclear - it's not the first query, but the 2nd query with data retrieval that fails.
E.g. this command:
curl -d 'https://www.sciencedirect.com/search?qs=TVET&show=50&sortBy=relevance' -H 'Content-Type: text/plain' http://127.0.0.1:1969/web > temp.json
curl -H 'Content-Type: application/json' --data @temp.json http://127.0.0.1:1969/web
(The show=50 is important.) I cannot see a missing title in temp.json.
This query also fails (and only returns 9 items, which may make it easier to analyse):
curl -d 'https://www.sciencedirect.com/search?qs=TVET%20Mozambique&show=25&sortBy=relevance' -H 'Content-Type: text/plain' http://127.0.0.1:1969/web > temp.json
curl -H 'Content-Type: application/json' --data @temp.json http://127.0.0.1:1969/web
It's just a translator error that fails in the client as well:
https://www.sciencedirect.com/science/article/pii/S0738059304001671
For this query (and others) https://www.sciencedirect.com/search?qs=TVET%20Africa&show=50&sortBy=relevance
I get