Mathscinet search is not working

tobiasdiez commented 1 year ago

JabRef version

Latest development branch build (please note build date below)

Operating system

Windows

Details on version and operating system

No response

Checked with the latest development build (copy version output from About dialog)

[X] I made a backup of my libraries before testing the latest development version.
[X] I have tested the latest development version and the problem persists

Steps to reproduce the behaviour

Search something with the Mathscinet fetcher. Get internal error for say url: https://mathscinet.ams.org/mathscinet/publications-search?pg7=ALLF&s7=query&r=1&extend=1&fmt=bibtex.

Appendix

The new API is as follows. https://mathscinet.ams.org/mathscinet/api/publications/format?formats=bib&ids=4085669 (with ids being comma separated) yields:

[{"paperId":4085669,"ams":null,"bib":"@article {MR4085669,\n    AUTHOR = {\\'{A}lvarez-C\\'{o}nsul, Luis and Garcia-Fernandez, Mario and\n              Garc\\'{\\i}a-Prada, Oscar},\n     TITLE = {On the {K}\\\"{a}hler-{Y}ang-{M}ills-{H}iggs equations},\n   JOURNAL = {Pure Appl. Math. Q.},\n  FJOURNAL = {Pure and Applied Mathematics Quarterly},\n    VOLUME = {15},\n      YEAR = {2019},\n    NUMBER = {4},\n     PAGES = {1181--1217},\n      ISSN = {1558-8599,1558-8602},\n   MRCLASS = {32Q15 (53C07 53C55)},\n  MRNUMBER = {4085669},\nMRREVIEWER = {Mancho\\ H.\\ Manev},\n       DOI = {10.4310/PAMQ.2019.v15.n4.a6},\n       URL = {https://doi.org/10.4310/PAMQ.2019.v15.n4.a6},\n}","tex":null,"end":null}]

and https://mathscinet.ams.org/mathscinet/api/publications/search?query=test&currentPage=1&pageSize=20&sort=newest yields

{"results":[{"mrnumber":4651864,"titles":{"title":"Test of conditional independence in factor models via Hilbert--Schmidt independence criterion","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62H15","description":"Hypothesis testing in multivariate analysis"},"authors":[{"id":null,"name":"Xu, Kai"},{"id":null,"name":"Cheng, Qing"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"199","volume2":null,"volume3":null,"number":null,"journal":{"id":3577,"shortTitle":"J. Multivariate Anal."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 105241"},"translatedPaging":null},"counts":null,"itemType":"Prelim","articleUrl":"https://doi.org/10.1016/j.jmva.2023.105241","openURL":null,"prePubl":null,"public":true},{"mrnumber":4644335,"titles":{"title":"Tests for group-specific heterogeneity in high-dimensional factor models","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62H25","description":"Factor analysis and principal components; correspondence analysis"},"authors":[{"id":null,"name":"Djogbenou, Antoine"},{"id":null,"name":"Sufana, Razvan"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"199","volume2":null,"volume3":null,"number":null,"journal":{"id":3577,"shortTitle":"J. Multivariate Anal."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 105233"},"translatedPaging":null},"counts":null,"itemType":"Prelim","articleUrl":"https://doi.org/10.1016/j.jmva.2023.105233","openURL":null,"prePubl":null,"public":true},{"mrnumber":4642501,"titles":{"title":"Significance test for semiparametric conditional average treatment effects and other structural functions","translatedTitle":null},"entryType":"J","primaryClass":null,"authors":[{"id":null,"name":"Zhou, Niwen"},{"id":null,"name":"Guo, Xu"},{"id":null,"name":"Zhu, Lixing"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"189","volume2":null,"volume3":null,"number":null,"journal":{"id":950,"shortTitle":"Comput. Statist. Data Anal."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 107839, 14 pp."},"translatedPaging":null},"counts":null,"itemType":"Expansion","articleUrl":"https://doi.org/10.1016/j.csda.2023.107839","openURL":null,"prePubl":null,"public":true},{"mrnumber":4640221,"titles":{"title":"Likelihood-type confidence regions for optimal sensitivity and specificity of a diagnostic test","translatedTitle":null},"entryType":"J","primaryClass":null,"authors":[{"id":null,"name":"Adimari, Gianfranco"},{"id":null,"name":"To, Duc-Khanh"},{"id":null,"name":"Chiogna, Monica"},{"id":null,"name":"Scatozza, Francesca"},{"id":null,"name":"Facchiano, Antonio"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"189","volume2":null,"volume3":null,"number":null,"journal":{"id":950,"shortTitle":"Comput. Statist. Data Anal."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 107840, 17 pp."},"translatedPaging":null},"counts":null,"itemType":"Expansion","articleUrl":"https://doi.org/10.1016/j.csda.2023.107840","openURL":null,"prePubl":null,"public":true},{"mrnumber":4630337,"titles":{"title":"A smoothed p-value test when there is a nuisance parameter under the alternative","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62G10","description":"Nonparametric hypothesis testing"},"authors":[{"id":818913,"name":"Hill, Jonathan B."}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"229","volume2":null,"volume3":null,"number":null,"journal":{"id":1809,"shortTitle":"J. Statist. Plann. Inference"},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 106096, 21 pp."},"translatedPaging":null},"counts":null,"itemType":"Pending","articleUrl":"https://doi.org/10.1016/j.jspi.2023.08.001","openURL":null,"prePubl":null,"public":true},{"mrnumber":4630306,"titles":{"title":"Non-destructive one-shot device test under step-stress experiment with lognormal lifetime distribution","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62N05","description":"Reliability and life testing"},"authors":[{"id":193047,"name":"Balakrishnan, Narayanaswamy"},{"id":1488973,"name":"Jaenada, María"},{"id":219638,"name":"Pardo, Leandro"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"437","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115483, 17 pp."},"translatedPaging":null},"counts":null,"itemType":"Pending","articleUrl":"https://doi.org/10.1016/j.cam.2023.115483","openURL":null,"prePubl":null,"public":true},{"mrnumber":4623934,"titles":{"title":"Calculations of fractional derivative option pricing models based on neural network","translatedTitle":null},"entryType":"J","primaryClass":{"code":"91G20","description":"Derivative securities (option pricing, hedging, etc.)"},"authors":[{"id":908061,"name":"Song, Lina"},{"id":1571960,"name":"Yu, Wang"},{"id":1572459,"name":"Tan, Yousheng"},{"id":1571536,"name":"Duan, Ke"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"437","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115462, 13 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115462","openURL":null,"prePubl":null,"public":true},{"mrnumber":4620034,"titles":{"title":"A computational macroscopic model of piezomagnetoelectric materials using generalized multiscale finite element method","translatedTitle":null},"entryType":"J","primaryClass":{"code":"74F15","description":"Electromagnetic effects in solid mechanics"},"authors":[{"id":1474267,"name":"Ammosov, Dmitry"},{"id":248181,"name":"Nasedkin, Andrey"},{"id":603349,"name":"Muratova, Galina"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"437","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115420, 22 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115420","openURL":null,"prePubl":null,"public":true},{"mrnumber":4618846,"titles":{"title":"An accelerated descent CG algorithm with clustering the eigenvalues for large-scale nonconvex unconstrained optimization and its application in image restoration problems","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65K05","description":"Numerical mathematical programming methods"},"authors":[{"id":1075057,"name":"Wang, Xiaoliang"},{"id":747150,"name":"Yuan, Gonglin"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"437","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115454, 19 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115454","openURL":null,"prePubl":null,"public":true},{"mrnumber":4618845,"titles":{"title":"Robust inference for destructive one-shot device test data under Weibull lifetimes and competing risks","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62N05","description":"Reliability and life testing"},"authors":[{"id":193047,"name":"Balakrishnan, N."},{"id":1256155,"name":"Castilla, E."}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"437","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115452, 12 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115452","openURL":null,"prePubl":null,"public":true},{"mrnumber":4618843,"titles":{"title":"An implicit splitting scheme with characteristic boundary conditions for compressible reactive flows on unstructured grids","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65M08","description":"Finite volume methods for initial value and initial-boundary value problems involving PDEs"},"authors":[{"id":1569633,"name":"Pries, Michael"},{"id":1381989,"name":"Fiolitakis, Andreas"},{"id":618529,"name":"Gerlinger, Peter"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"437","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115446, 17 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115446","openURL":null,"prePubl":null,"public":true},{"mrnumber":4618008,"titles":{"title":"Dynamics of a novel chaotic map","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65P20","description":"Numerical chaos"},"authors":[{"id":1569679,"name":"Sriram, Gokulakrishnan"},{"id":1569780,"name":"Ali, Ahmed M. Ali"},{"id":1290300,"name":"Natiq, Hayder"},{"id":1525529,"name":"Ahmadi, Atefeh"},{"id":1017511,"name":"Rajagopal, Karthikeyan"},{"id":1001156,"name":"Jafari, Sajad"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"436","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115453, 16 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115453","openURL":null,"prePubl":null,"public":true},{"mrnumber":4617049,"titles":{"title":"An alternating iterative method for solving the Cauchy problem for the Helmholtz equation in interior multiply connected domain","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65N06","description":"Finite difference methods for boundary value problems involving PDEs"},"authors":[{"id":647160,"name":"Feng, Lixin"},{"id":961665,"name":"Li, Yuan"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"529","volume2":null,"volume3":null,"number":"1","journal":{"id":3591,"shortTitle":"J. Math. Anal. Appl."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 127594, 14 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.jmaa.2023.127594","openURL":null,"prePubl":null,"public":true},{"mrnumber":4615442,"titles":{"title":"Distributed eQTL analysis with auxiliary information","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62P10","description":"Applications of statistics to biology and medical sciences; meta analysis"},"authors":[{"id":1568378,"name":"Fang, Zhiwen"},{"id":1154458,"name":"Li, Gen"},{"id":1128954,"name":"Li, Wendong"},{"id":365332,"name":"Pu, Xiaolong"},{"id":938195,"name":"Xiang, Dongdong"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"228","volume2":null,"volume3":null,"number":null,"journal":{"id":1809,"shortTitle":"J. Statist. Plann. Inference"},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"34--45"},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.jspi.2023.06.003","openURL":null,"prePubl":null,"public":true},{"mrnumber":4615441,"titles":{"title":"Model-free, monotone invariant and computationally efficient feature screening with data-adaptive threshold","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62H20","description":"Measures of association (correlation, canonical correlation, etc.)"},"authors":[{"id":1568188,"name":"Deng, Linsui"},{"id":1523837,"name":"Zhang, Yilin"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"228","volume2":null,"volume3":null,"number":null,"journal":{"id":1809,"shortTitle":"J. Statist. Plann. Inference"},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"23--33"},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.jspi.2023.06.006","openURL":null,"prePubl":null,"public":true},{"mrnumber":4612274,"titles":{"title":"Decoupled algorithms for non-linearly coupled reaction-diffusion competition model with harvesting and stocking","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65M22","description":"Numerical solution of discretized equations for initial value and initial-boundary value problems involving PDEs"},"authors":[{"id":1135030,"name":"Mohebujjaman, Muhammad"},{"id":1547604,"name":"Buenrostro, Clarisa"},{"id":1000139,"name":"Kamrujjaman, Md."},{"id":751367,"name":"Khan, Taufiquar"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"436","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115421, 21 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115421","openURL":null,"prePubl":null,"public":true},{"mrnumber":4610795,"titles":{"title":"Sparse polynomial chaos expansions for uncertainty quantification in thermal tomography","translatedTitle":null},"entryType":"J","primaryClass":{"code":"94A08","description":"Image processing (compression, reconstruction, etc.) in information and communication theory"},"authors":[{"id":985678,"name":"Sýkora, Jan"},{"id":1337571,"name":"Havelka, Jan"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"436","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115406, 11 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115406","openURL":null,"prePubl":null,"public":true},{"mrnumber":4608372,"titles":{"title":"Multistep Runge-Kutta methods for Volterra integro-differential equations","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65R20","description":"Numerical methods for integral equations"},"authors":[{"id":1338241,"name":"Wen, Jiao"},{"id":347351,"name":"Huang, Chengming"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"436","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115384, 19 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115384","openURL":null,"prePubl":null,"public":true},{"mrnumber":4605388,"titles":{"title":"Weighted circular distributions","translatedTitle":null},"entryType":"J","primaryClass":{"code":"62H11","description":"Directional data; spatial statistics"},"authors":[{"id":1061944,"name":"Shahsanaei, Fatemeh"},{"id":608023,"name":"Chinipardaz, Rahim"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"436","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115376, 8 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115376","openURL":null,"prePubl":null,"public":true},{"mrnumber":4602860,"titles":{"title":"An efficient radial basis function generated finite difference meshfree scheme to price multi-dimensional PDEs in financial options","translatedTitle":null},"entryType":"J","primaryClass":{"code":"65M22","description":"Numerical solution of discretized equations for initial value and initial-boundary value problems involving PDEs"},"authors":[{"id":920766,"name":"Song, Yanlai"}],"issue":{"issue":{"pubYear":2024,"pubYear2":null,"volume":"436","volume2":null,"volume3":null,"number":null,"journal":{"id":2273,"shortTitle":"J. Comput. Appl. Math."},"volSlash":"N","isbn":null,"elementOrd":null},"translatedIssue":null},"book":null,"paging":{"paging":{"text":"Paper No. 115382, 13 pp."},"translatedPaging":null},"counts":null,"itemType":"Summary","articleUrl":"https://doi.org/10.1016/j.cam.2023.115382","openURL":null,"prePubl":null,"public":true}],"total":100863}

(no option for direct bibtex export as far as I can see)

koppor commented 1 year ago

This is a refined version of https://github.com/JabRef/jabref/issues/10025.

u7416555 commented 1 year ago

I am a university student and I would like to work on this issue for my university assignment. Could the maintainers please assign this to me please. I have followed the Contribution guidlines and I have set up the required workspace on my system.

github-actions[bot] commented 1 year ago

As a general advice for newcomers: check out Contributing for a start. Also, guidelines for setting up a local workspace is worth having a look at.

Feel free to ask here at GitHub, if you have any issue related questions. If you have questions about how to setup your workspace use JabRef's Gitter chat. Try to open a (draft) pull-request early on, so that people can see you are working on the issue and so that they can see the direction the pull request is heading towards. This way, you will likely receive valuable feedback.

u7416555 commented 1 year ago

Hey. I am working on this issue. When I debug from searchByQueryFindsEntry() unit test in MathSciTest, I get success status code 200 when the query is executed in picture 1 in UrlDownload.Java. In the same picture, line 329, I'm guessing urlConnection.getInputStream() that it doesn't return the right value. The response value is Picture 2. This is causing the exception "internal parser error" when that response is converted to JSONObject. I am not too sure why urlConnection.getInputStream() is returning the HTML page instead of the proper response. Please guide me!

Picture 1:

urlDown

Picture 2: html

Siedlerchr commented 1 year ago

Hi, yes the parser error is clear at this point. You are trying to convert html into a json object which obviously isn't possible. Copy the request/url and paste it in your browser. It seems like you are getting back a html page instead of json And as you can see @tobiasdiez wrote in the first post that the URL has changed

u7416555 commented 1 year ago

I tried to find the exact position from where it is getting changed to an HTML page. I wanted to see what the InputStream I was getting, for that I created an Inner class to deserialize the stream. When the stream was deserialized an IO exception was thrown as "java.io.StreamCorruptedException: invalid stream header: 3C21444F". So I am guessing the output from search from MathSciNet might be wrong. desi1

asInput

Siedlerchr commented 1 year ago

You should set a breakpoint in the various UriBuilder.toUrl methods so you see which URL is actually built Then paste that in your browser https://github.com/JabRef/jabref/blob/afb9e76cda1f224b41c12ff5ed79dd225263c983/src/main/java/org/jabref/logic/importer/fetcher/MathSciNet.java#L80

Deserializing stream does not work here because HTML cannot be converted to a java object...

Enivex commented 1 year ago

Any progress here? Searching Math Sci Net is one of the features I use most often

Siedlerchr commented 11 months ago

@Enivex Can you test this version? https://builds.jabref.org/pull/10691/merge

I have no MathScinet subscription, so I could not test it at whole, but at least the query now looks the same as on the website and Adding new entry by mathscinet id works now as well.

JabRef / jabref