kermitt2 / grobid

A machine learning software for extracting information from scholarly documents
https://grobid.readthedocs.io
Apache License 2.0
3.48k stars 449 forks source link

Service Unavailable Without Heavy Load #878

Closed Soul-Code closed 3 months ago

Soul-Code commented 2 years ago

Really nice tool. But I just encountered such a mistake.

Error encountered while requesting the server.
HTTP ERROR 503
Problem accessing /api/processFulltextDocument. Reason:

    Service Unavailable

Then I looked through the documents and found this.

A 503 error with the default parallel mode normally means that all the threads available to GROBID are currently used. The client need to re-send the query after a wait time that will allow the server to free some threads. The wait time depends on the service and the capacities of the server, we suggest 2 seconds for the processHeaderDocument service.

But I don't have a heavy load. I only requested the interface a few times. A few hours later, it was still the same.

My CPU is 4 cores with 8G RAM. It should not be the reason for the lack of memory.

I'm confused about what caused this.

My log file like this.

07:54:00.259 [main] INFO org.grobid.service.main.GrobidServiceApplication - Found conf path: /opt/grobid/grobid-home/config/grobid.yaml
07:54:00.263 [main] WARN org.grobid.service.main.GrobidServiceApplication - Running with default arguments: "server" "/opt/grobid/grobid-home/config/grobid.yaml"
07:54:00.263 [main] INFO org.grobid.service.main.GrobidServiceApplication - Configuration file: /opt/grobid/grobid-home/config/grobid.yaml
INFO  [2021-12-17 07:54:01,646] io.dropwizard.server.DefaultServerFactory: Registering jersey handler with root path prefix: /
INFO  [2021-12-17 07:54:01,649] io.dropwizard.server.DefaultServerFactory: Registering admin handler with root path prefix: /
INFO  [2021-12-17 07:54:01,650] io.dropwizard.assets.AssetsBundle: Registering AssetBundle with name: grobidAssets for path /*
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (file:/opt/grobid/grobid-service/lib/guice-4.1.0.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
WARNING: Please consider reporting this to the maintainers of com.google.inject.internal.cglib.core.$ReflectUtils$1
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
INFO  [2021-12-17 07:54:02,182] com.hubspot.dropwizard.guicier.DropwizardModule: Added guice injected health check: org.grobid.service.resources.HealthResource
WARN  [2021-12-17 07:54:02,190] org.grobid.core.main.GrobidHomeFinder: Grobid config file location was not explicitly set via 'org.grobid.config' system variable, defaulting to: /opt/grobid/grobid-home/config/grobid.yaml
INFO  [2021-12-17 07:54:02,223] org.grobid.service.GrobidRestService: Initiating Servlet GrobidRestService
INFO  [2021-12-17 07:54:02,225] org.grobid.core.main.LibraryLoader: Loading external native sequence labelling library
INFO  [2021-12-17 07:54:02,230] org.grobid.core.main.LibraryLoader: Loading Wapiti native library...
INFO  [2021-12-17 07:54:02,230] org.grobid.core.main.LibraryLoader: Native library for sequence labelling loaded
INFO  [2021-12-17 07:54:02,233] org.grobid.core.lexicon.Lexicon: Initiating dictionary
INFO  [2021-12-17 07:54:02,233] org.grobid.core.lexicon.Lexicon: End of Initialization of dictionary
INFO  [2021-12-17 07:54:02,234] org.grobid.core.lexicon.Lexicon: Initiating names
INFO  [2021-12-17 07:54:02,234] org.grobid.core.lexicon.Lexicon: End of initialization of names
INFO  [2021-12-17 07:54:02,880] org.grobid.core.lexicon.Lexicon: Initiating country codes
INFO  [2021-12-17 07:54:02,880] org.grobid.core.lexicon.Lexicon: End of initialization of country codes
INFO  [2021-12-17 07:54:03,059] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 1/10
INFO  [2021-12-17 07:54:03,059] org.grobid.service.GrobidRestService: Initiating of Servlet GrobidRestService finished.
INFO  [2021-12-17 07:54:03,065] com.hubspot.dropwizard.guicier.DropwizardModule: Registering org.grobid.service.resources.HealthResource as a root resource class
INFO  [2021-12-17 07:54:03,066] com.hubspot.dropwizard.guicier.DropwizardModule: Registering org.grobid.service.GrobidRestService as a root resource class
INFO  [2021-12-17 07:54:03,066] com.hubspot.dropwizard.guicier.DropwizardModule: Registering org.grobid.service.exceptions.mapper.GrobidServiceExceptionMapper as a provider class
INFO  [2021-12-17 07:54:03,067] com.hubspot.dropwizard.guicier.DropwizardModule: Registering org.grobid.service.exceptions.mapper.GrobidExceptionsTranslationUtility as a provider class
INFO  [2021-12-17 07:54:03,067] com.hubspot.dropwizard.guicier.DropwizardModule: Registering org.grobid.service.exceptions.mapper.GrobidExceptionMapper as a provider class
INFO  [2021-12-17 07:54:03,067] com.hubspot.dropwizard.guicier.DropwizardModule: Registering org.grobid.service.exceptions.mapper.WebApplicationExceptionMapper as a provider class
INFO  [2021-12-17 07:54:03,070] org.grobid.service.main.GrobidServiceApplication: Service config=GrobidServiceConfiguration{server=DefaultServerFactory{applicationConnectors=[io.dropwizard.jetty.HttpConnectorFactory@45d64d27], adminConnectors=[io.dropwizard.jetty.HttpConnectorFactory@36dfbdaf], adminMaxThreads=64, adminMinThreads=1, applicationContextPath=/, adminContextPath=/}, logging=DefaultLoggingFactory{level=INFO, loggers={org.apache.pdfbox.pdmodel.font.PDSimpleFont="OFF"}, appenders=[io.dropwizard.logging.ConsoleAppenderFactory@26cb5207, io.dropwizard.logging.FileAppenderFactory@2687725a]}, metrics=MetricsFactory{frequency=1 minute, reporters=[]}}
INFO  [2021-12-17 07:54:03,095] io.dropwizard.server.ServerFactory: Starting grobid-service

 _______  _______  _______  ______  _________ ______     _______  _______  _______          _________ _______  _______
(  ____ \(  ____ )(  ___  )(  ___ \ \__   __/(  __  \   (  ____ \(  ____ \(  ____ )|\     /|\__   __/(  ____ \(  ____ \
| (    \/| (    )|| (   ) || (   ) )   ) (   | (  \  )  | (    \/| (    \/| (    )|| )   ( |   ) (   | (    \/| (    \/
| |      | (____)|| |   | || (__/ /    | |   | |   ) |  | (_____ | (__    | (____)|| |   | |   | |   | |      | (__
| | ____ |     __)| |   | ||  __ (     | |   | |   | |  (_____  )|  __)   |     __)( (   ) )   | |   | |      |  __)
| | \_  )| (\ (   | |   | || (  \ \    | |   | |   ) |        ) || (      | (\ (    \ \_/ /    | |   | |      | (
| (___) || ) \ \__| (___) || )___) )___) (___| (__/  )  /\____) || (____/\| ) \ \__  \   /  ___) (___| (____/\| (____/\
(_______)|/   \__/(_______)|/ \___/ \_______/(______/   \_______)(_______/|/   \__/   \_/   \_______/(_______/(_______/

INFO  [2021-12-17 07:54:03,198] org.eclipse.jetty.setuid.SetUIDListener: Opened application@734ce281{HTTP/1.1,[http/1.1]}{0.0.0.0:8070}
INFO  [2021-12-17 07:54:03,198] org.eclipse.jetty.setuid.SetUIDListener: Opened admin@49b89425{HTTP/1.1,[http/1.1]}{0.0.0.0:8071}
INFO  [2021-12-17 07:54:03,201] org.eclipse.jetty.server.Server: jetty-9.4.18.v20190429; built: 2019-04-29T20:42:08.989Z; git: e1bc35120a6617ee3df052294e433f3a25ce7097; jvm 11.0.11+9
WARN  [2021-12-17 07:54:03,514] org.glassfish.jersey.internal.inject.Providers: A provider org.grobid.service.exceptions.mapper.GrobidExceptionsTranslationUtility registered in SERVER runtime does not implement any provider interfaces applicable in the SERVER runtime. Due to constraint configuration problems the provider org.grobid.service.exceptions.mapper.GrobidExceptionsTranslationUtility will be ignored. 
INFO  [2021-12-17 07:54:03,816] io.dropwizard.jersey.DropwizardResourceConfig: The following paths were found for the configured resources:

    POST    /api/annotatePDF (org.grobid.service.GrobidRestService)
    POST    /api/citationPatentAnnotations (org.grobid.service.GrobidRestService)
    GET     /api/grobid (org.grobid.service.GrobidRestService)
    GET     /api/health (org.grobid.service.resources.HealthResource)
    GET     /api/isalive (org.grobid.service.GrobidRestService)
    POST    /api/processAffiliations (org.grobid.service.GrobidRestService)
    PUT     /api/processAffiliations (org.grobid.service.GrobidRestService)
    POST    /api/processCitation (org.grobid.service.GrobidRestService)
    PUT     /api/processCitation (org.grobid.service.GrobidRestService)
    POST    /api/processCitationNames (org.grobid.service.GrobidRestService)
    PUT     /api/processCitationNames (org.grobid.service.GrobidRestService)
    POST    /api/processCitationPatentPDF (org.grobid.service.GrobidRestService)
    POST    /api/processCitationPatentST36 (org.grobid.service.GrobidRestService)
    POST    /api/processCitationPatentTXT (org.grobid.service.GrobidRestService)
    POST    /api/processDate (org.grobid.service.GrobidRestService)
    PUT     /api/processDate (org.grobid.service.GrobidRestService)
    POST    /api/processFulltextAssetDocument (org.grobid.service.GrobidRestService)
    PUT     /api/processFulltextAssetDocument (org.grobid.service.GrobidRestService)
    POST    /api/processFulltextDocument (org.grobid.service.GrobidRestService)
    PUT     /api/processFulltextDocument (org.grobid.service.GrobidRestService)
    POST    /api/processHeaderDocument (org.grobid.service.GrobidRestService)
    PUT     /api/processHeaderDocument (org.grobid.service.GrobidRestService)
    POST    /api/processHeaderNames (org.grobid.service.GrobidRestService)
    PUT     /api/processHeaderNames (org.grobid.service.GrobidRestService)
    POST    /api/processReferences (org.grobid.service.GrobidRestService)
    PUT     /api/processReferences (org.grobid.service.GrobidRestService)
    POST    /api/referenceAnnotations (org.grobid.service.GrobidRestService)
    GET     /api/version (org.grobid.service.GrobidRestService)

INFO  [2021-12-17 07:54:03,818] org.eclipse.jetty.server.handler.ContextHandler: Started i.d.j.MutableServletContextHandler@36a58466{/,null,AVAILABLE}
INFO  [2021-12-17 07:54:03,822] io.dropwizard.setup.AdminEnvironment: tasks = 

    POST    /tasks/log-level (io.dropwizard.servlets.tasks.LogConfigurationTask)
    POST    /tasks/gc (io.dropwizard.servlets.tasks.GarbageCollectionTask)

INFO  [2021-12-17 07:54:03,827] org.eclipse.jetty.server.handler.ContextHandler: Started i.d.j.MutableServletContextHandler@36665c11{/,null,AVAILABLE}
INFO  [2021-12-17 07:54:03,838] org.eclipse.jetty.server.AbstractConnector: Started application@734ce281{HTTP/1.1,[http/1.1]}{0.0.0.0:8070}
INFO  [2021-12-17 07:54:03,851] org.eclipse.jetty.server.AbstractConnector: Started admin@49b89425{HTTP/1.1,[http/1.1]}{0.0.0.0:8071}
INFO  [2021-12-17 07:54:03,853] org.eclipse.jetty.server.Server: Started @3935ms
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET / HTTP/1.1" 200 14113 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 56
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/bootstrap/css/bootstrap.min.css HTTP/1.1" 200 127128 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 11
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/css/style.css HTTP/1.1" 200 3777 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 3
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.css HTTP/1.1" 200 1818 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/bootstrap/css/prettify.css HTTP/1.1" 200 818 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/pdf.js/web/text_layer_builder.css HTTP/1.1" 200 1776 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 15
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/font-awesome/css/font-awesome.min.css HTTP/1.1" 200 19431 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 11
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/js/jquery.form.js HTTP/1.1" 200 39145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 4
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/js/jquery-3.4.1.min.js HTTP/1.1" 200 88145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 8
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/bootstrap/js/prettify.js HTTP/1.1" 200 13632 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/bootstrap/js/bootstrap.min.js HTTP/1.1" 200 41085 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 4
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/js/vkbeautify.js HTTP/1.1" 200 10111 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/pdf.js/web/pdf_link_service.js HTTP/1.1" 200 9575 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/pdf.js/web/text_layer_builder.js HTTP/1.1" 200 11582 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 4
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /grobid/grobid.js HTTP/1.1" 200 62369 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 5
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.js HTTP/1.1" 200 3386 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
127.0.0.1 - - [17/Dec/2021:07:54:07 +0000] "GET /resources/pdf.js/build_/pdf.js HTTP/1.1" 200 333388 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 20
127.0.0.1 - - [17/Dec/2021:07:54:08 +0000] "GET /resources/img/favicon.ico HTTP/1.1" 200 1406 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2
61.151.206.126 - - [17/Dec/2021:07:54:10 +0000] "GET / HTTP/1.0" 200 14113 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML; like Gecko) Mobile/12F70 MicroMessenger/6.1.5 NetType/WIFI" 1
127.0.0.1 - - [17/Dec/2021:07:54:37 +0000] "GET /resources/font-awesome/font/fontawesome-webfont.woff?v=3.1.0 HTTP/1.1" 200 34420 "http://127.0.0.1:8080/resources/font-awesome/css/font-awesome.min.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 3
INFO  [2021-12-17 07:54:57,676] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/affiliation-address/model.wapiti (size: 2699936)
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/affiliation-address/model.wapiti"
Model path: /opt/grobid/grobid-home/models/affiliation-address/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/name/header/model.wapiti"
INFO  [2021-12-17 07:54:57,966] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/name/header/model.wapiti (size: 2524527)
Model path: /opt/grobid/grobid-home/models/name/header/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/name/citation/model.wapiti"
INFO  [2021-12-17 07:54:58,164] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/name/citation/model.wapiti (size: 440148)
Model path: /opt/grobid/grobid-home/models/name/citation/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/header/model.wapiti"
INFO  [2021-12-17 07:54:58,196] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/header/model.wapiti (size: 17134253)
Model path: /opt/grobid/grobid-home/models/header/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/date/model.wapiti"
INFO  [2021-12-17 07:55:00,067] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/date/model.wapiti (size: 102435)
Model path: /opt/grobid/grobid-home/models/date/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/citation/model.wapiti"
INFO  [2021-12-17 07:55:00,074] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/citation/model.wapiti (size: 16865234)
Model path: /opt/grobid/grobid-home/models/citation/model.wapiti
WARN  [2021-12-17 07:55:01,877] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/fulltext/model.wapiti"
INFO  [2021-12-17 07:55:01,877] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/fulltext/model.wapiti (size: 26707735)
Model path: /opt/grobid/grobid-home/models/fulltext/model.wapiti
WARN  [2021-12-17 07:55:04,685] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/segmentation/model.wapiti"
INFO  [2021-12-17 07:55:04,685] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/segmentation/model.wapiti (size: 31133177)
Model path: /opt/grobid/grobid-home/models/segmentation/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/reference-segmenter/model.wapiti"
INFO  [2021-12-17 07:55:08,509] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/reference-segmenter/model.wapiti (size: 4921245)
Model path: /opt/grobid/grobid-home/models/reference-segmenter/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/figure/model.wapiti"
INFO  [2021-12-17 07:55:08,923] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/figure/model.wapiti (size: 422671)
Model path: /opt/grobid/grobid-home/models/figure/model.wapiti
[Wapiti] Loading model: "/opt/grobid/grobid-home/models/table/model.wapiti"
INFO  [2021-12-17 07:55:08,950] org.grobid.core.jni.WapitiModel: Loading model: /opt/grobid/grobid-home/models/table/model.wapiti (size: 1427222)
Model path: /opt/grobid/grobid-home/models/table/model.wapiti
INFO  [2021-12-17 07:55:09,054] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 1/10
127.0.0.1 - - [17/Dec/2021:07:55:53 +0000] "POST /api/processFulltextDocument HTTP/1.1" 200 66461 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 57907
WARN  [2021-12-17 08:04:45,690] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 08:04:45,690] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 08:04:45,690] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 1/10
127.0.0.1 - - [17/Dec/2021:08:04:48 +0000] "POST /api/processFulltextDocument HTTP/1.1" 200 66461 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 5019
WARN  [2021-12-17 08:05:12,536] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 08:05:12,536] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 08:05:12,536] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 1/10
127.0.0.1 - - [17/Dec/2021:08:05:15 +0000] "POST /api/processFulltextDocument HTTP/1.1" 200 66461 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 5631
127.0.0.1 - - [17/Dec/2021:09:09:39 +0000] "GET / HTTP/1.1" 200 14113 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 6
127.0.0.1 - - [17/Dec/2021:09:09:42 +0000] "GET /resources/js/jquery-3.4.1.min.js HTTP/1.1" 200 88145 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:09:52 +0000] "GET /resources/js/jquery.form.js HTTP/1.1" 200 39145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 4.4.4; HUAWEI ALE-CL00 Build/HuaweiALE-CL00; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043024 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:09:58 +0000] "GET /resources/bootstrap/js/bootstrap.min.js HTTP/1.1" 200 41085 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:10:03 +0000] "GET /resources/bootstrap/js/prettify.js HTTP/1.1" 200 13632 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 4.4.4; Coolpad Y82-520 Build/KTU84P) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/33.0.0.0 Mobile Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:10:06 +0000] "GET /resources/js/vkbeautify.js HTTP/1.1" 200 10111 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:10:09 +0000] "GET /resources/pdf.js/web/text_layer_builder.js HTTP/1.1" 200 11582 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/en" 1
127.0.0.1 - - [17/Dec/2021:09:10:12 +0000] "GET /resources/pdf.js/web/pdf_link_service.js HTTP/1.1" 200 9575 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.95 Safari/537.36 MicroMessenger/6.5.2.501 NetType/WIFI WindowsWechat QBCore/3.43.27.400 QQBrowser/9.0.2524.400" 1
127.0.0.1 - - [17/Dec/2021:09:10:15 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.js HTTP/1.1" 200 3386 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 5.1.1; SM801 Build/LMY47V; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043024 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:10:19 +0000] "GET /resources/pdf.js/build_/pdf.js HTTP/1.1" 200 333388 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 5.1.1; SM801 Build/LMY47V; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043024 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 18
127.0.0.1 - - [17/Dec/2021:09:10:30 +0000] "GET /grobid/grobid.js HTTP/1.1" 200 62369 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:18:56 +0000] "GET / HTTP/1.1" 200 14113 "-" "Mozilla/5.0 (Linux; Android 5.1.1; SM801 Build/LMY47V; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043024 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 1
127.0.0.1 - - [17/Dec/2021:09:18:57 +0000] "GET /resources/js/jquery-3.4.1.min.js HTTP/1.1" 200 88145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 4.4.4; Coolpad Y82-520 Build/KTU84P) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/33.0.0.0 Mobile Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:19:05 +0000] "GET /resources/js/jquery.form.js HTTP/1.1" 200 39145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 4.4.4; Coolpad Y82-520 Build/KTU84P) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/33.0.0.0 Mobile Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:19:09 +0000] "GET /resources/bootstrap/js/bootstrap.min.js HTTP/1.1" 200 41085 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:19:14 +0000] "GET /resources/bootstrap/js/prettify.js HTTP/1.1" 200 13632 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 1
127.0.0.1 - - [17/Dec/2021:09:19:15 +0000] "GET /resources/js/vkbeautify.js HTTP/1.1" 200 10111 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 5.1.1; SM801 Build/LMY47V; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043024 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 1
127.0.0.1 - - [17/Dec/2021:09:19:18 +0000] "GET /resources/pdf.js/web/text_layer_builder.js HTTP/1.1" 200 11582 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 2
127.0.0.1 - - [17/Dec/2021:09:19:20 +0000] "GET /resources/pdf.js/web/pdf_link_service.js HTTP/1.1" 200 9575 "http://127.0.0.1:8080/" "Mozilla/5.0 (iPhone; CPU iPhone OS 10_2_1 like Mac OS X) AppleWebKit/602.4.6 (KHTML, like Gecko) Mobile/14D27 MicroMessenger/6.5.5 NetType/WIFI Language/zh_CN" 1
127.0.0.1 - - [17/Dec/2021:09:19:22 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.js HTTP/1.1" 200 3386 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.95 Safari/537.36 MicroMessenger/6.5.2.501 NetType/WIFI WindowsWechat QBCore/3.43.27.400 QQBrowser/9.0.2524.400" 2
127.0.0.1 - - [17/Dec/2021:09:19:26 +0000] "GET /resources/pdf.js/build_/pdf.js HTTP/1.1" 200 333388 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 5.1.1; SM801 Build/LMY47V; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.49 Mobile MQQBrowser/6.2 TBS/043024 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 16
127.0.0.1 - - [17/Dec/2021:09:19:38 +0000] "GET /grobid/grobid.js HTTP/1.1" 200 62369 "http://127.0.0.1:8080/" "Mozilla/5.0 (Linux; Android 6.0.1; OPPO R9s Build/MMB29M) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/37.0.0.0 Mobile MQQBrowser/6.9 TBS/036906 Safari/537.36 MicroMessenger/6.5.4.1000 NetType/4G Language/zh_CN" 2
11.168.183.73 - - [17/Dec/2021:10:04:46 +0000] "GET /api/processFulltextDocument HTTP/1.1" 405 277 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.212 Safari/537.36" 7
11.167.9.143 - - [17/Dec/2021:13:19:40 +0000] "GET / HTTP/1.1" 200 14113 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.212 Safari/537.36" 5
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET / HTTP/1.1" 200 14113 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 2
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/bootstrap/css/bootstrap.min.css HTTP/1.1" 200 127128 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 5
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/bootstrap/css/prettify.css HTTP/1.1" 200 818 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/font-awesome/css/font-awesome.min.css HTTP/1.1" 200 19431 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 3
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/css/style.css HTTP/1.1" 200 3777 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 2
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.css HTTP/1.1" 200 1818 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/pdf.js/web/text_layer_builder.css HTTP/1.1" 200 1776 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/js/jquery-3.4.1.min.js HTTP/1.1" 200 88145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 6
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/js/jquery.form.js HTTP/1.1" 200 39145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 2
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/bootstrap/js/bootstrap.min.js HTTP/1.1" 200 41085 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 3
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/bootstrap/js/prettify.js HTTP/1.1" 200 13632 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 2
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/js/vkbeautify.js HTTP/1.1" 200 10111 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/pdf.js/web/text_layer_builder.js HTTP/1.1" 200 11582 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/pdf.js/web/pdf_link_service.js HTTP/1.1" 200 9575 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.js HTTP/1.1" 200 3386 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /grobid/grobid.js HTTP/1.1" 200 62369 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 3
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/pdf.js/build_/pdf.js HTTP/1.1" 200 333388 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 17
127.0.0.1 - - [17/Dec/2021:14:08:02 +0000] "GET /resources/img/favicon.ico HTTP/1.1" 200 1406 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:18:43 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 3
WARN  [2021-12-17 14:18:45,616] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:18:45,616] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:18:45,617] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 1/10
INFO  [2021-12-17 14:18:45,815] org.grobid.core.utilities.glutton.GluttonClient: nThreads: 4
INFO  [2021-12-17 14:18:45,818] org.grobid.core.utilities.glutton.GluttonClient:  (,postValidate=false,parseReference=false,query.title=Brain Tumor Segmentation in MRI Scans Using Deeply-Supervised Neural Networks,query.author=Pourreza,doi=10.1007/978-3-319-75238-9_28): New request in the pool
INFO  [2021-12-17 14:18:45,819] org.grobid.core.utilities.glutton.GluttonClient:  (,postValidate=false,parseReference=false,query.title=Brain Tumor Segmentation in MRI Scans Using Deeply-Supervised Neural Networks,query.author=Pourreza,doi=10.1007/978-3-319-75238-9_28): .. executing
127.0.0.1 - - [17/Dec/2021:14:19:17 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 3
WARN  [2021-12-17 14:19:17,941] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:19:17,941] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:19:17,941] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 2/10
INFO  [2021-12-17 14:19:18,148] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Attention Is All You Need,query.author=Vaswani): New request in the pool
INFO  [2021-12-17 14:19:18,149] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Attention Is All You Need,query.author=Vaswani): .. executing
127.0.0.1 - - [17/Dec/2021:14:19:38 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
WARN  [2021-12-17 14:19:38,383] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:19:38,384] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:19:38,384] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 3/10
INFO  [2021-12-17 14:19:38,565] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Attention Is All You Need,query.author=Vaswani): New request in the pool
INFO  [2021-12-17 14:19:38,566] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Attention Is All You Need,query.author=Vaswani): .. executing
INFO  [2021-12-17 14:30:13,927] org.apache.http.impl.execchain.RetryExec: I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://cloud.science-miner.com:443: The target server failed to respond
INFO  [2021-12-17 14:30:13,928] org.apache.http.impl.execchain.RetryExec: Retrying request to {s}->https://cloud.science-miner.com:443
127.0.0.1 - - [17/Dec/2021:14:39:02 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 20
WARN  [2021-12-17 14:39:02,341] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:39:02,341] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:39:02,341] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 4/10
INFO  [2021-12-17 14:39:02,541] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Self-Attentive Speaker Embeddings for Text-Independent Speaker Verification,query.author=Zhu): New request in the pool
INFO  [2021-12-17 14:39:02,542] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Self-Attentive Speaker Embeddings for Text-Independent Speaker Verification,query.author=Zhu): .. executing
61.151.207.112 - - [17/Dec/2021:14:40:20 +0000] "GET / HTTP/1.0" 200 14113 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML; like Gecko) Mobile/12F70 MicroMessenger/6.1.5 NetType/WIFI" 1
127.0.0.1 - - [17/Dec/2021:14:40:28 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
WARN  [2021-12-17 14:40:28,353] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:40:28,353] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:40:28,353] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 5/10
INFO  [2021-12-17 14:40:28,563] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Self-supervised speaker embeddings,query.author=Stafylakis): New request in the pool
INFO  [2021-12-17 14:40:28,564] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Self-supervised speaker embeddings,query.author=Stafylakis): .. executing
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET / HTTP/1.1" 200 14113 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/js/jquery-3.4.1.min.js HTTP/1.1" 200 88145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 6
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/js/jquery.form.js HTTP/1.1" 200 39145 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 3
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/bootstrap/js/prettify.js HTTP/1.1" 200 13632 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/bootstrap/js/bootstrap.min.js HTTP/1.1" 200 41085 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 3
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/bootstrap/css/prettify.css HTTP/1.1" 200 818 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/bootstrap/css/bootstrap.min.css HTTP/1.1" 200 127128 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 5
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/css/style.css HTTP/1.1" 200 3777 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/font-awesome/css/font-awesome.min.css HTTP/1.1" 200 19431 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.css HTTP/1.1" 200 1818 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/pdf.js/web/text_layer_builder.css HTTP/1.1" 200 1776 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/pdf.js/web/text_layer_builder.js HTTP/1.1" 200 11582 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/pdf.js/web/pdf_link_service.js HTTP/1.1" 200 9575 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/js/vkbeautify.js HTTP/1.1" 200 10111 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/pdf.js/web/annotation_layer_builder.js HTTP/1.1" 200 3386 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /grobid/grobid.js HTTP/1.1" 200 62369 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 3
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/pdf.js/build_/pdf.js HTTP/1.1" 200 333388 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 16
127.0.0.1 - - [17/Dec/2021:14:41:12 +0000] "GET /resources/img/favicon.ico HTTP/1.1" 200 1406 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 1
127.0.0.1 - - [17/Dec/2021:14:41:45 +0000] "GET /resources/font-awesome/font/fontawesome-webfont.woff?v=3.1.0 HTTP/1.1" 200 34420 "http://127.0.0.1:8080/resources/font-awesome/css/font-awesome.min.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 2
WARN  [2021-12-17 14:41:46,507] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:41:46,507] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:41:46,507] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 6/10
INFO  [2021-12-17 14:41:47,184] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=SSAST: Self-Supervised Audio Spectrogram Transformer,query.author=Gong): New request in the pool
INFO  [2021-12-17 14:41:47,185] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=SSAST: Self-Supervised Audio Spectrogram Transformer,query.author=Gong): .. executing
127.0.0.1 - - [17/Dec/2021:14:42:23 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 2
WARN  [2021-12-17 14:42:34,794] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:42:34,794] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:42:34,794] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 7/10
127.0.0.1 - - [17/Dec/2021:14:42:36 +0000] "POST /api/processFulltextDocument HTTP/1.1" 200 60359 "http://127.0.0.1:8080/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.55 Safari/537.36" 2064
127.0.0.1 - - [17/Dec/2021:14:42:55 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
WARN  [2021-12-17 14:42:55,244] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:42:55,245] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:42:55,245] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 7/10
INFO  [2021-12-17 14:42:55,451] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Self-supervised speaker embeddings,query.author=Stafylakis): New request in the pool
INFO  [2021-12-17 14:42:55,452] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Self-supervised speaker embeddings,query.author=Stafylakis): .. executing
127.0.0.1 - - [17/Dec/2021:14:43:54 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
WARN  [2021-12-17 14:43:56,041] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:43:56,041] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:43:56,042] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 8/10
INFO  [2021-12-17 14:43:56,245] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=T-GSA: TRANSFORMER WITH GAUSSIAN-WEIGHTED SELF-ATTENTION FOR SPEECH ENHANCEMENT,query.author=Kim): New request in the pool
INFO  [2021-12-17 14:43:56,246] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=T-GSA: TRANSFORMER WITH GAUSSIAN-WEIGHTED SELF-ATTENTION FOR SPEECH ENHANCEMENT,query.author=Kim): .. executing
127.0.0.1 - - [17/Dec/2021:14:45:20 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
WARN  [2021-12-17 14:45:20,560] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:45:20,560] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:45:20,560] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 9/10
INFO  [2021-12-17 14:45:20,758] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Short utterance compensation in speaker verification via cosine-based teacher-student learning of speaker embeddings,query.author=Jung): New request in the pool
127.0.0.1 - - [17/Dec/2021:14:45:37 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
WARN  [2021-12-17 14:45:38,583] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model fulltext
WARN  [2021-12-17 14:45:38,583] org.grobid.core.utilities.GrobidProperties: No configuration parameter defined for DeLFT engine for model segmentation
INFO  [2021-12-17 14:45:38,583] org.grobid.core.factory.GrobidPoolingFactory: Number of Engines in pool active/max: 10/10
INFO  [2021-12-17 14:45:38,820] org.grobid.core.utilities.glutton.GluttonClient:  (,parseReference=false,query.title=Short-time speaker verification with different speaking style utterances,query.author=Mao): New request in the pool
127.0.0.1 - - [17/Dec/2021:14:49:13 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
ERROR [2021-12-17 14:49:14,329] org.grobid.service.process.GrobidRestProcessFiles: Could not get an engine from the pool within configured time. Sending service unavailable.
127.0.0.1 - - [17/Dec/2021:14:49:14 +0000] "POST /api/processHeaderDocument HTTP/1.1" 503 277 "-" "Go-http-client/1.1" 1069
127.0.0.1 - - [17/Dec/2021:14:50:36 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 2
ERROR [2021-12-17 14:50:37,540] org.grobid.service.process.GrobidRestProcessFiles: Could not get an engine from the pool within configured time. Sending service unavailable.
127.0.0.1 - - [17/Dec/2021:14:50:37 +0000] "POST /api/processHeaderDocument HTTP/1.1" 503 277 "-" "Go-http-client/1.1" 1046
127.0.0.1 - - [17/Dec/2021:14:50:38 +0000] "GET /api/isalive HTTP/1.1" 200 4 "-" "Go-http-client/1.1" 1
ERROR [2021-12-17 14:50:39,800] org.grobid.service.process.GrobidRestProcessFiles: Could not get an engine from the pool within configured time. Sending service unavailable.
127.0.0.1 - - [17/Dec/2021:14:50:39 +0000] "POST /api/processReferences HTTP/1.1" 503 273 "-" "Go-http-client/1.1" 1056
ERROR [2021-12-17 14:51:05,866] org.grobid.service.process.GrobidRestProcessFiles: Could not get an engine from the pool within configured time. Sending service unavailable.
127.0.0.1 - - [17/Dec/2021:14:51:05 +0000] "POST /api/processFulltextDocument HTTP/1.1" 503 279 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2045
127.0.0.1 - - [17/Dec/2021:15:31:36 +0000] "HEAD /api/processFulltextDocument HTTP/1.1" 405 277 "-" "python-requests/2.17.3" 3
ERROR [2021-12-17 16:02:04,844] org.grobid.service.process.GrobidRestProcessFiles: Could not get an engine from the pool within configured time. Sending service unavailable.
127.0.0.1 - - [17/Dec/2021:16:02:04 +0000] "POST /api/processFulltextDocument HTTP/1.1" 503 279 "http://127.0.0.1:8080/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36 Edg/96.0.1054.53" 2124

Did I do something wrong that caused this to happen?

kermitt2 commented 2 years ago

Hello !

It seems that you are using biblio-glutton online for consolidation and it is not responding (probably because I stopped the biblio-glutton demo... it was overloaded by queries). You can set to crossref the consolidation option on the server with the config file if you just occasionally use Grobid or install your own biblio-glutton if the usage is more intensive.

I need to better manage connectivity issues with biblio-glutton.

Soul-Code commented 2 years ago

Thanks very much! I'll try to deploy the biblio-glutton.

kermitt2 commented 2 years ago

I'll try to deploy the biblio-glutton.

biblio-glutton is very heavy to install and deploy, it's for scaling beyond CrossRef web API capacities and having richer metadata, slightly more accurate matching. For a normal usage, a few thousand PDF, using CrossRef API for consolidation is good (see here).

Soul-Code commented 2 years ago

Thanks for the replay. I've tried both these two methods. When I use CrossRef Web API, I met an error looks like a network error. Maybe I should start a proxy service for this? image And then I try to build the docker image of biblio-glutton. But I find out this.

Building biblio
Step 1/23 : FROM openjdk:8-jdk as builder
 ---> 5bbce51c9625
Step 2/23 : USER root
 ---> Using cache
 ---> 8b60e1fa24f4
Step 3/23 : RUN apt-get update
 ---> Using cache
 ---> 231dd5bef5b6
Step 4/23 : WORKDIR /app/glutton-source
 ---> Using cache
 ---> 5f08186cdab0
Step 5/23 : RUN mkdir -p .gradle
 ---> Using cache
 ---> fda93c61777e
Step 6/23 : VOLUME /app/glutton-source/.gradle
 ---> Using cache
 ---> 79018165cfcd
Step 7/23 : COPY lookup/ ./lookup/
 ---> Using cache
 ---> e825da01add4
Step 8/23 : COPY matching/ ./matching/
 ---> Using cache
 ---> 50cb4a2abc0b
Step 9/23 : RUN cd /app/glutton-source/lookup && ./gradlew clean assemble --no-daemon
 ---> Using cache
 ---> d6a46e68ffcb
Step 10/23 : FROM openjdk:8-jre-slim
 ---> 781db64a09bd
Step 11/23 : RUN apt-get update -qq && apt-get -qy install curl build-essential unzip
 ---> Using cache
 ---> 2560d3028235
Step 12/23 : RUN mkdir -p /app
 ---> Using cache
 ---> bc2135d44697
Step 13/23 : WORKDIR /app
 ---> Using cache
 ---> 83bfc4becbe3
Step 14/23 : RUN curl -sL https://deb.nodesource.com/setup_10.x | bash -
 ---> Using cache
 ---> 00fdd2beef0a
Step 15/23 : RUN apt-get update -qq && apt-get -y install nodejs
 ---> Using cache
 ---> 201e18a7e6ba
Step 16/23 : COPY --from=builder /app/glutton-source/matching /app/matching
 ---> Using cache
 ---> bd04082980e4
Step 17/23 : RUN cd matching; npm install
 ---> Running in 1d216a66ef99
/bin/sh: 1: npm: not found
ERROR: Service 'biblio' failed to build: The command '/bin/sh -c cd matching; npm install' returned a non-zero code: 127

After that I find a image from docekrhub https://registry.hub.docker.com/r/bjrne/biblio-glutton and try it. It started successfully. But return a 500 error everytime I call the interface which looks like this.

biblio_1  | WARN  [2021-12-18 16:37:18,547] org.glassfish.jersey.internal.Errors: The following warnings have been detected: WARNING: 
biblio_1  | WARNING: The (sub)resource method getByBiblioStringWithPost in com.scienceminer.lookup.web.resource.LookupController conta
biblio_1  | WARNING: The (sub)resource method getDoiByMetadataDoi in com.scienceminer.lookup.web.resource.OAController contains empty 
biblio_1  | WARNING: The (sub)resource method getDocumentSize in com.scienceminer.lookup.web.resource.DataController contains empty pa
biblio_1  | WARNING: The (sub)resource method getDoiByMetadataDoi in com.scienceminer.lookup.web.resource.OaIstexController contains e
biblio_1  | 
biblio_1  | WARN  [2021-12-18 16:38:37,128] com.scienceminer.lookup.web.resource.LookupController: DOI did not matched, move to additi
biblio_1  | 172.29.0.1 - - [18/Dec/2021:16:38:37 +0000] "GET /service/lookup?doi=10.1484/J.QUAESTIO.1.103624 HTTP/1.1" 404 58 "-" "cur
biblio_1  | 172.29.0.1 - - [18/Dec/2021:16:44:03 +0000] "GET /service/lookup?parseReference=false&atitle=Attention+Is+All+You+Need&firstAuthor=Vaswani HTTP/1.1" 500 58 "-" "Apache-HttpClient/4.5.10 (Java/11.0.11)" 246
biblio_1  | 172.29.0.1 - - [18/Dec/2021:16:44:27 +0000] "GET /service/lookup?parseReference=false&atitle=Attention+Is+All+You+Need&firstAuthor=Vaswani HTTP/1.1" 500 58 "-" "Apache-HttpClient/4.5.10 (Java/11.0.11)" 19
biblio_1  | 172.29.0.1 - - [18/Dec/2021:16:47:32 +0000] "GET /service/lookup?parseReference=false&atitle=Attention+Is+All+You+Need&firstAuthor=Vaswani HTTP/1.1" 500 58 "-" "Apache-HttpClient/4.5.10 (Java/11.0.11)" 7
biblio_1  | 172.29.0.1 - - [18/Dec/2021:16:47:33 +0000] "GET /service/lookup?parseReference=false&atitle=Attention+Is+All+You+Need&firstAuthor=Vaswani HTTP/1.1" 500 58 "-" "Apache-HttpClient/4.5.10 (Java/11.0.11)" 10

But whatever, it worked for me now. Without consolidation but no blocking.

kermitt2 commented 2 years ago

If you're calling the consolidation service behind a proxy, you need to indicate the proxy information in the Grobid settings as documented here. Don't forget to indicate your email in the CrossRef parameter too for the "polite" usage.

The docker image is just the service without any data. You would still need to load and index the resources (crossref dump at least) into the database, and this is the heavy part. Consolidation is very valuable I think if you're exploiting extracted metadata and citations, so it worth setting CrossRef at least.

Soul-Code commented 2 years ago

Thanks a lot. I fully understand.