search

jannisborn / paperscraper

Tools to scrape publication metadata from pubmed, arxiv, medrxiv and chemrxiv.
MIT License
263 stars 31 forks source link

How to turn off the DEBUG log information? #32

Closed yiouyou closed 1 year ago

yiouyou commented 1 year ago

There're too much log print outs, how to turn off the DEBUG/INFO?

Thanks!

jannisborn commented 1 year ago

Are you looking for this? https://stackoverflow.com/questions/7234262/how-to-implement-different-levels-for-specific-modules-in-python

yiouyou commented 1 year ago

No, it's not what I'm looking for. The repo keeps output something like below, how can I turn off those?

INFO:paperscraper.load_dumps:Loaded biorxiv dump with 281401 entries
INFO:paperscraper.load_dumps:Loaded chemrxiv dump with 19395 entries
INFO:paperscraper.load_dumps:Loaded medrxiv dump with 57042 entries
DEBUG:asyncio:Using selector: EpollSelector
DEBUG:httpx:load_ssl_context verify=False cert=None trust_env=True http2=False
...
DEBUG:charset_normalizer:Encoding detection: ascii is most likely the one.
DEBUG:charset_normalizer:Encoding detection: ascii is most likely the one.
DEBUG:httpcore.connection:connect_tcp.started host='localhost' port=7788 local_address=None timeout=None socket_options=None
DEBUG:httpcore.connection:connect_tcp.complete return_value=<httpcore._backends.anyio.AnyIOStream object at 0x7fb9a173b340>
DEBUG:httpcore.http11:send_request_headers.started request=<Request [b'POST']>
DEBUG:httpcore.http11:send_request_headers.complete
DEBUG:httpcore.http11:send_request_body.started request=<Request [b'POST']>
DEBUG:httpcore.http11:send_request_body.complete
DEBUG:httpcore.http11:receive_response_headers.started request=<Request [b'POST']>
DEBUG:matplotlib.pyplot:Loaded backend agg version v2.2.
DEBUG:httpcore.http11:receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'date', b'Mon, 28 Aug 2023 10:43:32 GMT'), (b'server', b'uvicorn'), (b'content-length', b'150'), (b'content-type', b'application/json')])
INFO:httpx:HTTP Request: POST http://localhost:7788/api/predict "HTTP/1.1 200 OK"
DEBUG:httpcore.http11:receive_response_body.started request=<Request [b'POST']>
DEBUG:httpcore.http11:receive_response_body.complete
DEBUG:httpcore.http11:response_closed.started
DEBUG:httpcore.http11:response_closed.complete
DEBUG:httpcore.http11:send_request_headers.started request=<Request [b'POST']>
DEBUG:httpcore.http11:send_request_headers.complete
DEBUG:httpcore.http11:send_request_body.started request=<Request [b'POST']>
DEBUG:httpcore.http11:send_request_body.complete
DEBUG:httpcore.http11:receive_response_headers.started request=<Request [b'POST']>
DEBUG:httpcore.http11:receive_response_headers.complete return_value=(b'HTTP/1.1', 200, b'OK', [(b'date', b'Mon, 28 Aug 2023 10:43:32 GMT'), (b'server', b'uvicorn'), (b'content-length', b'16'), (b'content-type', b'application/json')])
INFO:httpx:HTTP Request: POST http://localhost:7788/reset "HTTP/1.1 200 OK"
DEBUG:httpcore.http11:receive_response_body.started request=<Request [b'POST']>
DEBUG:httpcore.http11:receive_response_body.complete
DEBUG:httpcore.http11:response_closed.started
DEBUG:httpcore.http11:response_closed.complete

Thanks!

jannisborn commented 1 year ago

Mose of those are not outputs from paperscraper but from httpcore, so this is not strictly related to paperscraper. How to set the logging level, you can google it