search

DeepPhe / DeepPhe-Release

Public release of the DeepPhe analytic software
Other
30 stars 10 forks source link

running time #22

Closed harryhoch closed 5 years ago

harryhoch commented 5 years ago

might be good to add something to the documentation indicating the possibility that processing documents can take a fair amount of time...

fedorov commented 5 years ago

As a reference point, it took 4 minutes to parse 41 pathology report on a system below

image

fedorov commented 5 years ago

On a related note, it would be helpful if upon completion there was a log entry saying how long processing took.

seanfinan commented 5 years ago

Hi Andrey,

There is in the current unreleased version. It reports initialization and total processing time, plus average time per document.

From: Andrey Fedorov notifications@github.com Sent: Thursday, January 3, 2019 11:58 AM To: DeepPhe/DeepPhe-Release Cc: Subscribed Subject: Re: [DeepPhe/DeepPhe-Release] running time (#22) [EXTERNAL]

On a related note, it would be helpful if upon completion there was a log entry saying how long processing took.

- You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_DeepPhe_DeepPhe-2DRelease_issues_22-23issuecomment-2D451206572&d=DwMCaQ&c=qS4goWBT7poplM69zy_3xhKwEW14JZMSdioCoppxeFU&r=GZ-zi4-4Ig70T3sKUBF5gxlDMUa1gkWNgFq0SOkeWgI&m=iiawtgMOWHTmnorU_TIDzvW592rFu8toBJ4AdMPYrDo&s=9VI6b-bw54XcZc3eVd43zfxvqDYUcYS59F1pzbWWh4c&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AHidNFgqQdsolgmRGpqKBuAyeQ3xiZsBks5u-5Fja8gaJpZM4YHn-5Fq&d=DwMCaQ&c=qS4goWBT7poplM69zy_3xhKwEW14JZMSdioCoppxeFU&r=GZ-zi4-4Ig70T3sKUBF5gxlDMUa1gkWNgFq0SOkeWgI&m=iiawtgMOWHTmnorU_TIDzvW592rFu8toBJ4AdMPYrDo&s=E_g7fT6E1_zy0ulNsfWY8216D1G1Y5sUbK_JlHraMKg&e=.

fedorov commented 5 years ago

Would be great to have some progress reporting (like percent of the documents processed). I've been running the pipeline for about 1.5 hours now with 2000+ documents, and really have no clue when it will be finished. Maybe this deserves a separate issue, but it is related to the current closed one.

seanfinan commented 5 years ago

Progress reporting is also (mostly) part of the 3rd party gui library. However, since I am a contributor to said software ... I just checked in an enhancement that include a progress bar at the top of the gui with text "[current#] / [total#]" in the bar. It should appear in the next version.