peterdolan
commented
7 years ago Problem: my application is comprised of an API component and a background processing component which uses WebJobs. All parts of the app use Serilog in order to send diagnostic messages to an elasticsearch cluster. I want each webjob's logs to appear in both the dashboard and in the elasticsearch cluster.
There are four possible solutions to this problem that I explored, none of which ended up working out completely for me:
Implement a custom Serilog Sink to handle pushing logs to webjobs, and implement a "passthru" TraceWriter which should be added to the JobHostConfiguration before initialization. Basically this was an attempt to "trick" WebJobs into recognizing that logging is happening and to send said logs to the dashboard. This is, IMO, the cleaner option overall as I would theoretically be able to just inject an ILogger instance everywhere and have logs magically appear where they need to be, but unfortunately when I implemented this, it seemed like all logs that my webjob sent (i.e. explicit ILogger.Information() calls) were being ignored, while runtime-generated logs such as exception messages worked fine and were logged to the dashboard. So this option didn't work at all for me.
Attempt to enable Console, Trace, File, etc. logging in Serilog in hopes of getting WebJobs to pick up one of them and send the logs to the dashboard. This didn't work despite some StackOverflow posts saying it would. :)
Implement a custom TraceWriter that has a serilog dependency. This actually worked and allowed logs to be stored in both the webjobs dashboard and the elasticsearch cluster. However, it's a messy solution because I had to call Serilog's internal message parser to generate a log that the dashboard would be able to display (it doesn't understand serilog's message templates). It's additionally messy because certain shared code needed both an ILogger dependency and an optional TraceWriter dependency for the case when the shared code is being invoked from the WebJobs runtime. I considered just using the TraceWriter that I wrote everywhere to avoid multiple logging dependencies, but that seemed a bit odd as I figured pieces of my application unrelated to WebJobs shouldn't have a WebJobs dependency
Use the built in TextWriter dependency injection stuff. This wasn't ideal for the same reason #3 wasn't ideal, and it was less flexible because TextWriter only exposes a WriteLine method and I want to be able to log errors, warnings, etc. differently.
So that said, is there a recommended approach for logging to external data sources and the dashboard at once? If webjobs just listened for Trace messages and wrote those to the dashboard, this would be a lot easier because I could simply turn on Trace logging and ElasticSearch logging in my Serilog configuration and be done with it, but it seems like this doesn't work / no longer works as of the latest stable WebJobs version.
Thanks! 👍 3
mgartner
mpiercy827
dmlittle
itsachen
(」ﾟДﾟ)」⬅️ tfw there arent any tests