Observability with Deno Deploy

[crimelabs786]

Kindly point me to duplicate issue, if any.

Probably you folks are already working on it, but just wanted to echo some sentiments.

I moderate a small Discord community, and we've been planning to host some of our bots on the cloud using Deno Deploy. We wanted to have some logs, observability, and dashboard thingy going, but it seems Deno Deploy doesn't support external log forwarding to services like Splunk, New Relic etc.

Would be great to have the option for this.

Similarly, having StatsD metrics collector would help as well.

[bnoordhuis]

I think we're open to that but can you tell me how you think it ought to work? An "Export to..." button on the admin panel, some kind of programmatic API, something else?

[crimelabs786]

I'd personally prefer a programmatic API.

Some sort of library on top of standard logger, that lets me specify a third party data ingestion platform or just plain-old S3 bucket, from which an APM system can consume these.

Ditto with statsD.

[bnoordhuis]

When you say "standard logger", you mean the console.log() family of functions?

Hypothetically: couldn't you monkey-patch those and send off the logs to your service of choice? I'm trying to understand where Deploy falls short at the moment.

[crimelabs786]

Maybe something like this: https://vercel.com/blog/log-drains

[bnoordhuis]

Because I don't want to leave you hanging: we don't have a concrete plan yet but it's under discussion.

[re-thc]

Maybe less Deno Deploy specific, but a lot of Observability platforms (and their SDKs) aren't supporting Deno yet - still just Node.

[happysalada]

has there been progress on this ? Personally I'm very interested.

[joeldrotleff]

Also interested in this! Sad that Deno Deploy logs only seem to persist for a few hours or so. @bnoordhuis

[Jolg42]

Also interested, and also about having bigger logs.

Currently they are trimmed to a maximum size of 2KB: https://docs.deno.com/deploy/manual/logs

[satyarohith]

Updates:

• we introduced persistant logs feature in July 2023 which allows you to filter/search https://deno.com/deploy/changelog#2023-07-22
• currently free plan supports log retention for 1 day while the pro plan increases the retention period to 7 days: https://deno.com/deploy/pricing
• we want to support log drains but we're not working on it right now and there is no ETA

[vicary]

Log drains are extremely important. Before thats officially available, may try "npm:winston" for the moment.

[m4djack]

We are also looking for sending logs to another system in our case it would be datadog.