Observability with Deno Deploy

denoland / deploy_feedback

For reporting issues with Deno Deploy

https://deno.com/deploy

74 stars 5 forks source link

Observability with Deno Deploy #39

Open crimelabs786 opened 3 years ago

crimelabs786 commented 3 years ago

Kindly point me to duplicate issue, if any.

Probably you folks are already working on it, but just wanted to echo some sentiments.

I moderate a small Discord community, and we've been planning to host some of our bots on the cloud using Deno Deploy. We wanted to have some logs, observability, and dashboard thingy going, but it seems Deno Deploy doesn't support external log forwarding to services like Splunk, New Relic etc.

Would be great to have the option for this.

Similarly, having StatsD metrics collector would help as well.

bnoordhuis commented 3 years ago

I think we're open to that but can you tell me how you think it ought to work? An "Export to..." button on the admin panel, some kind of programmatic API, something else?

crimelabs786 commented 3 years ago

I'd personally prefer a programmatic API.

Some sort of library on top of standard logger, that lets me specify a third party data ingestion platform or just plain-old S3 bucket, from which an APM system can consume these.

Ditto with statsD.

bnoordhuis commented 3 years ago

When you say "standard logger", you mean the console.log() family of functions?

Hypothetically: couldn't you monkey-patch those and send off the logs to your service of choice? I'm trying to understand where Deploy falls short at the moment.

crimelabs786 commented 3 years ago

Maybe something like this: https://vercel.com/blog/log-drains

bnoordhuis commented 3 years ago

Because I don't want to leave you hanging: we don't have a concrete plan yet but it's under discussion.

re-thc commented 3 years ago

Maybe less Deno Deploy specific, but a lot of Observability platforms (and their SDKs) aren't supporting Deno yet - still just Node.

happysalada commented 1 year ago

has there been progress on this ? Personally I'm very interested.

joeldrotleff commented 10 months ago

Also interested in this! Sad that Deno Deploy logs only seem to persist for a few hours or so. @bnoordhuis

Jolg42 commented 9 months ago

Also interested, and also about having bigger logs.

Currently they are trimmed to a maximum size of 2KB: https://docs.deno.com/deploy/manual/logs

satyarohith commented 8 months ago

Updates:

we introduced persistant logs feature in July 2023 which allows you to filter/search https://deno.com/deploy/changelog#2023-07-22
currently free plan supports log retention for 1 day while the pro plan increases the retention period to 7 days: https://deno.com/deploy/pricing
we want to support log drains but we're not working on it right now and there is no ETA

vicary commented 7 months ago

Log drains are extremely important. Before thats officially available, may try "npm:winston" for the moment.