search

signalmetrics / signal

The Laravel package for signal
MIT License
0 stars 0 forks source link

DuckDB #3

Closed iambateman closed 2 months ago

iambateman commented 2 months ago

@tnylea

maybe we should look into DuckDB...this is obviously a big deal because changing databases later would be awful. :D

I've done 10 minutes of research and I'm going to do some more. My very ADHD notes are below.

From https://marclamberti.com/blog/duckdb-getting-started-for-beginners/ DuckDB is optimized for queries that apply aggregate calculations across large numbers of rows, whereas SQLite is optimized for fast scanning and lookup for individual rows of data. If you need to perform analytical queries, go with DuckDB otherwise, use SQLite

here's my HN comment with some commentary https://news.ycombinator.com/item?id=41515044

to which someone said... Write events in parquet format and use DuckDB for your analytics? If you’re looking for something portable, DuckDB is hard to beat. It’s pretty much the SQLite for analytics.

chatgpt thinks... https://chatgpt.com/share/65052228-a0f1-4142-972d-396aeac18416

iambateman commented 2 months ago

Update...DuckDB looks like the right tool but PHP isn't currently supported.

I don't presently see a path to making that work. Maybe we start with SQLite and look to convert to DuckDB in the future.