Table Stats/Summary - Githubissues

devpkr1 commented 3 weeks ago

Hi Mike,

I have a suggestion to enhance the context menu for tables: it would be valuable to include an option labeled "Descriptive Statistics." When selected, this option would open a new tab in the main area displaying descriptive statistics for the table.

This feature would be especially helpful for data analysts and data scientists, providing quick insights directly from the table.

I've attached a screenshot for reference.

Thank you for considering this suggestion!

Best regards, Pradeep

mikeburgh commented 3 weeks ago

Okay so that's some sort of break down of the columns from the table and their values for the various stat's.

Are there any common stats for this sort of thing ? It should be rather straight forward if it can be built up as a common SQL query

devpkr1 commented 2 weeks ago

Hi Mike,

Yes, you're exactly right! The goal is to provide a breakdown of key statistics, which would typically include:

Mean: Average value for each column.
Median: Middle value in the dataset, which is useful for understanding central tendencies, especially if there are outliers.
Standard Deviation: Measures the spread of the data, giving insights into variability.
Min and Max: For identifying the range of each column's values.
Count: Total number of non-null values in each column.
Unique: Counts the distinct values in each column, useful for gauging the data’s diversity.
Top: Identifies the most frequent value, which is helpful for categorical columns.
Freq: Shows the frequency of the top value, giving a sense of its prevalence.

As for percentiles (e.g., 25th, 50th, and 75th), we could make these optional to allow flexibility, as they are often insightful but may not be necessary in every case.

These statistics could be generated with a fairly straightforward SQL query, depending on the specific database in use. I believe having this available as a quick-access menu item would streamline our workflow, allowing users to explore table insights at a glance without needing to write queries themselves.

Let me know if you’d like more details on any of these stats, or if there’s anything specific I should look into!

mikeburgh commented 2 weeks ago

Thanks for that, I also noticed DuckDB has this built in.. https://duckdb.org/docs/guides/meta/summarize.html

dbcodeio / public

Table Stats/Summary #91