pannhapat / Dev-CV

Developer-CV
0 stars 0 forks source link

Visualizing Streaming Data #1

Open pannhapat opened 4 years ago

pannhapat commented 4 years ago

Statistics, aggregates, groupings, comparisons, and analysis

pannhapat commented 4 years ago

Assumptions

pannhapat commented 4 years ago

Goals Presentation Goals Data Collection - > Analysis -> Data Selection -> Static Presentation

Data Collection - > Analysis -> Report Development -> Dashboard

                                  V------------------------------------------<|

Data Collection - > Analysis -> Process -> Ask Questions -> Review Findings

pannhapat commented 4 years ago

The Analyst Decision Queue Machine Learning algorithms you have based on analyst input. Peer-review decision and allow analysts to collaborate as much as possible

Events -> Processing & Lookups -> Machine Learning -> Store High Confidence Data

Analyst Decision Queue ->. Analyst Decisions Sampled Raw Data. - > Machine Learning Training Low Confidence Data. -> Categorization Sampled High Confidence. - > Machine Learning Tuning Data Analyst Team Decisions -> Peer Review

pannhapat commented 4 years ago

Data Sources What to Stream -> Unless Already Log Monitoring Polling CSV

Data Storage Considerations Files Database Document store Distributed storage

Managing Multiple Sources