tachOrg / Real-Time-Data-Processing-Application

0 stars 0 forks source link

Create local data stream #10

Closed tacho090 closed 1 year ago

tacho090 commented 1 year ago

choosethe power metric and output those results to a stream. this stream will be captured by kinesis and outputted to a database. we can then use this data with amazon sagemaker to get some insights from it and produce recommendations. This issue is just creating the data stream with the linux power metric

tacho090 commented 1 year ago

image

tacho090 commented 1 year ago

@XrosHeart05 take care of the following metrics:

XrosHeart05 commented 1 year ago

The issue is taken and started

tacho090 commented 1 year ago

UPDATE: focus on getting data ONLY from CPU and relaying it into a stream.

XrosHeart05 commented 1 year ago

Issue status: On the #1-cpu branch, a data generation type is being contiguous from the top command and the %Cpu(s) section. This data is segmented and assigned to variables for their respective printouts at console level. At console level you can see the specific cpu consumption data represented by percentages and also in a more graphical view through horizontal bars that mark the consumption of each type of process; an example is attached. In addition this is done once per second refreshing this console "view", the idea is to use this process per second for sending data to the stream.

imagen

XrosHeart05 commented 1 year ago

Average CPU core usage load is added for 1, 5, and 15 minute times; these are sent to AWS Kinesis also every 1 minute

XrosHeart05 commented 1 year ago

Added functionality to obtain the usage time per processor core in ms versus the time of the started session in ms. This data is sent to AWS Kinesis as well.

imagen

XrosHeart05 commented 1 year ago

Actually working in cpu usage in only one second; until work in progress

XrosHeart05 commented 1 year ago

Memory usage statistics start to be created imagen

XrosHeart05 commented 1 year ago

Current system memory consumption data is sent to Kinesis imagen

tacho090 commented 1 year ago

Is there a pull request linked to this issue? @XrosHeart05

XrosHeart05 commented 1 year ago

Yes, currently this PR is still associated

XrosHeart05 commented 1 year ago

System memory consumption data is being stored in DynamoDB. imagen

tacho090 commented 1 year ago

Archived for reference only.