owenCCY
commented
1 year ago Before the feature is available, we can self install Fluent Bit on Windows instance, and send logs to the pipeline provisioned using CLO console. Here is the overall steps, and assume you are using the S3 as the buffering layer
-
Create a application log pipeline in Centralized Logging with OpenSearch Solution console
Take a note of the buffer destination you chose. (Ex, if you choose S3 as buffer, take a note of the s3 bucket name) -
Download Fluent Bit agent from Fluent Bit: Official Manual. Choose the version that suit your platform.
-
Config the Fluent Bit agent to the correct output destination: The output destination should be the S3 bucket location. Official Guide here
-
Attach role / policy to your windows instances, example policy is shown as follows: You might need to change the bucket name to be your own S3 bucket.
{
"Version": "2012-10-17",
"Statement": [
#(If you choose S3 as buffer)
{
"Action": "s3:PutObject",
"Resource": "arn:aws:s3:::YOUR_S3_BUFFER_BUCKET_NAME/*",
"Effect": "Allow"
},
#(Optional, if you choose KDS as buffer)
{
"Action": [
"kinesis:PutRecord",
"kinesis:PutRecords"
],
"Resource": "arn:aws:kinesis:YOUR_REGION:YOUR_ACCOUNT_ID:stream/KDS_STREAM_NAME",
"Effect": "Allow"
},
#(Optional, if you choose no buffer)
{
"Action": [
"es:ESHttpGet",
"es:ESHttpDelete",
"es:ESHttpPut",
"es:ESHttpPost",
"es:ESHttpHead",
"es:ESHttpPatch"
],
"Resource": "arn:aws:es:YOUR_REGION:YOUR_ACCOUNT_ID:domain/DOMAIN_NAME",
"Effect": "Allow"
}
]
}
James96315
Describe the feature
The Instance Group can only list out the Linux instances, and the solution can only monitor/install/configure Fluent Bit on Linux Instances. We are expecting the solution can support Windows OS as well.
Use Case
Monitor, install and configure log agents on Windows instances automatically.
Proposed Solution
No response
Other Information
No response
Log Hub version used
v1.0.0