search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.23k stars 21.41k forks source link

Collect logs from a text or JSON file with Azure Monitor Agent - Improvements #119736

Closed Viajaz closed 3 months ago

Viajaz commented 7 months ago
  1. Although Data collection transformations in Azure Monitor is referenced for the Data Source transform, I think Tutorial: Transform text logs during ingestion in Azure Monitor Logs should be referenced directly, somewhere, as it's more directly relevant.
  2. In the Prerequisites, it should be explicitly mentioned that there should be a JSON object on each line and that the log file itself is not a full JSON document (Eg: Array of objects) when using a "Collect JSON Logs" Data Source; Do delineate the end of a record with an end of line. is too ambiguous.
  3. More information on the logic of when the files are picked up needs to be included. Does it rely on file Date Modified to tell if a file has been changed? Does it keep track of how many lines are in a log file and, if changed/increased, reads the new lines from the last position the log was read till? How frequent are the log file checks?

Document Details

⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

Viajaz commented 7 months ago

https://learn.microsoft.com/en-us/azure/azure-monitor/agents/data-sources-custom-logs#data-collection ?

Naveenommi-MSFT commented 7 months ago

@Viajaz Thanks for your feedback! We will investigate and update as appropriate.

AaronMaxwell commented 3 months ago

Thanks for your dedication to our documentation. This issue has been moved to an internal work item for triage and prioritization. Thanks in advance for your understanding as we investigate to provide the most accurate documentation updates. #please-close

Internal work item: https://dev.azure.com/msft-skilling/Content/_workitems/edit/262446

Please also note that GitHub documentation issues are being phased out completely. For more information see: https://aka.ms/ContentUserFeedback.

Our support team is available to assist you if you have any pressing questions or problems that need to be resolved. You can create a support ticket by visiting the following link: https://azure.microsoft.com/support/create-ticket/

You may also ask support questions to our Q&A forums or on Stack Overflow when the questions are related to coding.