Parse Azure Storage Logs into Azure Monitor Logs & Metrics

Category: azure log integration

Question

Dave Tyas (Avanade) on Tue, 13 Nov 2018 22:06:55


Hi,

We have an application that stores error log information in Azure Storage in a predefined format. What we would like to do is parse the data into the Azure Monitor log and/or metric store so that it can be interpreted and alerted on. What would be the best way to do this? For example would it be appropriate to use an Azure Function and appropriate APIs to read the source data, parse, and inject it into the Azure Monitor stores? From what I can see using a scheduled Azure function would mean we would also have to code the handling of the source data so that only new records are processed. Any direction greatly appreciated.

Thanks,

Dave.

Replies

Femisulu on Sat, 17 Nov 2018 00:51:53


Hi Dave, does your application sit on an Azure VM? or are you forwarding logs from a non-azure application into Azure Storage.  If the former, then I recommend following the steps detailed here. Basically you will need to forward your error logs into a Log Analytics workspace where you can analyze the logs using log analytics query language. You can also use Log Analytics to create alerts based on yur log data, specific error codes or the frequency of occurrence of a specific log event/error.