Not all log management efforts are successful. Without proper planning, these initiatives are likely to fail – or at the very least, produce less than desired results.
Here are some pitfalls to avoid when setting and executing your log management strategy:
Disconnects between IT and compliance staff
When it comes to log management, IT and compliance staff must work closely together. Each group needs to understand the other’s role in the process in order for the strategy to be comprehensive and successful. For example, without open collaboration, IT staff will lack understanding of the regulatory requirements that drive log management initiatives in the first place, while compliance professionals will have limited insight into the technology issues that impact effective log data collection, storage, and analysis.
Collecting data before formal policies are put into place
Log management should be viewed as a rigid business discipline. Formal policies must be set and documented before data collection and aggregation begin. These guidelines should not only provide details about which log data should be gathered, how it should be stored, and how frequently it should be analyzed, they also must outline the persons responsible for various aspects of log management, as well as the steps that must be taken when suspicious activity is detected. Otherwise, log management procedures will be fragmented and disjointed – and therefore, ineffective.
Focusing only on events in the “security” log
Many log management strategies focus on identifying suspicious events within system security logs only. However, this provides only a limited view of all network and application activity, and may cause companies to overlook potential incidents that require further investigation. Application logs and other log types must also be reviewed on a regular basis, to provide the most accurate picture.
Collecting too much
While gathering log data from every technology system within the enterprise may seem like the best approach (some companies feel more comfortable doing this, to ensure that nothing is overlooked), it will never work if event logs are not prioritized. Simply taking every log file, combining them all together, and reviewing them with little direction will make it nearly impossible to find what needs to be found. But, by knowing where to look first, then moving on logically to other related system logs, companies can effectively gather the system activity intelligence they need.
Lack of data consolidation
Log management projects that call for the collection and analysis of log data on a device-by-device basis provide limited insight into enterprise-wide security incidents. Reviewing log event data one system at a time is particularly ineffective when it comes to obtaining a comprehensive view of user activity, or conducting forensic investigations once a possible breach has been identified.
Insufficient testing
Log management infrastructures must be thoroughly tested, not just before initial deployment, but continuously. Many companies discontinue testing after the solution has been put into production. But, as new business systems are added to their technology environment, the impact of these applications, and the log data that will be collected from them, must be assessed. Even if no changes to the infrastructure are made, organizations should periodically test features such as real-time alerts, to ensure all is in proper working order.