MySQL Forums
Forum List  »  General

Re: Apache Log Parser and Data Normalization Application
Posted by: William Donaldson
Date: January 22, 2025 08:53AM

Thanks Rohan! Not only does it normalize Access and Error log data, it also tracks multiple clients uploading logs from multiple domains in multiple file formats to a centralized MySQL Server.

Table names starting with import_ provide management of clients, devices, upload processes, import processes, imported files, imported file formats, servers and errors.

Last few weeks we've been simultaneously uploading logs from 10 VPS with multiple VirtualHosts on each Server. We are running thousands of files in different formats and millions of log records through it. Current version is solid.

A Web interface built with Express web application frameworks with Drill Down Capability & Apache ECharts frameworks for Log Data Visualization in charts, reports & data analysis interfaces is in development for the MySQL Schema.

For more information and Entity Relationship Diagram of MySQL Database Schema apache_logs tables - https://willthefarmer.github.io/

Options: ReplyQuote


Subject
Written By
Posted
Re: Apache Log Parser and Data Normalization Application
January 22, 2025 08:53AM


Sorry, only registered users may post in this forum.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.