Implement a Better Logging System

[snobbee]

Is your feature request related to a problem? Please describe.

Debugging production issues is challenging without a robust logging strategy that includes structured logging and correlation IDs.

Describe the solution you'd like

Implement a comprehensive logging system that:

• Utilizes structured JSON logging for all messages.
• Incorporates correlation IDs for distributed tracing to enhance observability and debugging.
• Defines proper log levels (DEBUG, INFO, WARN, ERROR) to categorize log messages effectively.
• Includes meaningful context in every log message to facilitate easier analysis and troubleshooting.
• Adopts best practices for log retention and rotation policies to manage log data efficiently.

Describe alternatives you've considered

• Relying on simple text-based logging without structure.
• Using external logging tools without integrating correlation IDs.
• Manual efforts to analyze logs without a standardized format.

Additional context

Establishing a better logging system will significantly improve our ability to trace issues, monitor performance, and ensure compliance with logging best practices. This is a vital step towards achieving observability and enhancing the overall quality of the software.