[Meta Issue] Logging Improvements

[robbavey]

This issue contains a list of improvements to logging that we would like to include in future versions of Logstash:

7.x

• Logs should include the plugin.id (see RFC: Logging Context with Loggable #9988 for one proposal) PR to review Added plugin.name to fish tag log lines #11078 (7.x)

7.6

• Avoid SourceWithMetadata collapse to plain string, use around the rich objects: PR Fix/refact use source with metadata instead of plain text #11456) (7.6)
• Implement deprecation logging . Introduce deprecation logging #11049 PR Feature/deprecation logger #11260 (7.6)

7.5.0

• Split logs for multiple pipelines into separate log files Ability to use path.logs under each pipeline #10427 PR Feature/log appender per pipeline #11108 (docs PR [DOCS] Added section in logstash.yml documentation to describe feature #11177) (7.5.0)
• Include path.config associated with pipeline.id Include path.config associated to pipeline id in logging #9630 PR Added origins of pipeline configurations #11123 (7.5.0)

7.4

• Logs should include the pipeline.id Logs should be prefixed with pipeline name when using multiple pipelines. #8290, Pipeline ID in Logstash Error Log - multiple pipelines #10521 (previous work: better thread identification and pipeline thread context setup #9991) fixed by PR Add pipeline.id to log lines #11075 (7.4)

discarded issues/PRs

• Default Plugin.id should be more useful, to discuss: Issue Default Plugin.id should be more useful #11154 PR Added line and columns to plugin name #11155 aborted because of Fix/refact use source with metadata instead of plain text #11456
• Expose Plugin source references through HTTP API (input/codec/filter/output) aborted Expose input source metadata trhough http api #11497 because Fix/refact use source with metadata instead of plain text #11456 already does the job

[robbavey]

Thanks to the awesome work by @andsel, this meta issue can be closed!