copy_config_to_registered_loggers results in duplicate logs when using with existing loggers

[DonDebonair]

When using utils.copy_config_to_registered_loggers() to copy the PowerLogger config to existing loggers created by a library, this results in duplicate log entries in AWS Lambda

Expected Behavior

When copying config from the AWS Powertools logger to existing loggers instantiated by a library, I expect the log statements of that library to appear once in the log stream, formatted as JSON

Current Behavior

When copying config from the AWS Powertools logger to existing loggers, I see log statements from existing loggers appearing twice in the log stream: once properly formatted as JSON and once as plain text

Possible Solution

I don't know why is this happening, so I can't really comment on a solution 😅

Steps to Reproduce (for bugs)

1. Have a library that instantiates loggers the "regular" Python way, like this:

logger = logging.getLogger(__name__)

class MyClass:
    def my_func():
        logger.info("Hello")

2. Import this library into your Lambda function
3. Instantiate a logger from AWS Lambda Powertools and copy the config to existing loggers:

from aws_lambda_powertools import Logger
from mylibrary import MyClass

logger = Logger() # POWERTOOLS_SERVICE_NAME=myservice
utils.copy_config_to_registered_loggers(source_logger=logger)

4. Observe duplicated logs in the Lambda log stream

Environment

• Powertools version used: 1.25.1
• Packaging format (Layers, PyPi): Docker image
• AWS Lambda function runtime: Python 3.9

[boring-cyborg]

Thanks for opening your first issue here! We'll come back to you as soon as we can.

[heitorlessa]

Thanks a lot for reporting this @dandydev !! @mploski could you look into this? If I recall correctly, you fixed that with the filter two releases ago.

[mploski]

@heitorlessa I will look at this today's evening. There was PR created by @houbie #1001 to exclude source logger from a list.

[DonDebonair]

If I understand #1001 correctly, that is about the source logger being excluded. And from what I understand, the source logger is the Lambda Powertools logger, from which the configs are copied, right?

The problem I'm having, is that the logs from another library are duplicated. They appear once properly formatted as JSON, and once as plain text (as per the original config)

[heitorlessa]

yeah this seems different @dandydev. A logging filter would likely be the solution. Without revisiting the code, this typically happens when you have multiple handlers (we might not be removing existing handlers), or when the root logger is configured and logs get propagated hierarchically (we have a filter on this).

Thanks a lot @mploski !!

[DonDebonair]

I've searched high and low, and the library that instantiates the logger I mentioned in my bug report, doesn't create any handlers. So that cannot be it.

Anyways, thanks for picking this up! I'm excited that there's already a PR open to fix this!

[heitorlessa]

We're looking into this tomorrow @dandydev :) Should have a patch release by EOW (the latest).

[heitorlessa]

All good @dandydev waiting @mploski for a final pass after changes to the PR, then we can prep a patch release for this.

[DonDebonair]

Super swift! Amazing!