All CDK-Assets logging needs to be pluggable

[mrgrain]

Currently cdk-assets writes logs directly to stdout and stderr. It also uses a boolean quiet flag to decide if output is printed or not.

• Instead we need the logging to be pluggable from the outside world.
• The quiet options needs to be deprecated in favor of a log level. Existing quiet should be mapped to a log level
• Anything written to process.stdout or process.stderr needs also be pluggable

[rix0rrr]

Are you sure we need this? The cdk-assets library already exposes a pluggable logger interface:

    /**
     * Listener for progress events
     *
     * @default No listener
     */
    readonly progressListener?: IPublishProgressListener;

That is used by the CDK CLI. CDK CLI funnels log events to the regular CDK CLI logger.

[mrgrain]

Are you sure we need this? The cdk-assets library already exposes a pluggable logger interface:
That is used by the CDK CLI. CDK CLI funnels log events to the regular CDK CLI logger.

Great find! In that case we just need to make sure this is used everywhere. I came across the Docker asset building implementation which is not using the logger at the moment:

cdk-assets/lib/private/shell.ts

Line 38 in 79c76a7

process.stdout.write(chunk);

[rix0rrr]

I was discussing this with @HBobertz today, and we're not quite sure what the best solution is here. This is for build output that is intended primarily for a human's eyeballs, not for a program. Of course, in an IDE context or whatever, we would want to capture it so we can send it somewhere else. Buffering stdout to the last moment and then emitting it all at once is probably a bad experience, so we'll need to do something on-the-fly. Also, the chunks can unpredictably range anywhere from 1 to 8092 bytes.

What do you think of the following approach:

• Introduce a new cdk-assets EventType, something like EventType.BUILD_OUTPUT or whatever. Do we want a separation between stdout and stderr?
• Split stdout/stderr on newlines (take into account that chunk boundaries can straddle line boundaries)
• Emit every line over the regular IPublishProgressListener interface.