Issue with repeat DEBUG Information in Example Case After Updating Opendrift

[dayeno]

Hi all,

I tried to run the sample case "example_long_cmems_currents.py", but lots of DEBUG information appears repeatedly, as shown below. Previously I can successfully run this case without so much DEBUG information existing. But after the update, the issue exists.
Thanks for your support.

Best,
Daye

09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.GetObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7fe04c1bd080>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.GetObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7fe03d8235d0>>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.GetObject: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7fe03bd02fd0>>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.GetObject: calling handler <function generate_idempotent_uuid at 0x7fe04c18eca0>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.GetObject: calling handler <function _handle_request_validation_mode_member at 0x7fe04c1bd800>
09:53:21 DEBUG botocore.hooks:238: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7fe04c1bd260>
09:53:21 DEBUG botocore.hooks:238: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7fe03d8235d0>>
09:53:21 DEBUG botocore.regions:503: Calling endpoint provider with parameters: {'Bucket': 'mdl-arco-time-015', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'https://s3.waw3-1.cloudferro.com', 'ForcePathStyle': False, 'Accelerate': False, 'UseGlobalEndpoint': True, 'Key': 'arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1', 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
09:53:21 DEBUG botocore.regions:518: Endpoint provider result: https://mdl-arco-time-015.s3.waw3-1.cloudferro.com
09:53:21 DEBUG botocore.regions:680: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "<botocore.UNSIGNED object at 0x7fe04c3d1b10>"
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.GetObject: calling handler <function create_custom_query_function.._add_custom_query_param at 0x7fe03e40f740>
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.GetObject: calling handler <function add_expect_header at 0x7fe04c18f240>
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.GetObject: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7fe03d822e10>>
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.GetObject: calling handler <function add_recursion_detection_header at 0x7fe04c18d4e0>
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.GetObject: calling handler <function add_query_compatibility_header at 0x7fe04c1bd760>
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.GetObject: calling handler <function inject_api_version_header_if_needed at 0x7fe04c1bc7c0>
09:53:21 DEBUG botocore.endpoint:114: Making request for OperationModel(name=GetObject) with params: {'url_path': '/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1', 'query_string': {}, 'method': 'GET', 'headers': {'x-amz-checksum-mode': 'ENABLED', 'User-Agent': 'Boto3/1.36.2 md/Botocore#1.36.2 ua/2.0 os/linux#5.15.0-130-generic md/arch#x86_64 lang/python#3.11.6 md/pyimpl#CPython cfg/retry-mode#standard Botocore/1.36.2'}, 'body': b'', 'auth_path': '/mdl-arco-time-015/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1', 'url': 'https://mdl-arco-time-015.s3.waw3-1.cloudferro.com/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1?x-cop-client=copernicus-marine-toolbox&x-cop-client-version=2.0.0&x-cop-user=byang12', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7fe03d7f1450>, 'has_streaming_input': False, 'auth_type': 'none', 'unsigned_payload': None, 's3_redirect': {'redirected': False, 'bucket': 'mdl-arco-time-015', 'params': {'Bucket': 'mdl-arco-time-015', 'Key': 'arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1', 'ChecksumMode': 'ENABLED'}}, 'input_params': {'Bucket': 'mdl-arco-time-015', 'Key': 'arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1'}, 'signing': {}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'us-east-1'}]}, 'checksum': {'response_algorithms': ['crc32', 'sha1', 'sha256']}}}
09:53:21 DEBUG botocore.hooks:238: Event request-created.s3.GetObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7fe03d7f12d0>>
09:53:21 DEBUG botocore.hooks:238: Event choose-signer.s3.GetObject: calling handler <function set_operation_specific_signer at 0x7fe04c18eac0>
09:53:21 DEBUG botocore.hooks:238: Event before-sign.s3.GetObject: calling handler <function remove_arn_from_signing_path at 0x7fe04c1bd1c0>
09:53:21 DEBUG botocore.hooks:238: Event before-sign.s3.GetObject: calling handler <function _set_extra_headers_for_unsigned_request at 0x7fe04c1bd8a0>
09:53:21 DEBUG botocore.hooks:238: Event before-sign.s3.GetObject: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7fe03d822e10>>
09:53:21 DEBUG botocore.hooks:238: Event request-created.s3.GetObject: calling handler <function add_retry_headers at 0x7fe04c1bcfe0>
09:53:21 DEBUG botocore.endpoint:263: Sending http request: <AWSPreparedRequest stream_output=True, method=GET, url=https://mdl-arco-time-015.s3.waw3-1.cloudferro.com/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1?x-cop-client=copernicus-marine-toolbox&x-cop-client-version=2.0.0&x-cop-user=byang12, headers={'x-amz-checksum-mode': b'ENABLED', 'User-Agent': b'Boto3/1.36.2 md/Botocore#1.36.2 ua/2.0 os/linux#5.15.0-130-generic md/arch#x86_64 lang/python#3.11.6 md/pyimpl#CPython cfg/retry-mode#standard Botocore/1.36.2', 'amz-sdk-invocation-id': b'f8c49281-b5f0-4269-a717-2399dfcbdc2e', 'amz-sdk-request': b'attempt=1'}>
09:53:21 DEBUG botocore.httpsession:97: Certificate path: /home/daye/mambaforge/envs/opendrift/lib/python3.11/site-packages/certifi/cacert.pem
09:53:21 DEBUG urllib3.connectionpool:544: https://mdl-arco-time-015.s3.waw3-1.cloudferro.com:443 "GET /arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35075.0.3.1?x-cop-client=copernicus-marine-toolbox&x-cop-client-version=2.0.0&x-cop-user=byang12 HTTP/1.1" 200 496536
09:53:21 INFO botocore.httpchecksum:481: Skipping checksum validation. Response did not contain one of the following algorithms: ['crc32', 'sha1', 'sha256'].
09:53:21 DEBUG botocore.hooks:238: Event before-parse.s3.GetObject: calling handler <function _handle_200_error at 0x7fe04c1bd580>
09:53:21 DEBUG botocore.hooks:238: Event before-parse.s3.GetObject: calling handler <function handle_expires_header at 0x7fe04c1bd3a0>
09:53:21 DEBUG botocore.parsers:241: Response headers: {'content-length': '496536', 'accept-ranges': 'bytes', 'last-modified': 'Thu, 14 Nov 2024 10:17:04 GMT', 'x-rgw-object-type': 'Normal', 'etag': '"7c8be3ab256657e0d7d85102cddb222c"', 'x-amz-request-id': 'tx00000e3fcf16b56ab45eb-006790c011-137d27989-default', 'content-type': 'binary/octet-stream', 'date': 'Wed, 22 Jan 2025 09:53:21 GMT'}
09:53:21 DEBUG botocore.parsers:242: Response body:
<botocore.response.StreamingBody object at 0x7fe0c2388d30>
09:53:21 DEBUG botocore.hooks:238: Event needs-retry.s3.GetObject: calling handler <function _update_status_code at 0x7fe04c1bd6c0>
09:53:21 DEBUG botocore.hooks:238: Event needs-retry.s3.GetObject: calling handler <bound method RetryHandler.needs_retry of <botocore.retries.standard.RetryHandler object at 0x7fe03d822a90>>
09:53:21 DEBUG botocore.retries.standard:101: Not retrying request.
09:53:21 DEBUG botocore.hooks:238: Event needs-retry.s3.GetObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7fe03d8235d0>>
09:53:21 DEBUG botocore.hooks:238: Event after-call.s3.GetObject: calling handler <bound method RetryQuotaChecker.release_retry_quota of <botocore.retries.standard.RetryQuotaChecker object at 0x7fe03d8215d0>>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <function sse_md5 at 0x7fe04c18ef20>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <function validate_bucket_name at 0x7fe04c18ee80>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7fe04c1bd080>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7fe03d8235d0>>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7fe03bd02fd0>>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <function generate_idempotent_uuid at 0x7fe04c18eca0>
09:53:21 DEBUG botocore.hooks:238: Event before-parameter-build.s3.HeadObject: calling handler <function _handle_request_validation_mode_member at 0x7fe04c1bd800>
09:53:21 DEBUG botocore.hooks:238: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7fe04c1bd260>
09:53:21 DEBUG botocore.hooks:238: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7fe03d8235d0>>
09:53:21 DEBUG botocore.regions:503: Calling endpoint provider with parameters: {'Bucket': 'mdl-arco-time-015', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'https://s3.waw3-1.cloudferro.com', 'ForcePathStyle': False, 'Accelerate': False, 'UseGlobalEndpoint': True, 'Key': 'arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1', 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
09:53:21 DEBUG botocore.regions:518: Endpoint provider result: https://mdl-arco-time-015.s3.waw3-1.cloudferro.com
09:53:21 DEBUG botocore.regions:680: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "<botocore.UNSIGNED object at 0x7fe04c3d1b10>"
09:53:21 DEBUG botocore.hooks:238: Event before-call.s3.HeadObject: calling handler <function create_custom_query_function.._add_custom_query_param at 0x7fe03e40f600>
09:53:22 DEBUG botocore.hooks:238: Event before-call.s3.HeadObject: calling handler <function add_expect_header at 0x7fe04c18f240>
09:53:22 DEBUG botocore.hooks:238: Event before-call.s3.HeadObject: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7fe03d822e10>>
09:53:22 DEBUG botocore.hooks:238: Event before-call.s3.HeadObject: calling handler <function add_recursion_detection_header at 0x7fe04c18d4e0>
09:53:22 DEBUG botocore.hooks:238: Event before-call.s3.HeadObject: calling handler <function add_query_compatibility_header at 0x7fe04c1bd760>
09:53:22 DEBUG botocore.hooks:238: Event before-call.s3.HeadObject: calling handler <function inject_api_version_header_if_needed at 0x7fe04c1bc7c0>
09:53:22 DEBUG botocore.endpoint:114: Making request for OperationModel(name=HeadObject) with params: {'url_path': '/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1', 'query_string': {}, 'method': 'HEAD', 'headers': {'User-Agent': 'Boto3/1.36.2 md/Botocore#1.36.2 ua/2.0 os/linux#5.15.0-130-generic md/arch#x86_64 lang/python#3.11.6 md/pyimpl#CPython cfg/retry-mode#standard Botocore/1.36.2'}, 'body': b'', 'auth_path': '/mdl-arco-time-015/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1', 'url': 'https://mdl-arco-time-015.s3.waw3-1.cloudferro.com/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1?x-cop-client=copernicus-marine-toolbox&x-cop-client-version=2.0.0&x-cop-user=byang12', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7fe03d7f1450>, 'has_streaming_input': False, 'auth_type': 'none', 'unsigned_payload': None, 's3_redirect': {'redirected': False, 'bucket': 'mdl-arco-time-015', 'params': {'Bucket': 'mdl-arco-time-015', 'Key': 'arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1'}}, 'input_params': {'Bucket': 'mdl-arco-time-015', 'Key': 'arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1'}, 'signing': {}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'us-east-1'}]}}}
09:53:22 DEBUG botocore.hooks:238: Event request-created.s3.HeadObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7fe03d7f12d0>>
09:53:22 DEBUG botocore.hooks:238: Event choose-signer.s3.HeadObject: calling handler <function set_operation_specific_signer at 0x7fe04c18eac0>
09:53:22 DEBUG botocore.hooks:238: Event before-sign.s3.HeadObject: calling handler <function remove_arn_from_signing_path at 0x7fe04c1bd1c0>
09:53:22 DEBUG botocore.hooks:238: Event before-sign.s3.HeadObject: calling handler <function _set_extra_headers_for_unsigned_request at 0x7fe04c1bd8a0>
09:53:22 DEBUG botocore.hooks:238: Event before-sign.s3.HeadObject: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7fe03d822e10>>
09:53:22 DEBUG botocore.hooks:238: Event request-created.s3.HeadObject: calling handler <function add_retry_headers at 0x7fe04c1bcfe0>
09:53:22 DEBUG botocore.endpoint:263: Sending http request: <AWSPreparedRequest stream_output=False, method=HEAD, url=https://mdl-arco-time-015.s3.waw3-1.cloudferro.com/arco/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_merged-uv_PT1H-i_202211/timeChunked.zarr/utide/35076.0.2.1?x-cop-client=copernicus-marine-toolbox&x-cop-client-version=2.0.0&x-cop-user=byang12, headers={'User-Agent': b'Boto3/1.36.2 md/Botocore#1.36.2 ua/2.0 os/linux#5.15.0-130-generic md/arch#x86_64 lang/python#3.11.6 md/pyimpl#CPython cfg/retry-mode#standard Botocore/1.36.2', 'amz-sdk-invocation-id': b'8d0ffec2-e93f-4cbd-9577-b8a1beb3defb', 'amz-sdk-request': b'attempt=1'}>

[dayeno]

Hi again, I have reinstalled OpenDrift, but the issue still persists. I just wanted to check if there is any additional information I should provide? Thanks!

[knutfrode]

This debug output comes from copernicusmarine toolbox, but can be disabled with

import logging
logging.getLogger('botocore').setLevel(logging.INFO)

If you update to the latest version from Git, this is automatically disabled by OpenDrift. This is not yet available in the latest conda-version.