Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Bug: add_replication_rule method failing on more than 6000 blocks #866

Open
hassan11196 opened this issue Nov 25, 2024 · 2 comments
Open
Assignees
Labels

Comments

@hassan11196
Copy link
Member

Bug Description

The add_replication_rule method of the rucio python client fails with the following error.

Details: no error information passed (http status code: 413)

The request creating this transfer was misconfigured so we rejected that workflow.
I am reporting the issue here for future reference. FYI @haozturk

Reproduction Steps

I don't know which HTTP endpoint is used by the Rucio Python client underneath, Therefore I am just providing details about the client.

  1. use add_replication_rule method to create a rule for more than 6000 blocks.

Expected Behavior

No response

Possible Solution

No response

Related Issues

No response

@haozturk haozturk self-assigned this Nov 26, 2024
@haozturk
Copy link
Contributor

Hi @hassan11196 can please provide the exact command that gives this error?

@hassan11196
Copy link
Member Author

Hi @haozturk

here is the rucio method being called that fails
https://github.com/dmwm/WMCore/blob/90a14e513d8bce727388f6dcf6b7dac80b616fbd/src/python/WMCore/Services/Rucio/Rucio.py#L515C13-L515C92

Following is the Log Message in MS-Transferor with the dataset name:

Creating rule for workflow cmsunified_EXT_task_BPH-GenericGSmearS-00004__v1_T_241111_214602_7530 with 6764 DIDs in container /InclusiveDileptonMinBias_TuneCP5Plus_13p6TeV_pythia8/GenericNoSmearGEN-124X_mcRun3_2022_realistic_v12-v2/GEN, RSEs: T2_CH_CERN|T1_US_FNAL_Disk, grouping: DATASET

In the following file, you can find the complete list of blocks.
rucio_failing_method.txt

Let me know if you need anything else.
Thanks

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants