[GCC] Build latest GCC 12 with stdcxx backtrace enabled

[smuzaffar]

• Build latest GCC 12 commit ( which contains Backported changes https://gcc.gnu.org/bugzilla/show_bug.cgi?id=111936 fix )
• enable stdcxx backtrace
• backport changes from GCC 13 branch to make gcc12 and gcc13 branches as close as possible

[smuzaffar]

test parameters:

• full_cmssw = true
• pull_request = Allow compiler package to have deps pkgtools#199

[smuzaffar]

please test

[cmsbuild]

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_14_0_X/devel.

@smuzaffar, @iarspider, @cmsbuild, @aandvalenzuela can you please review it and eventually sign? Thanks.
@antoniovilela, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

[smuzaffar]

please test

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-927d94/35884/summary.html
COMMIT: a120e24
CMSSW: CMSSW_14_0_DEVEL_X_2023-11-15-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8821/35884/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation error when building:

cwd: /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el8_amd64_gcc12/external/py3-cryptography/41.0.3-241ade3e3adff708a2e19cb7b5e2afa6/cmsdist-tmp/pip-req-build-0kh1f76f
Building wheel for cryptography (pyproject.toml): finished with status 'error'
ERROR: Failed building wheel for cryptography
Failed to build cryptography
ERROR: Could not build wheels for cryptography, which is required to install pyproject.toml-based projects
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.LaFC6Z (%build)


RPM build errors:
line 37: It's not recommended to have unversioned Obsoletes: Obsoletes: external+py3-cryptography+41.0.3-241ade3e3adff708a2e19cb7b5e2afa6
Macro expanded in comment on line 375: %{pkginstroot}/bin/*


[cmsbuild]

Pull request #8821 was updated.

[smuzaffar]

please test

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-927d94/35908/summary.html
COMMIT: f18bb97
CMSSW: CMSSW_14_0_DEVEL_X_2023-11-16-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8821/35908/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

[smuzaffar]

please test

[cmsbuild]

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-927d94/35912/summary.html
COMMIT: f18bb97
CMSSW: CMSSW_14_0_DEVEL_X_2023-11-16-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8821/35912/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @iarspider Drop cascade interface cmssw#37611
• @cms-sw Change devel build to use pybind11 for cmsRun cmssw#25975
• @Dr15Jones Concurrently run beginStreams cmssw#35230
• @mrodozov Revert TF changes on DEVEL cmssw#27710
• @Prasant1993 Add Correct EGM Run3 electron NonIso MVA ID for EB  cmssw#43275
• @osschar For async calls always store XrdCl::FileSystem with the response-handler. cmssw#35455
• @mrodozov Update clang headers location and changed interfaces cmssw#27663
• @Dr15Jones Run ES modules concurrently [CMSSW_11_2_DEVEL_X] cmssw#30145
• @Dr15Jones Change Sonic to use ExternalFailure exception cmssw#43274
• @davidlange6 Use python3 in cmsRun in DEVEL build  cmssw#26401
• @iarspider Drop Herwig6Interface, MCatNLOInterface, PomwigInterface cmssw#37612
• @mrodozov Update DQMServices for protobuf 3.6.1.2 and tensorflow interfaces for TF 1.13.1 (copy of 25889) cmssw#26689
• @osschar [XrdAdaptor] Delay additional source acquisition when redirect limit error is returned. cmssw#35498
• @dan131riley restrict FastTimerService to default arena cmssw#33126
• @mrodozov Remove CMS custom hacks for Oracle OCCI old C++ ABI compatibility cmssw#25691
• @smuzaffar [DEVEL] Delete unused FWCore/PyDevParameterSet/BuildFile.xml cmssw#35242
• @iarspider Remove Configuration/Generator/data/download.url cmssw#37610
• @fabiocos Revert PR 25975 "Change devel build to use pybind11 for cmsRun" cmssw#26293
• @iarspider Drop PhotosInterface, support for tauola 27.x from TauolaInterface cmssw#37616
• @osschar [XrdAdaptor] Modifications for xrootd-5.3 cmssw#34700

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-927d94/35912/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-927d94/35912/git-merge-result

Unit Tests

I found 2 errors in the following unit tests:

---> test runtestRecoEgammaElectronIdentification had ERRORS
---> test testTauEmbeddingProducers had ERRORS

RelVals

• 136.7611

----- Begin Fatal Exception 17-Nov-2023 16:28:58 CET-----------------------
An exception of category 'MVA config failure: ' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=ElectronMVAValueMapProducer label='electronMVAValueMapProducer'
Exception Message:
Concerning ElectronMVAEstimatorRun2RunIIIWinter22NoIsoV1
Variable ele_hcalPFClusterIso not found in variable definition file!
----- End Fatal Exception -------------------------------------------------

• 136.8311

----- Begin Fatal Exception 17-Nov-2023 16:28:58 CET-----------------------
An exception of category 'MVA config failure: ' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=ElectronMVAValueMapProducer label='electronMVAValueMapProducer'
Exception Message:
Concerning ElectronMVAEstimatorRun2RunIIIWinter22NoIsoV1
Variable ele_hcalPFClusterIso not found in variable definition file!
----- End Fatal Exception -------------------------------------------------

• 136.88811

----- Begin Fatal Exception 17-Nov-2023 16:28:59 CET-----------------------
An exception of category 'MVA config failure: ' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=ElectronMVAValueMapProducer label='electronMVAValueMapProducer'
Exception Message:
Concerning ElectronMVAEstimatorRun2RunIIIWinter22NoIsoV1
Variable ele_hcalPFClusterIso not found in variable definition file!
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

• 4.53
• 135.4
• 136.731
• 136.874
• 136.793
• 158.01
• 139.001
• 2018.1
• 9.0
• 1306.0
• 25.0
• 1330.0
• 312.0
• 141.044
• 13234.0
• 10042.0
• 14034.0
• 14234.0
• 10024.0
• 10824.0
• 11634.0
• 25202.0
• 2500.4
• 11634.911
• 12434.0
• 11634.914
• 10224.0
• 12434.7
• 24900.0
• 24896.0
• 12634.0
• 24834.0
• 23234.0
• 250202.181
• 25034.999
• 24834.911

[cmsbuild]

This PR contains many commits (152 >= 150) and will not be processed. Please ensure you have selected the correct target branch and consider squashing unnecessary commits.
@rappoccio, @smuzaffar, @sextonkennedy, @makortel, @Dr15Jones, @antoniovilela, to re-enable processing of this PR, you can write +commit-count in a comment. Thanks.