justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79965.92@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79965.92@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 08:20:21
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2024-09-27 17:10:03
From worker nodeHostnamedunegli-35088-0-cmswn2324.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 13:14:30
Input fileshd-protodune:np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654.hdf5
JobscriptExit code0
Real time3h (13832s)
CPU time1h (6172s = 44%)
Outputting started2024-09-27 17:06:27
Output fileshd-protodune-det-reco:np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup.root
hd-protodune-det-reco:np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup_hists.root
Finished2024-09-27 17:10:03
Saved logsjustin-logs:79965.92-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

"
FrameSaver: q=1.80537e+06 n=909204 tag=gauss
wclsFrameSaver: saving 63473 traces tagged "wiener"
FrameSaver: q=1.91438e+06 n=822303 tag=wiener
3264 hits in TPC 0
4344 hits in TPC 1
4162 hits in TPC 2
2115 hits in TPC 3
5418 hits in TPC 4
6527 hits in TPC 5
6259 hits in TPC 6
3318 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 16 XUs and 22 XVs -> 2 XUVs
C:0 T:1 2889 XUs and 2054 XVs -> 37 XUVs
C:0 T:2 7785 XUs and 11115 XVs -> 187 XUVs
C:0 T:3 25 XUs and 34 XVs -> 1 XUVs
C:0 T:4 88 XUs and 117 XVs -> 9 XUVs
C:0 T:5 26879 XUs and 25887 XVs -> 850 XUVs
C:0 T:6 16111 XUs and 9767 XVs -> 380 XUVs
C:0 T:7 159 XUs and 175 XVs -> 7 XUVs
1473 XUVs total
1110 collection wire objects
1473 potential space points
Neighbour search...
14701 tests to find 8542 neighbours
Iterating with no regularization...
Begin: 2.27625e+07
0 2.1855e+07
1 2.17918e+07
2 2.17905e+07
Now with regularization...
Begin: 2.07963e+07
0 2.07956e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 17:04:55 UTC  Closed output file "np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup.root"
27-Sep-2024 17:04:55 UTC  Closed input file "np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              87.3986       146.44        235.138       142.064       38.5016        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000347694   0.00196447    0.00493289     0.0016058    0.00123242       35     
produce:fembfilter:PDHDFEMBFilter                      0.614463      0.660912      0.786854      0.642803      0.0425442       35     
produce:wclsdatahd:WireCellToolkit                      38.0628       42.6446       48.6735       42.6135       2.70633        35     
produce:gaushit:GausHitFinder                           0.61487       1.03865       1.43681       1.03364      0.228939        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000185148   0.000373448   0.000757234   0.000354157   0.000121582      35     
produce:reco3d:SpacePointSolver                        0.287259       1.67772       4.44346       1.51141       1.05435        35     
produce:hitpdune:DisambigFromSpacePoints               0.460703       1.15507       2.5107        1.07518      0.551235        35     
produce:pandora:StandardPandora                         14.3379       49.7787       121.202       47.1086       24.8237        35     
produce:pandoraWriter:StandardPandora                   0.1091       0.193399      0.307396      0.193817      0.0442074       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.10616       2.77377       6.21633       2.31164       1.27709        35     
produce:pandoraShower:LArPandoraShowerCreation         0.947565       2.63693       5.06925       2.36508       1.1958         35     
produce:pandoracalo:Calorimetry                         0.53319       1.3437        3.12442       1.15161      0.619426        35     
produce:pandoracalonosce:Calorimetry                    0.49074       1.28874       3.04598       1.09281      0.612143        35     
produce:pandorapid:Chi2ParticleID                     0.00127131    0.00237497    0.00422373    0.00225756    0.000625636      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.815353        2.562        5.17734       2.1442        1.27697        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.805737       2.46784       4.75971       2.11836       1.2051         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0685991     0.145564      0.226561       0.14254      0.0353089       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.024361      0.0511646     0.0738077     0.0507847     0.0119079       35     
produce:emtrkmichelid:EmTrackMichelId                   21.1652       33.6222       49.6012       33.1827       7.09889        35     
[art]:TriggerResults:TriggerResultInserter            1.6059e-05    2.33669e-05    7.507e-05    2.1101e-05    1.04918e-05      35     
end_path:out1:RootOutput                               5.639e-06     7.463e-06    2.4911e-05     6.696e-06    3.11397e-06      35     
end_path:michelremoving:michelremoving                 0.0177092     0.126487       0.76673      0.0401124     0.152616        35     
end_path:michelremovinggnocchi:michelremoving          0.0167081     0.123218      0.760523      0.0369898     0.152617        35     
end_path:calibanagnocchi:CalibAnaTree                  0.439035       1.09082       2.37112      0.967361      0.508841        35     
end_path:out1:RootOutput(write)                        0.586101      0.963344       1.43352      0.970437      0.232267        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5085.43 MB
  Peak resident set size usage (VmHWM): 2731.88 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup.root
\tHists: np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727451523.0,
    "core.end_time": 1727456696.0,
    "core.events": [
      22005,
      22009,
      22013,
      22017,
      22021,
      22025,
      22029,
      22033,
      22037,
      22041,
      22045,
      22049,
      22053,
      22057,
      22061,
      22065,
      22069,
      22073,
      22077,
      22081,
      22085,
      22089,
      22093,
      22097,
      22101,
      22105,
      22109,
      22113,
      22117,
      22121,
      22125,
      22129,
      22133,
      22137,
      22141
    ],
    "core.event_count": 35,
    "core.first_event_number": 22005,
    "core.last_event_number": 22141,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27333
    ],
    "core.runs_subruns": [
      2733300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654_reco_stage1_reco_stage2_20240927T170455_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727451523.0,
    "core.end_time": 1727456696.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27333
    ],
    "core.runs_subruns": [
      2733300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027333_0157_dataflow1_datawriter_0_20240621T024654.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:23:35 UTC       justIN version: 01.01.08