justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264893.173@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264893.173@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3518
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 09:32:32
SiteUS_UConn-HPC
EntryGLUEX_US_UConn-HPC_osgce
Last heartbeat2024-09-27 15:31:35
From worker nodeHostnamecn432
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 10:05:23
Input fileshd-protodune:np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518.hdf5
Outputting started2024-09-27 15:08:48
Output files
Finished2024-09-27 15:31:35
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

76761 traces tagged "wiener"
FrameSaver: q=2.43085e+06 n=924333 tag=wiener
8270 hits in TPC 0
5800 hits in TPC 1
4272 hits in TPC 2
1837 hits in TPC 3
4474 hits in TPC 4
5817 hits in TPC 5
10034 hits in TPC 6
4679 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 8207 XUs and 6488 XVs -> 187 XUVs
C:0 T:2 24431 XUs and 10922 XVs -> 448 XUVs
C:0 T:3 77 XUs and 83 XVs -> 4 XUVs
C:0 T:4 118 XUs and 219 XVs -> 2 XUVs
C:0 T:5 25714 XUs and 25795 XVs -> 764 XUVs
C:0 T:6 67351 XUs and 40007 XVs -> 2767 XUVs
C:0 T:7 1057 XUs and 898 XVs -> 31 XUVs
4203 XUVs total
1665 collection wire objects
4203 potential space points
Neighbour search...
293343 tests to find 105942 neighbours
Iterating with no regularization...
Begin: 5.41143e+07
0 4.57456e+07
1 4.50572e+07
2 4.50095e+07
3 4.50015e+07
Now with regularization...
Begin: 4.27802e+07
0 4.27501e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 11:08:37 EDT  Closed output file "np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1_reco_stage2_20240927T150837_keepup.root"
27-Sep-2024 11:08:37 EDT  Closed input file "np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              90.0026       143.63        248.088       139.054       38.0366        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000710181   0.00369764    0.00747216    0.00336208    0.00202991       35     
produce:fembfilter:PDHDFEMBFilter                      0.650028       0.80954      0.934333      0.836065      0.0888843       35     
produce:wclsdatahd:WireCellToolkit                      37.9632       48.3174       56.0322       49.3536       5.32647        35     
produce:gaushit:GausHitFinder                          0.525412      0.950594       1.5492       0.891541      0.300157        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000420824   0.000740836   0.00141853    0.000674643   0.000226701      35     
produce:reco3d:SpacePointSolver                        0.329717       1.89013       8.40252       1.46545       1.75759        35     
produce:hitpdune:DisambigFromSpacePoints               0.316057      0.825073       2.05188      0.731201      0.400194        35     
produce:pandora:StandardPandora                         11.5781       33.1542       70.5636       26.9878       16.5766        35     
produce:pandoraWriter:StandardPandora                  0.118786      0.247996      0.434273      0.240793      0.081155        35     
produce:pandoraTrack:LArPandoraTrackCreation           0.858053       3.21307       8.71361       2.86885       1.90939        35     
produce:pandoraShower:LArPandoraShowerCreation         0.760957       3.2755        10.4418       2.22092       2.35569        35     
produce:pandoracalo:Calorimetry                        0.445583       1.42582       4.61979       1.08006      0.906265        35     
produce:pandoracalonosce:Calorimetry                   0.399708       1.34621       4.2649        1.1692       0.880691        35     
produce:pandorapid:Chi2ParticleID                     0.00142072    0.00304721    0.00559528    0.00286054    0.00103928       35     
produce:pandoraShowercalo:ShowerCalorimetry            0.606655       3.12965       12.9053       2.21451       2.54461        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.624962       2.79461       10.4357       1.94498       2.13102        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0821651     0.180941      0.373322      0.162238      0.0666385       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0298604     0.0609105      0.13722      0.0583497     0.023173        35     
produce:emtrkmichelid:EmTrackMichelId                   23.4917       39.6754       60.2531       38.9272       9.18406        35     
[art]:TriggerResults:TriggerResultInserter            1.9918e-05    7.0728e-05    0.000160904    6.895e-05    3.15424e-05      35     
end_path:out1:RootOutput                              1.1832e-05    2.70033e-05   0.000127561    2.114e-05    2.21241e-05      35     
end_path:michelremoving:michelremoving                 0.0179268     0.0698394     0.314368      0.0427491     0.0651677       35     
end_path:michelremovinggnocchi:michelremoving          0.0162564     0.0661955     0.323628      0.0358758     0.0680077       35     
end_path:calibanagnocchi:CalibAnaTree                  0.299147      0.955896       2.46375      0.760649      0.514823        35     
end_path:out1:RootOutput(write)                        0.561029       1.01453       1.64022      0.965194      0.287029        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4998.99 MB
  Peak resident set size usage (VmHWM): 2640.99 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1_reco_stage2_20240927T150837_keepup.root
\tHists: np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1_reco_stage2_20240927T150837_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1_reco_stage2_20240927T150837_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1_reco_stage2_20240927T150837_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727444640.0,
    "core.end_time": 1727449718.0,
    "core.events": [
      30381,
      30385,
      30389,
      30393,
      30397,
      30401,
      30405,
      30409,
      30413,
      30417,
      30421,
      30425,
      30429,
      30433,
      30437,
      30441,
      30445,
      30449,
      30453,
      30457,
      30461,
      30465,
      30469,
      30473,
      30477,
      30481,
      30485,
      30489,
      30493,
      30497,
      30501,
      30505,
      30509,
      30513,
      30517
    ],
    "core.event_count": 35,
    "core.first_event_number": 30381,
    "core.last_event_number": 30517,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27404
    ],
    "core.runs_subruns": [
      2740400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518_reco_stage1_reco_stage2_20240927T150837_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727444640.0,
    "core.end_time": 1727449718.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27404
    ],
    "core.runs_subruns": [
      2740400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027404_0217_dataflow1_datawriter_0_20240624T120518.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:35 UTC       justIN version: 01.01.08