justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269662.21@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269662.21@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3574
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 00:06:56
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-05 04:46:19
From worker nodeHostnamedunegli-4177750-0-fnpc23013.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 02:57:55
Input fileshd-protodune:np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115.hdf5
JobscriptExit code0
Real time1h (6468s)
CPU time50m (3005s = 46%)
Outputting started2024-10-05 04:45:44
Output fileshd-protodune-det-reco:np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup.root
hd-protodune-det-reco:np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup_hists.root
Finished2024-10-05 04:46:19
Saved logsjustin-logs:269662.21-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

lsFrameSaver: saving 66085 traces tagged "wiener"
FrameSaver: q=2.35565e+06 n=858345 tag=wiener
2944 hits in TPC 0
2358 hits in TPC 1
6910 hits in TPC 2
4326 hits in TPC 3
5199 hits in TPC 4
9208 hits in TPC 5
5935 hits in TPC 6
2830 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 7 XUs and 5 XVs -> 0 XUVs
C:0 T:1 1407 XUs and 1847 XVs -> 87 XUVs
C:0 T:2 25913 XUs and 36657 XVs -> 8100 XUVs
C:0 T:3 554 XUs and 491 XVs -> 24 XUVs
C:0 T:4 111 XUs and 131 XVs -> 2 XUVs
C:0 T:5 44590 XUs and 68227 XVs -> 3225 XUVs
C:0 T:6 11707 XUs and 12735 XVs -> 461 XUVs
C:0 T:7 57 XUs and 53 XVs -> 2 XUVs
11901 XUVs total
2197 collection wire objects
11901 potential space points
Neighbour search...
2090127 tests to find 1050946 neighbours
Iterating with no regularization...
Begin: 1.50634e+08
0 9.64529e+07
1 8.99136e+07
2 8.95209e+07
3 8.94521e+07
Now with regularization...
Begin: 8.37009e+07
0 8.36256e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 04:45:39 UTC  Closed output file "np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup.root"
05-Oct-2024 04:45:39 UTC  Closed input file "np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              40.7593       60.2791       91.4518       59.7841       12.3897        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000427738   0.00147793    0.00329881    0.00135813    0.000847427      40     
produce:fembfilter:PDHDFEMBFilter                      0.581768      0.660861      0.853946      0.633465      0.0638559       40     
produce:wclsdatahd:WireCellToolkit                      22.9886       24.5157       28.4124       24.1206       1.30025        40     
produce:gaushit:GausHitFinder                          0.238763      0.453612      0.759628      0.451241       0.11443        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000181617   0.000293043   0.000445682   0.000284794   6.44311e-05      40     
produce:reco3d:SpacePointSolver                        0.164455       0.9346        7.2607       0.454747       1.39079        40     
produce:hitpdune:DisambigFromSpacePoints               0.109676      0.370197       0.97846      0.347892      0.203744        40     
produce:pandora:StandardPandora                         3.24195       9.2207        25.3076       7.51844       4.55319        40     
produce:pandoraWriter:StandardPandora                  0.0520423     0.0938927     0.208312      0.0873087     0.0342932       40     
produce:pandoraTrack:LArPandoraTrackCreation            0.34072       0.77583       1.62688      0.736828      0.290778        40     
produce:pandoraShower:LArPandoraShowerCreation          0.29212      0.927718       2.05772      0.875018      0.421023        40     
produce:pandoracalo:Calorimetry                        0.190586      0.423185      0.886574      0.425603      0.153524        40     
produce:pandoracalonosce:Calorimetry                   0.170766       0.39139      0.835573      0.380668      0.145069        40     
produce:pandorapid:Chi2ParticleID                     0.000852309   0.00140568    0.00281536     0.0013986    0.000367431      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.265879      0.910784       2.21051      0.834076      0.428653        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.255621      0.872961       2.08056      0.804405      0.408591        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0444635     0.0778814      0.12614      0.0787939     0.0182246       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0155817     0.0259914     0.0435527     0.0264113    0.00635735       40     
produce:emtrkmichelid:EmTrackMichelId                   10.6301       18.5856       29.9281       18.4178       4.55536        40     
[art]:TriggerResults:TriggerResultInserter            1.5399e-05    2.60043e-05   7.4271e-05    2.19965e-05   1.31439e-05      40     
end_path:out1:RootOutput                               7.194e-06    1.15992e-05   2.5779e-05    1.1177e-05    3.17924e-06      40     
end_path:michelremoving:michelremoving                0.00963177     0.0374062     0.114022      0.018978      0.0323623       40     
end_path:michelremovinggnocchi:michelremoving         0.00764932     0.034935      0.110099      0.0161081     0.0322066       40     
end_path:calibanagnocchi:CalibAnaTree                   0.13556      0.333226      0.660054      0.330406      0.111127        40     
end_path:out1:RootOutput(write)                        0.306588      0.548012       1.03445      0.545023      0.149102        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4982.32 MB
  Peak resident set size usage (VmHWM): 2661.73 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup.root
\tHists: np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728101103.0,
    "core.end_time": 1728103539.0,
    "core.events": [
      6013,
      6014,
      6015,
      6016,
      6017,
      6018,
      6019,
      6020,
      6021,
      6022,
      6023,
      6024,
      6025,
      6026,
      6027,
      6028,
      6029,
      6030,
      6031,
      6032,
      6033,
      6034,
      6035,
      6036,
      6037,
      6038,
      6039,
      6040,
      6041,
      6042,
      6043,
      6044,
      6045,
      6046,
      6047,
      6048,
      6049,
      6050,
      6051,
      6052
    ],
    "core.event_count": 40,
    "core.first_event_number": 6013,
    "core.last_event_number": 6052,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27555
    ],
    "core.runs_subruns": [
      2755500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115_reco_stage1_reco_stage2_20241005T044539_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728101103.0,
    "core.end_time": 1728103539.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27555
    ],
    "core.runs_subruns": [
      2755500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027555_0150_dataflow0_datawriter_0_20240630T080115.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:57:12 UTC       justIN version: 01.01.09