justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79532.127@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79532.127@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3518
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 19:24:20
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2024-09-27 16:09:28
From worker nodeHostnamecdr490.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit84598 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 00:22:50
Input fileshd-protodune:np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914.hdf5
JobscriptExit code0
Real time15h (54928s)
CPU time1h (6740s = 12%)
Outputting started2024-09-27 15:38:20
Output fileshd-protodune-det-reco:np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup.root
hd-protodune-det-reco:np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup_hists.root
Finished2024-09-27 16:09:28
Saved logsjustin-logs:79532.127-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ith 54793 traces, 54793 summary
Retagger: tagging trace set: gauss with 42444 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 42444 traces tagged "gauss"
FrameSaver: q=1.6277e+06 n=809413 tag=gauss
wclsFrameSaver: saving 54793 traces tagged "wiener"
FrameSaver: q=1.73395e+06 n=734320 tag=wiener
2824 hits in TPC 0
2675 hits in TPC 1
4648 hits in TPC 2
2735 hits in TPC 3
4382 hits in TPC 4
5853 hits in TPC 5
5059 hits in TPC 6
3854 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 829 XUs and 844 XVs -> 22 XUVs
C:0 T:2 9838 XUs and 11706 XVs -> 625 XUVs
C:0 T:3 266 XUs and 286 XVs -> 15 XUVs
C:0 T:4 2095 XUs and 960 XVs -> 149 XUVs
C:0 T:5 20395 XUs and 16078 XVs -> 490 XUVs
C:0 T:6 9674 XUs and 12478 XVs -> 878 XUVs
C:0 T:7 129 XUs and 144 XVs -> 0 XUVs
2179 XUVs total
1339 collection wire objects
2179 potential space points
Neighbour search...
31001 tests to find 18608 neighbours
Iterating with no regularization...
Begin: 2.97139e+07
0 2.80301e+07
1 2.78855e+07
2 2.78788e+07
Now with regularization...
Begin: 2.61923e+07
0 2.61916e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 08:38:09 PDT  Closed output file "np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup.root"
27-Sep-2024 08:38:09 PDT  Closed input file "np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              108.036       157.146       261.183       153.016       28.815         35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000563542   0.00307138    0.00524657    0.00316417    0.00154313       35     
produce:fembfilter:PDHDFEMBFilter                      0.907418      0.919257      0.952371      0.918388     0.00775534       35     
produce:wclsdatahd:WireCellToolkit                      53.2322       55.2536       59.9758       55.0534       1.19405        35     
produce:gaushit:GausHitFinder                           0.93251       1.24734       1.64946       1.2551       0.190233        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000395153   0.000508989   0.00067072    0.000509263   6.15053e-05      35     
produce:reco3d:SpacePointSolver                        0.367061       1.59484       3.42732       1.54589      0.754389        35     
produce:hitpdune:DisambigFromSpacePoints               0.486056       1.14175       2.35265       1.10074      0.394938        35     
produce:pandora:StandardPandora                         14.154        39.0455       104.716       37.696        16.9285        35     
produce:pandoraWriter:StandardPandora                  0.163289      0.240285      0.344016      0.245681      0.0373034       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.4134        3.64896       8.3221        3.48332       1.47581        35     
produce:pandoraShower:LArPandoraShowerCreation          1.69485       3.8516        8.39454       3.66239       1.51985        35     
produce:pandoracalo:Calorimetry                         0.7718        1.5892        3.37955       1.48821      0.571372        35     
produce:pandoracalonosce:Calorimetry                   0.703758       1.50116       3.37997       1.43875      0.566931        35     
produce:pandorapid:Chi2ParticleID                     0.00180377    0.00293254    0.00457337    0.00276459    0.000624209      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.43831       3.17372       6.38788       3.01903       1.17757        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.37964       3.00558       5.63823       2.96503        1.078         35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.114398      0.183308       0.25779      0.188512      0.0298561       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0433495     0.0657291     0.0887296     0.0664021     0.0101745       35     
produce:emtrkmichelid:EmTrackMichelId                   26.6095       37.9567       54.7095       38.6411       5.82088        35     
[art]:TriggerResults:TriggerResultInserter            2.8699e-05    4.80008e-05    8.821e-05    4.9856e-05    1.18626e-05      35     
end_path:out1:RootOutput                               8.789e-06    1.21037e-05   2.9081e-05    1.1142e-05    3.65906e-06      35     
end_path:michelremoving:michelremoving                 0.0327555     0.108177      0.354112      0.0531951     0.0806559       35     
end_path:michelremovinggnocchi:michelremoving          0.029437      0.103115      0.347017      0.0467243     0.0799743       35     
end_path:calibanagnocchi:CalibAnaTree                  0.532933       1.1732        2.80684       1.06354      0.472216        35     
end_path:out1:RootOutput(write)                         0.82703       1.18761       1.65146       1.2024       0.190533        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4995.57 MB
  Peak resident set size usage (VmHWM): 2674.41 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup.root
\tHists: np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727445936.0,
    "core.end_time": 1727451490.0,
    "core.events": [
      12043,
      12047,
      12051,
      12055,
      12059,
      12063,
      12067,
      12071,
      12075,
      12079,
      12083,
      12087,
      12091,
      12095,
      12099,
      12103,
      12107,
      12111,
      12115,
      12119,
      12123,
      12127,
      12131,
      12135,
      12139,
      12143,
      12147,
      12151,
      12155,
      12159,
      12163,
      12167,
      12171,
      12175,
      12179
    ],
    "core.event_count": 35,
    "core.first_event_number": 12043,
    "core.last_event_number": 12179,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27404
    ],
    "core.runs_subruns": [
      2740400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914_reco_stage1_reco_stage2_20240927T153809_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727445936.0,
    "core.end_time": 1727451490.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27404
    ],
    "core.runs_subruns": [
      2740400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027404_0086_dataflow3_datawriter_0_20240624T105914.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:31:38 UTC       justIN version: 01.01.08