justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265394.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265394.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3514
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 20:51:47
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2024-09-27 23:35:22
From worker nodeHostnamecdr175.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit84598 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 20:53:46
Input fileshd-protodune:np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500.hdf5
JobscriptExit code0
Real time2h (9618s)
CPU time2h (7234s = 75%)
Outputting started2024-09-27 23:34:05
Output fileshd-protodune-det-reco:np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup.root
hd-protodune-det-reco:np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup_hists.root
Finished2024-09-27 23:35:22
Saved logsjustin-logs:265394.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

summary
Retagger: tagging trace set: gauss with 80968 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 80968 traces tagged "gauss"
FrameSaver: q=3.85524e+06 n=1495054 tag=gauss
wclsFrameSaver: saving 110047 traces tagged "wiener"
FrameSaver: q=4.14261e+06 n=1351513 tag=wiener
5719 hits in TPC 0
5896 hits in TPC 1
10765 hits in TPC 2
8079 hits in TPC 3
4389 hits in TPC 4
9917 hits in TPC 5
13902 hits in TPC 6
6616 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 238 XUs and 166 XVs -> 13 XUVs
C:0 T:1 26865 XUs and 28071 XVs -> 1441 XUVs
C:0 T:2 72109 XUs and 72148 XVs -> 1716 XUVs
C:0 T:3 2164 XUs and 1838 XVs -> 42 XUVs
C:0 T:4 79 XUs and 58 XVs -> 1 XUVs
C:0 T:5 40617 XUs and 48019 XVs -> 1313 XUVs
C:0 T:6 89172 XUs and 114419 XVs -> 2767 XUVs
C:0 T:7 2558 XUs and 2558 XVs -> 253 XUVs
7546 XUVs total
2797 collection wire objects
7546 potential space points
Neighbour search...
273382 tests to find 149246 neighbours
Iterating with no regularization...
Begin: 5.16565e+08
0 4.80701e+08
1 4.78564e+08
2 4.78364e+08
Now with regularization...
Begin: 4.72492e+08
0 4.72447e+08
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 16:33:56 PDT  Closed output file "np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup.root"
27-Sep-2024 16:33:56 PDT  Closed input file "np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              115.494       170.465       240.598       169.121       35.2734        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000576282   0.00334418    0.00596197    0.00347328    0.00174141       35     
produce:fembfilter:PDHDFEMBFilter                      0.913524      0.935618       1.04328      0.926034      0.0277894       35     
produce:wclsdatahd:WireCellToolkit                      54.3811       56.0432       58.1162       55.892        1.02708        35     
produce:gaushit:GausHitFinder                          0.806094       1.28548       1.8449        1.29585      0.262264        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000379053   0.000537364   0.000858686   0.000520023   0.000110315      35     
produce:reco3d:SpacePointSolver                        0.576845       1.7855        4.90946       1.56109       1.02128        35     
produce:hitpdune:DisambigFromSpacePoints               0.524524       1.31545       2.73491       1.18423      0.492917        35     
produce:pandora:StandardPandora                         15.7687       47.5938       81.9565       49.0209       19.4427        35     
produce:pandoraWriter:StandardPandora                  0.162219       0.25178      0.360776      0.256443      0.0501206       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.95012       3.63227       6.08358       3.44597       1.18299        35     
produce:pandoraShower:LArPandoraShowerCreation          1.42977       3.94068       8.26874       3.87257       1.6058         35     
produce:pandoracalo:Calorimetry                        0.930368       1.6465        2.69251       1.52243       0.50458        35     
produce:pandoracalonosce:Calorimetry                   0.880721       1.53933       2.54664       1.37474       0.46865        35     
produce:pandorapid:Chi2ParticleID                     0.00229905    0.00309487    0.00483802    0.00306503    0.000564584      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.24523       3.44224       7.64489       3.23804       1.44143        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.21443       3.2775        7.39643       3.15669       1.38391        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.111082       0.19339       0.2762       0.191695      0.0376093       35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0409027     0.0688144     0.0995927     0.0718816     0.0128772       35     
produce:emtrkmichelid:EmTrackMichelId                   26.5194       40.6084       57.7258       40.8435       7.82891        35     
[art]:TriggerResults:TriggerResultInserter            3.1335e-05    4.88865e-05   8.4095e-05    4.7642e-05    1.2219e-05       35     
end_path:out1:RootOutput                              1.0815e-05    1.35643e-05   3.0866e-05    1.2263e-05    4.25603e-06      35     
end_path:michelremoving:michelremoving                 0.0265105     0.104088       0.5967       0.0513375     0.108809        35     
end_path:michelremovinggnocchi:michelremoving          0.0250432     0.0992794     0.588081      0.0460618      0.10785        35     
end_path:calibanagnocchi:CalibAnaTree                  0.682996       1.25869       2.22064       1.1871       0.393171        35     
end_path:out1:RootOutput(write)                         0.8098        1.28124       1.84549       1.28189      0.244226        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5036.76 MB
  Peak resident set size usage (VmHWM): 2716.34 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup.root
\tHists: np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727474016.0,
    "core.end_time": 1727480036.0,
    "core.events": [
      3504,
      3508,
      3512,
      3516,
      3520,
      3524,
      3528,
      3532,
      3536,
      3540,
      3544,
      3548,
      3552,
      3556,
      3560,
      3564,
      3568,
      3572,
      3576,
      3580,
      3584,
      3588,
      3592,
      3596,
      3600,
      3604,
      3608,
      3612,
      3616,
      3620,
      3624,
      3628,
      3632,
      3636,
      3640
    ],
    "core.event_count": 35,
    "core.first_event_number": 3504,
    "core.last_event_number": 3640,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27373
    ],
    "core.runs_subruns": [
      2737300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500_reco_stage1_reco_stage2_20240927T233356_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727474016.0,
    "core.end_time": 1727480036.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27373
    ],
    "core.runs_subruns": [
      2737300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027373_0025_dataflow0_datawriter_0_20240622T064500.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:25:33 UTC       justIN version: 01.01.08