justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273778.23@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID273778.23@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3670
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-12 02:11:03
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2024-10-12 03:25:17
From worker nodeHostnamer21-n08.ph.liv.ac.uk
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit259200 (72 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-12 02:13:37
Input fileshd-protodune:np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400.hdf5
Outputting started2024-10-12 03:21:59
Output files
Finished2024-10-12 03:25:15
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 34828 traces, 34828 summary
Retagger: tagging trace set: gauss with 26996 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 26996 traces tagged "gauss"
FrameSaver: q=1.10873e+06 n=530192 tag=gauss
wclsFrameSaver: saving 34828 traces tagged "wiener"
FrameSaver: q=1.16533e+06 n=481157 tag=wiener
2698 hits in TPC 0
1795 hits in TPC 1
3872 hits in TPC 2
3350 hits in TPC 3
1909 hits in TPC 4
3139 hits in TPC 5
4288 hits in TPC 6
2201 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 194 XUs and 146 XVs -> 4 XUVs
C:0 T:2 8421 XUs and 5810 XVs -> 419 XUVs
C:0 T:3 561 XUs and 393 XVs -> 8 XUVs
C:0 T:4 124 XUs and 125 XVs -> 7 XUVs
C:0 T:5 3471 XUs and 2833 XVs -> 130 XUVs
C:0 T:6 6225 XUs and 6713 XVs -> 639 XUVs
C:0 T:7 157 XUs and 150 XVs -> 15 XUVs
1222 XUVs total
574 collection wire objects
1222 potential space points
Neighbour search...
29420 tests to find 18460 neighbours
Iterating with no regularization...
Begin: 9.13302e+06
0 8.29855e+06
1 8.16771e+06
2 8.16032e+06
Now with regularization...
Begin: 7.48086e+06
0 7.47738e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Oct-2024 04:21:52 BST  Closed output file "np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1_reco_stage2_20241012T032152_keepup.root"
12-Oct-2024 04:21:52 BST  Closed input file "np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              31.7519       66.1361       107.956       64.8077        14.54         33     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000558488   0.00165425    0.00377607    0.00166983    0.000793672      33     
produce:fembfilter:PDHDFEMBFilter                      0.479361      0.497791      0.561151      0.497332      0.0127197       33     
produce:wclsdatahd:WireCellToolkit                      25.9613       27.8609       29.9226       27.9268      0.853243        33     
produce:gaushit:GausHitFinder                          0.241022      0.476773      0.925715      0.482257      0.127829        33     
produce:nhitsfilter:NumberOfHitsFilter                0.00016556    0.000280358   0.000635893   0.000263705   7.72369e-05      33     
produce:reco3d:SpacePointSolver                        0.101407       0.65499       3.16311      0.469235      0.636377        32     
produce:hitpdune:DisambigFromSpacePoints               0.102123      0.366598       1.08499      0.333979      0.204741        32     
produce:pandora:StandardPandora                         3.63037       9.94242       35.7906       8.52343       6.30681        32     
produce:pandoraWriter:StandardPandora                  0.0517155     0.100991      0.143692      0.100125      0.0245745       32     
produce:pandoraTrack:LArPandoraTrackCreation            0.27475       1.00655       2.12853      0.956759      0.426131        32     
produce:pandoraShower:LArPandoraShowerCreation         0.281653       1.13124       2.13058       1.05261      0.491584        32     
produce:pandoracalo:Calorimetry                        0.172096      0.523254       1.09688      0.496245      0.199112        32     
produce:pandoracalonosce:Calorimetry                   0.147838      0.478273      0.918285      0.454889      0.177102        32     
produce:pandorapid:Chi2ParticleID                     0.000966483   0.00141421    0.00229459    0.00140228    0.00028483       32     
produce:pandoraShowercalo:ShowerCalorimetry             0.27464       1.07247       2.12765       1.01667      0.442902        32     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.260893       1.01406       1.96745      0.949731      0.415308        32     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0448735     0.0753665     0.106647      0.0766198     0.0155117       32     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0152579     0.0262107     0.0386732     0.026713     0.00568656       32     
produce:emtrkmichelid:EmTrackMichelId                   13.7598       20.9789       29.0794       20.8782       4.41652        32     
[art]:TriggerResults:TriggerResultInserter            1.6041e-05    2.63925e-05   8.3016e-05    2.2672e-05    1.24925e-05      33     
end_path:out1:RootOutput                               4.138e-06    9.48058e-06   2.8504e-05     9.128e-06    3.62039e-06      33     
end_path:michelremoving:michelremoving                1.3445e-05     0.0483447     0.227998      0.0225805     0.0501401       33     
end_path:michelremovinggnocchi:michelremoving          4.468e-06     0.043125       0.20778      0.0204745     0.0443039       33     
end_path:calibanagnocchi:CalibAnaTree                  3.497e-06     0.362035      0.760784      0.372349      0.145423        33     
end_path:out1:RootOutput(write)                        0.313208      0.494804      0.677539      0.502235      0.103165        33     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4995.84 MB
  Peak resident set size usage (VmHWM): 2388.94 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1_reco_stage2_20241012T032152_keepup.root
\tHists: np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1_reco_stage2_20241012T032152_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1_reco_stage2_20241012T032152_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1_reco_stage2_20241012T032152_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728701102.0,
    "core.end_time": 1728703312.0,
    "core.events": [
      9736,
      9744,
      9752,
      9760,
      9768,
      9776,
      9784,
      9792,
      9800,
      9808,
      9816,
      9824,
      9832,
      9840,
      9848,
      9856,
      9864,
      9872,
      9880,
      9888,
      9896,
      9904,
      9912,
      9920,
      9928,
      9936,
      9944,
      9952,
      9960,
      9968,
      9976,
      9984,
      9992
    ],
    "core.event_count": 33,
    "core.first_event_number": 9736,
    "core.last_event_number": 9992,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27969
    ],
    "core.runs_subruns": [
      2796900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400_reco_stage1_reco_stage2_20241012T032152_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728701102.0,
    "core.end_time": 1728703312.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27969
    ],
    "core.runs_subruns": [
      2796900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027969_0038_dataflow0_datawriter_0_20240710T164400.hdf5"
    }
  ]
}
justIN time: 2024-11-24 02:13:42 UTC       justIN version: 01.01.09