justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 78034.17@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID78034.17@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3453
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 05:07:26
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce02
Last heartbeat2024-09-26 09:28:54
From worker nodeHostnameccwcondor0550
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 06:44:17
Input fileshd-protodune:np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636.hdf5
Outputting started2024-09-26 07:52:51
Output files
Finished2024-09-26 09:28:54
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

meSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 41170 traces tagged "gauss"
FrameSaver: q=949056 n=800037 tag=gauss
wclsFrameSaver: saving 55562 traces tagged "wiener"
FrameSaver: q=1.01278e+06 n=731578 tag=wiener
2173 hits in TPC 0
1723 hits in TPC 1
6367 hits in TPC 2
2967 hits in TPC 3
1986 hits in TPC 4
2529 hits in TPC 5
7927 hits in TPC 6
3832 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 34 XUs and 29 XVs -> 0 XUVs
C:0 T:2 43201 XUs and 39061 XVs -> 3099 XUVs
C:0 T:3 486 XUs and 610 XVs -> 20 XUVs
C:0 T:4 131 XUs and 220 XVs -> 12 XUVs
C:0 T:5 3396 XUs and 3741 XVs -> 234 XUVs
C:0 T:6 53518 XUs and 60071 XVs -> 2185 XUVs
C:0 T:7 749 XUs and 733 XVs -> 14 XUVs
5564 XUVs total
1720 collection wire objects
5564 potential space points
Neighbour search...
258320 tests to find 142736 neighbours
Iterating with no regularization...
Begin: 7.87813e+06
0 6.41478e+06
1 6.30852e+06
2 6.28838e+06
3 6.28251e+06
Now with regularization...
Begin: 5.56653e+06
0 5.56266e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 09:52:36 CEST  Closed output file "np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1_reco_stage2_20240926T075236_keepup.root"
26-Sep-2024 09:52:36 CEST  Closed input file "np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              65.2342       98.3474       139.039       95.2917       19.6223        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000334209   0.00270882    0.00519625    0.00276214    0.00133578       30     
produce:fembfilter:PDHDFEMBFilter                      0.540209      0.696798       1.03666      0.728191      0.110261        30     
produce:wclsdatahd:WireCellToolkit                      36.7688       42.9097       48.7658       43.6247       3.79613        30     
produce:gaushit:GausHitFinder                           0.38301      0.719408       1.20049      0.701006      0.190739        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000261182   0.000437524   0.000814484   0.000415763   0.000123703      30     
produce:reco3d:SpacePointSolver                        0.212114      0.952817       6.44426      0.652634       1.12305        30     
produce:hitpdune:DisambigFromSpacePoints               0.148981      0.486478       1.04289      0.446144      0.236623        30     
produce:pandora:StandardPandora                         4.99316       12.5979       27.8037       11.3653       5.4368         30     
produce:pandoraWriter:StandardPandora                  0.0584754     0.159605      0.256788      0.161022      0.049201        30     
produce:pandoraTrack:LArPandoraTrackCreation           0.413909       1.15067       2.12764       1.02833      0.429004        30     
produce:pandoraShower:LArPandoraShowerCreation         0.342191       1.35961       2.7339        1.23377      0.610477        30     
produce:pandoracalo:Calorimetry                        0.214346      0.614208       1.3177       0.569671      0.238051        30     
produce:pandoracalonosce:Calorimetry                   0.182584      0.532556       1.00242      0.505786      0.180527        30     
produce:pandorapid:Chi2ParticleID                      0.001253     0.00206703    0.00625744    0.00200468    0.00086431       30     
produce:pandoraShowercalo:ShowerCalorimetry            0.342924       1.2351        2.59076       1.16619      0.519306        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.321699       1.24102       2.42327       1.17624      0.503185        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0877685     0.159269      0.322518      0.158101      0.0518013       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0302298     0.0557743     0.084022      0.0544672     0.0167809       30     
produce:emtrkmichelid:EmTrackMichelId                   14.1917       31.8942       49.4372       29.9808       8.95941        30     
[art]:TriggerResults:TriggerResultInserter            1.9817e-05    4.39174e-05   0.000150193   3.46605e-05   2.65992e-05      30     
end_path:out1:RootOutput                               7.835e-06    1.16306e-05   3.9024e-05    1.01295e-05   5.74504e-06      30     
end_path:michelremoving:michelremoving                 0.0198609     0.0809457      0.33754      0.0326083     0.0873324       30     
end_path:michelremovinggnocchi:michelremoving          0.0131338     0.0731643     0.277335      0.0312683     0.0781047       30     
end_path:calibanagnocchi:CalibAnaTree                  0.185393      0.455174      0.782926      0.439941      0.148024        30     
end_path:out1:RootOutput(write)                        0.508573      0.835917       1.14348      0.830839      0.180355        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4942.75 MB
  Peak resident set size usage (VmHWM): 2375.52 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1_reco_stage2_20240926T075236_keepup.root
\tHists: np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1_reco_stage2_20240926T075236_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1_reco_stage2_20240926T075236_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1_reco_stage2_20240926T075236_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727334165.0,
    "core.end_time": 1727337156.0,
    "core.events": [
      850298,
      850306,
      850362,
      850370,
      850378,
      850386,
      850394,
      850402,
      850410,
      850418,
      850426,
      850434,
      850442,
      850450,
      850458,
      850466,
      850474,
      850482,
      850490,
      850498,
      850506,
      850514,
      850522,
      850530,
      850538,
      850546,
      850554,
      850562,
      850570,
      850578
    ],
    "core.event_count": 30,
    "core.first_event_number": 850298,
    "core.last_event_number": 850578,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636_reco_stage1_reco_stage2_20240926T075236_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727334165.0,
    "core.end_time": 1727337156.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_3543_dataflow2_datawriter_0_20240909T030636.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:28:03 UTC       justIN version: 01.01.08