justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59389.42@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59389.42@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2866
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 17:46:49
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2024-08-18 19:39:47
From worker nodeHostnamewn-lot-027.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 18:28:53
Input fileshd-protodune:np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730.hdf5
Outputting started2024-08-18 19:38:43
Output files
Finished2024-08-18 19:39:47
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

its in TPC 2
2073 hits in TPC 3
4113 hits in TPC 4
6167 hits in TPC 5
5207 hits in TPC 6
3432 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 455 XUs and 277 XVs -> 12 XUVs
C:0 T:2 8416 XUs and 6123 XVs -> 190 XUVs
C:0 T:3 245 XUs and 182 XVs -> 9 XUVs
C:0 T:4 85 XUs and 184 XVs -> 7 XUVs
C:0 T:5 29581 XUs and 56396 XVs -> 4935 XUVs
C:0 T:6 12547 XUs and 11719 XVs -> 534 XUVs
C:0 T:7 63 XUs and 66 XVs -> 7 XUVs
5694 XUVs total
1022 collection wire objects
5694 potential space points
Neighbour search...
852196 tests to find 483276 neighbours
Iterating with no regularization...
Begin: 4.93236e+06
0 4.14923e+06
1 4.11767e+06
2 4.10981e+06
3 4.10685e+06
Now with regularization...
Begin: 3.74675e+06
0 3.74355e+06
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  1   event 89996 TrkackID 10 startx, y, z 32.2388 271.019 445.11  wireno, peakt tpcno 274 2583.99 5 dist 0min T, max_T2582.57 3820.65
no of hits closeby  1   event 89996 TrkackID 10 startx, y, z 32.2388 271.019 445.11  wireno, peakt tpcno 274 2583.99 5 dist 0min T, max_T2582.57 3820.65
18-Aug-2024 21:38:35 CEST  Closed output file "np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1_reco_stage2_20240818T193835_keepup.root"
18-Aug-2024 21:38:35 CEST  Closed input file "np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              60.059        100.202       183.499       93.7974       27.4608        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000452707   0.00180689    0.00302928    0.00196589    0.000786145      30     
produce:fembfilter:PDHDFEMBFilter                      0.608347      0.631303      0.665171      0.630653      0.0110096       30     
produce:wclsdatahd:WireCellToolkit                      33.659        35.4298       36.7846       35.4191      0.771965        30     
produce:gaushit:GausHitFinder                          0.323641      0.719763       1.04224      0.735545      0.187947        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000260777   0.000559234   0.000987598   0.000564131   0.000200368      30     
produce:reco3d:SpacePointSolver                        0.146501       1.50829       12.9351      0.876822       2.23256        30     
produce:hitpdune:DisambigFromSpacePoints               0.137048      0.616064       1.59116       0.53505       0.35181        30     
produce:pandora:StandardPandora                         4.75896       23.4274       81.7436       20.8862       15.6969        30     
produce:pandoraWriter:StandardPandora                  0.090076      0.183167      0.272568      0.182294      0.0486849       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.352819       1.53955       3.34657       1.49606      0.769912        30     
produce:pandoraShower:LArPandoraShowerCreation         0.378164       1.60317       4.28227       1.29184      0.935486        30     
produce:pandoracalo:Calorimetry                        0.219718      0.739853       1.61855      0.731466       0.33008        30     
produce:pandoracalonosce:Calorimetry                   0.191609      0.685742       1.58675      0.636939      0.322902        30     
produce:pandorapid:Chi2ParticleID                     0.00123124    0.00198674    0.00282372    0.00199267    0.000382699      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.339135       1.44927       3.68909       1.17657      0.836479        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.333682       1.38716       3.53558       1.13954       0.79079        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0880881     0.143563      0.228699      0.136776      0.0377063       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0310067     0.0509188     0.0802613     0.0477657     0.0128045       30     
produce:emtrkmichelid:EmTrackMichelId                   16.7976       28.3848       41.3116       28.3357       6.59956        30     
[art]:TriggerResults:TriggerResultInserter            1.6501e-05    2.1427e-05    6.7677e-05    1.90505e-05   9.27333e-06      30     
end_path:out1:RootOutput                               3.567e-06    4.79297e-06   1.9967e-05     4.323e-06    2.83618e-06      30     
end_path:michelremoving:michelremoving                 0.0146116     0.049159      0.222515      0.0270293     0.0506634       30     
end_path:michelremovinggnocchi:michelremoving          0.0142249     0.0475299     0.218255      0.0260494     0.0498953       30     
end_path:calibanagnocchi:CalibAnaTree                  0.129327      0.549791       1.17465      0.537045      0.263987        30     
end_path:out1:RootOutput(write)                        0.497323      0.922482       1.35312      0.894219      0.228878        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4953.26 MB
  Peak resident set size usage (VmHWM): 2637.3 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1_reco_stage2_20240818T193835_keepup.root
\tHists: np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1_reco_stage2_20240818T193835_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1_reco_stage2_20240818T193835_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1_reco_stage2_20240818T193835_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724006873.0,
    "core.end_time": 1724009915.0,
    "core.events": [
      89764,
      89772,
      89780,
      89788,
      89796,
      89804,
      89812,
      89820,
      89828,
      89836,
      89844,
      89852,
      89860,
      89868,
      89876,
      89884,
      89892,
      89900,
      89908,
      89916,
      89924,
      89932,
      89940,
      89948,
      89956,
      89964,
      89972,
      89980,
      89988,
      89996
    ],
    "core.event_count": 30,
    "core.first_event_number": 89764,
    "core.last_event_number": 89996,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730_reco_stage1_reco_stage2_20240818T193835_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724006873.0,
    "core.end_time": 1724009915.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0374_dataflow4_datawriter_0_20240818T151730.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:49:55 UTC       justIN version: 01.01.09