justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59394.113@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59394.113@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-18 18:21:11
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel
Last heartbeat2024-08-18 20:36:52
From worker nodeHostnamewn-choc-032.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-18 19:09:27
Input fileshd-protodune:np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108.hdf5
Outputting started2024-08-18 20:35:49
Output files
Finished2024-08-18 20:36:52
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

XUs and 7556 XVs -> 961 XUVs
C:0 T:2 10215 XUs and 14031 XVs -> 351 XUVs
C:0 T:3 1 XUs and 1 XVs -> 0 XUVs
C:0 T:4 37 XUs and 33 XVs -> 3 XUVs
C:0 T:5 11714 XUs and 11748 XVs -> 432 XUVs
C:0 T:6 5697 XUs and 7010 XVs -> 219 XUVs
C:0 T:7 145 XUs and 136 XVs -> 10 XUVs
1976 XUVs total
876 collection wire objects
1976 potential space points
Neighbour search...
46160 tests to find 28308 neighbours
Iterating with no regularization...
Begin: 5.38099e+06
0 5.15149e+06
1 5.13862e+06
2 5.13719e+06
Now with regularization...
Begin: 4.96292e+06
0 4.96254e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  2   event 136570 TrkackID 0 startx, y, z 189.761 489.968 151.184  wireno, peakt tpcno 291 881.635 5 dist 0min T, max_T5.38948 2428.34
no of hits closeby  0   event 136570 TrkackID 3 startx, y, z 140.223 595.517 377.813  wireno, peakt tpcno 81 5 5 dist 0min T, max_T5 2385.88
no of hits closeby  2   event 136570 TrkackID 0 startx, y, z 189.761 489.968 151.184  wireno, peakt tpcno 291 881.635 5 dist 0min T, max_T5.38948 2428.34
no of hits closeby  0   event 136570 TrkackID 3 startx, y, z 140.223 595.517 377.813  wireno, peakt tpcno 81 5 5 dist 0min T, max_T5 2385.88
18-Aug-2024 22:35:41 CEST  Closed output file "np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1_reco_stage2_20240818T203541_keepup.root"
18-Aug-2024 22:35:41 CEST  Closed input file "np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              80.5211       126.214       189.559       120.11        28.3712        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000385443   0.00253021    0.00430208    0.00269841    0.00107525       30     
produce:fembfilter:PDHDFEMBFilter                      0.696483      0.715126      0.803028      0.710305      0.0189048       30     
produce:wclsdatahd:WireCellToolkit                      45.9978       47.815        49.0057       47.7643       0.79657        30     
produce:gaushit:GausHitFinder                          0.544375      0.949252       1.39381      0.971952      0.222537        30     
produce:nhitsfilter:NumberOfHitsFilter                0.00025743    0.000453448   0.000679783   0.000445582   8.82524e-05      30     
produce:reco3d:SpacePointSolver                        0.145824       1.33228       3.50437       1.1291        0.77918        30     
produce:hitpdune:DisambigFromSpacePoints               0.203989       0.84237       1.68635      0.804214      0.372181        30     
produce:pandora:StandardPandora                         7.5192        29.7821       68.524        26.315        15.7718        30     
produce:pandoraWriter:StandardPandora                  0.106561      0.196044      0.297642       0.19219      0.0434975       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.787144       2.40483       5.50874       2.2365        1.11964        30     
produce:pandoraShower:LArPandoraShowerCreation         0.575847       2.47204       5.65493       2.06931       1.35399        30     
produce:pandoracalo:Calorimetry                        0.406489       1.05431       2.23281      0.955805      0.447156        30     
produce:pandoracalonosce:Calorimetry                   0.358941      0.974487       2.16576      0.894055      0.414232        30     
produce:pandorapid:Chi2ParticleID                     0.00136991    0.00220079     0.0043199    0.00207938    0.000551924      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.504585       2.04974       4.8287        1.76145       1.1269         30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.49947       2.01801       4.68527       1.7082         1.107         30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0890036     0.150336      0.219016      0.151389      0.0327124       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.033127      0.0545234     0.0769064     0.0540099     0.0111251       30     
produce:emtrkmichelid:EmTrackMichelId                   17.9566       31.2582       42.9361       31.4078       6.62883        30     
[art]:TriggerResults:TriggerResultInserter            2.3781e-05    3.92236e-05   0.000132549   3.4501e-05    1.95436e-05      30     
end_path:out1:RootOutput                               7.854e-06    1.22246e-05   4.7299e-05    1.1336e-05    6.87346e-06      30     
end_path:michelremoving:michelremoving                 0.020067      0.112948      0.396502      0.0566318     0.098828        30     
end_path:michelremovinggnocchi:michelremoving          0.0201982     0.110206      0.394409      0.0529659     0.098448        30     
end_path:calibanagnocchi:CalibAnaTree                  0.297865      0.808871       1.99657      0.722719      0.386237        30     
end_path:out1:RootOutput(write)                         0.55362      0.978376       1.54174      0.977386      0.229322        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4976.16 MB
  Peak resident set size usage (VmHWM): 2660.43 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1_reco_stage2_20240818T203541_keepup.root
\tHists: np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1_reco_stage2_20240818T203541_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1_reco_stage2_20240818T203541_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1_reco_stage2_20240818T203541_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724009509.0,
    "core.end_time": 1724013341.0,
    "core.events": [
      136298,
      136306,
      136314,
      136346,
      136354,
      136362,
      136370,
      136378,
      136386,
      136394,
      136402,
      136410,
      136418,
      136426,
      136434,
      136442,
      136450,
      136458,
      136466,
      136474,
      136482,
      136490,
      136498,
      136506,
      136514,
      136522,
      136530,
      136554,
      136562,
      136570
    ],
    "core.event_count": 30,
    "core.first_event_number": 136298,
    "core.last_event_number": 136570,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108_reco_stage1_reco_stage2_20240818T203541_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724009509.0,
    "core.end_time": 1724013341.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_0568_dataflow2_datawriter_0_20240818T175108.hdf5"
    }
  ]
}
justIN time: 2024-11-21 23:52:21 UTC       justIN version: 01.01.09