justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265387.6@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265387.6@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 20:40:18
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-27 22:09:31
From worker nodeHostnamespool1486.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 20:41:28
Input fileshd-protodune:np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507.hdf5
JobscriptExit code0
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started2024-09-27 22:07:42
Output fileshd-protodune-det-reco:np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup.root
hd-protodune-det-reco:np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup_hists.root
Finished2024-09-27 22:09:31
Saved logsjustin-logs:265387.6-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 8 XUs and 8 XVs -> 0 XUVs
C:0 T:1 32052 XUs and 17645 XVs -> 2491 XUVs
C:0 T:2 34617 XUs and 40740 XVs -> 1008 XUVs
C:0 T:3 103 XUs and 125 XVs -> 4 XUVs
C:0 T:4 334 XUs and 413 XVs -> 9 XUVs
C:0 T:5 73920 XUs and 77889 XVs -> 4098 XUVs
C:0 T:6 61855 XUs and 62009 XVs -> 3297 XUVs
C:0 T:7 107 XUs and 129 XVs -> 2 XUVs
10909 XUVs total
2903 collection wire objects
10909 potential space points
Neighbour search...
1188111 tests to find 509762 neighbours
Iterating with no regularization...
Begin: 7.52832e+07
0 6.91445e+07
1 6.87013e+07
2 6.86578e+07
Now with regularization...
Begin: 6.54596e+07
0 6.5429e+07
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 25344 TrkackID 21 startx, y, z 33.0268 592.561 178.394  wireno, peakt tpcno 371 1967.5 2 dist 305.105min T, max_T5.08362 1981.9
no of hits closeby  0   event 25344 TrkackID 21 startx, y, z 33.0268 592.561 178.394  wireno, peakt tpcno 371 1967.5 2 dist 305.105min T, max_T5.08362 1981.9
27-Sep-2024 22:07:32 UTC  Closed output file "np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup.root"
27-Sep-2024 22:07:32 UTC  Closed input file "np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              69.5922       121.767       205.559        116.9        34.5132        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000354882   0.00157158    0.00427063    0.00134873    0.00101825       35     
produce:fembfilter:PDHDFEMBFilter                      0.653408      0.668654      0.692414      0.668814     0.00923581       35     
produce:wclsdatahd:WireCellToolkit                       45.06        48.5853       53.4513       48.297        2.05561        35     
produce:gaushit:GausHitFinder                          0.537007      0.916532       1.37381      0.905408       0.19354        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000304173   0.000522096   0.000752313   0.000522359   9.65492e-05      35     
produce:reco3d:SpacePointSolver                        0.179595       1.74745       3.6794        1.57858      0.947538        35     
produce:hitpdune:DisambigFromSpacePoints               0.180542      0.667364       1.25998      0.614125      0.270287        35     
produce:pandora:StandardPandora                         6.55426       34.4266       94.7776       29.9919       21.049         35     
produce:pandoraWriter:StandardPandora                   0.11704      0.201743      0.289837       0.20105      0.0384008       35     
produce:pandoraTrack:LArPandoraTrackCreation            1.4411        4.16042       10.1489       3.61394       2.13319        35     
produce:pandoraShower:LArPandoraShowerCreation          1.16471       4.12257       11.2487       3.30738       2.36063        35     
produce:pandoracalo:Calorimetry                        0.573106       1.58639        4.038        1.39659      0.787808        35     
produce:pandoracalonosce:Calorimetry                   0.518049       1.4932        3.67613       1.31838      0.747239        35     
produce:pandorapid:Chi2ParticleID                     0.00157952    0.00238381    0.00350758    0.00236314    0.000496588      35     
produce:pandoraShowercalo:ShowerCalorimetry            0.761441       3.03136       7.74005       2.49351       1.61728        35     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.777412       2.91456       7.77764       2.33559       1.57784        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0706004     0.127116      0.217072      0.123052      0.029493        35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0320491     0.0566865     0.0922366     0.0552709     0.0123564       35     
produce:emtrkmichelid:EmTrackMichelId                   8.17473       14.7171       20.7675       14.2816       2.9732         35     
[art]:TriggerResults:TriggerResultInserter            3.0778e-05    4.60216e-05    8.756e-05    4.6265e-05    9.49358e-06      35     
end_path:out1:RootOutput                               6.144e-06    1.03334e-05   1.8898e-05    1.0361e-05    2.72153e-06      35     
end_path:michelremoving:michelremoving                 0.0243307     0.0649562     0.209041      0.0400343     0.0488178       35     
end_path:michelremovinggnocchi:michelremoving          0.0210054     0.0612518     0.209584      0.0374336     0.0468935       35     
end_path:calibanagnocchi:CalibAnaTree                  0.413271       1.05454       2.55749      0.902144       0.54231        35     
end_path:out1:RootOutput(write)                        0.437925      0.845048       1.31148      0.822215      0.185454        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5893.23 MB
  Peak resident set size usage (VmHWM): 2680.24 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup.root
\tHists: np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727470556.0,
    "core.end_time": 1727474853.0,
    "core.events": [
      25208,
      25212,
      25216,
      25220,
      25224,
      25228,
      25232,
      25236,
      25240,
      25244,
      25248,
      25252,
      25256,
      25260,
      25264,
      25268,
      25272,
      25276,
      25280,
      25284,
      25288,
      25292,
      25296,
      25300,
      25304,
      25308,
      25312,
      25316,
      25320,
      25324,
      25328,
      25332,
      25336,
      25340,
      25344
    ],
    "core.event_count": 35,
    "core.first_event_number": 25208,
    "core.last_event_number": 25344,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507_reco_stage1_reco_stage2_20240927T220732_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727470556.0,
    "core.end_time": 1727474853.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0180_dataflow0_datawriter_0_20240621T043507.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:29:48 UTC       justIN version: 01.01.08