justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270304.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270304.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3586
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 20:22:20
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-06 01:09:21
From worker nodeHostnamedunegli-4179476-0-fnpc19124.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 23:48:31
Input fileshd-protodune:np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322.hdf5
JobscriptExit code0
Real time1h (4802s)
CPU time1h (4141s = 86%)
Outputting started2024-10-06 01:08:34
Output fileshd-protodune-det-reco:np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup.root
hd-protodune-det-reco:np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup_hists.root
Finished2024-10-06 01:09:21
Saved logsjustin-logs:270304.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

650 hits in TPC 0
2839 hits in TPC 1
3997 hits in TPC 2
3246 hits in TPC 3
5391 hits in TPC 4
6379 hits in TPC 5
3266 hits in TPC 6
2956 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1374 XUs and 1817 XVs -> 93 XUVs
C:0 T:2 15515 XUs and 8628 XVs -> 330 XUVs
C:0 T:3 178 XUs and 126 XVs -> 1 XUVs
C:0 T:4 270 XUs and 337 XVs -> 11 XUVs
C:0 T:5 25251 XUs and 24261 XVs -> 1130 XUVs
C:0 T:6 7288 XUs and 5563 XVs -> 192 XUVs
C:0 T:7 60 XUs and 76 XVs -> 1 XUVs
1758 XUVs total
1042 collection wire objects
1758 potential space points
Neighbour search...
26854 tests to find 14424 neighbours
Iterating with no regularization...
Begin: 1.83881e+07
0 1.76001e+07
1 1.7544e+07
2 1.75398e+07
Now with regularization...
Begin: 1.64059e+07
0 1.64038e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 2160 TrkackID 5 startx, y, z 30.0873 383.354 15.1036  wireno, peakt tpcno 111 5136.11 2 dist 342.694min T, max_T3065.58 5167.2
no of hits closeby  0   event 2160 TrkackID 5 startx, y, z 30.0873 383.354 15.1036  wireno, peakt tpcno 111 5136.11 2 dist 342.694min T, max_T3065.58 5167.2
06-Oct-2024 01:08:25 UTC  Closed output file "np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup.root"
06-Oct-2024 01:08:25 UTC  Closed input file "np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              50.1669       83.7277       129.625       79.3702       17.8388        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000695764   0.00257971    0.00484119    0.00247989    0.00105833       40     
produce:fembfilter:PDHDFEMBFilter                      0.707687      0.808242      0.977364      0.772292      0.083648        40     
produce:wclsdatahd:WireCellToolkit                      27.6034       33.231        44.5627       31.6077       4.70924        40     
produce:gaushit:GausHitFinder                          0.279552      0.683185       1.21664      0.632358      0.193144        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000237321   0.000397955   0.000633884   0.000372632   9.37192e-05      40     
produce:reco3d:SpacePointSolver                        0.0739974     0.810406       2.80728      0.621817        0.587         40     
produce:hitpdune:DisambigFromSpacePoints               0.105864      0.505329       1.23832      0.466519      0.236294        40     
produce:pandora:StandardPandora                         3.28074       14.093        31.437        12.7295       6.26478        40     
produce:pandoraWriter:StandardPandora                  0.0622603     0.154633      0.283276      0.152655      0.0417772       40     
produce:pandoraTrack:LArPandoraTrackCreation            0.36548       1.29176       3.26051       1.20744      0.559792        40     
produce:pandoraShower:LArPandoraShowerCreation         0.253239       1.58994       4.88363       1.36067      0.923404        40     
produce:pandoracalo:Calorimetry                        0.176041      0.626725       1.5801       0.541499      0.278456        40     
produce:pandoracalonosce:Calorimetry                   0.158651      0.581102       1.74561      0.480054      0.300012        40     
produce:pandorapid:Chi2ParticleID                     0.00110845    0.00183637    0.00291009    0.00168376    0.000485448      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.214023       1.39757       5.34489       1.17768      0.900598        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.213875       1.29482       3.96289       1.1073       0.695524        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0453871      0.12955      0.251153      0.117768      0.0432581       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0160318     0.0437219     0.070014      0.0419785     0.0124713       40     
produce:emtrkmichelid:EmTrackMichelId                   14.0194       24.932        37.8098       24.465        5.86346        40     
[art]:TriggerResults:TriggerResultInserter             1.566e-05    3.3162e-05    7.4491e-05     2.54e-05     1.65565e-05      40     
end_path:out1:RootOutput                               7.68e-06     1.27225e-05    3.186e-05     9.44e-06     6.78251e-06      40     
end_path:michelremoving:michelremoving                 0.0109155     0.0739754     0.280095      0.0294431     0.0768232       40     
end_path:michelremovinggnocchi:michelremoving          0.0130056     0.0716051     0.267618      0.0282585     0.0754851       40     
end_path:calibanagnocchi:CalibAnaTree                  0.112661      0.466859      0.968273      0.458326      0.166207        40     
end_path:out1:RootOutput(write)                        0.359977      0.814462       1.32925      0.781433      0.205196        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5024.83 MB
  Peak resident set size usage (VmHWM): 2701.71 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup.root
\tHists: np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728173517.0,
    "core.end_time": 1728176906.0,
    "core.events": [
      2121,
      2122,
      2123,
      2124,
      2125,
      2126,
      2127,
      2128,
      2129,
      2130,
      2131,
      2132,
      2133,
      2134,
      2135,
      2136,
      2137,
      2138,
      2139,
      2140,
      2141,
      2142,
      2143,
      2144,
      2145,
      2146,
      2147,
      2148,
      2149,
      2150,
      2151,
      2152,
      2153,
      2154,
      2155,
      2156,
      2157,
      2158,
      2159,
      2160
    ],
    "core.event_count": 40,
    "core.first_event_number": 2121,
    "core.last_event_number": 2160,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27766
    ],
    "core.runs_subruns": [
      2776600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322_reco_stage1_reco_stage2_20241006T010825_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728173517.0,
    "core.end_time": 1728176906.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27766
    ],
    "core.runs_subruns": [
      2776600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027766_0053_dataflow0_datawriter_0_20240705T215322.hdf5"
    }
  ]
}
justIN time: 2024-11-24 12:39:39 UTC       justIN version: 01.01.09