justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265103.41@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265103.41@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3511
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 16:37:06
SiteCA_Victoria
EntryDUNE_CA_Victoria_dune-condor_whole
Last heartbeat2024-09-28 04:48:27
From worker nodeHostnamedune--heprc--3456932580--41021190986552-2
cpuinfoIntel Core Processor (Broadwell, IBRS)
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 16:38:54
Input fileshd-protodune:np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754.hdf5
JobscriptExit code0
Real time12h (43660s)
CPU time4h (15377s = 35%)
Outputting started2024-09-28 04:46:37
Output fileshd-protodune-det-reco:np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup.root
hd-protodune-det-reco:np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup_hists.root
Finished2024-09-28 04:48:27
Saved logsjustin-logs:265103.41-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

summary
Retagger: tagging trace set: gauss with 53810 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53810 traces tagged "gauss"
FrameSaver: q=2.16045e+06 n=943166 tag=gauss
wclsFrameSaver: saving 74838 traces tagged "wiener"
FrameSaver: q=2.36384e+06 n=853371 tag=wiener
2455 hits in TPC 0
3638 hits in TPC 1
6550 hits in TPC 2
4218 hits in TPC 3
4738 hits in TPC 4
7669 hits in TPC 5
6245 hits in TPC 6
4880 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2510 XUs and 2057 XVs -> 176 XUVs
C:0 T:2 31856 XUs and 40447 XVs -> 4540 XUVs
C:0 T:3 111 XUs and 147 XVs -> 2 XUVs
C:0 T:4 59 XUs and 105 XVs -> 3 XUVs
C:0 T:5 39740 XUs and 44953 XVs -> 4985 XUVs
C:0 T:6 24326 XUs and 24849 XVs -> 1091 XUVs
C:0 T:7 885 XUs and 1184 XVs -> 171 XUVs
10968 XUVs total
2151 collection wire objects
10968 potential space points
Neighbour search...
1111300 tests to find 567466 neighbours
Iterating with no regularization...
Begin: 6.26634e+07
0 5.47022e+07
1 5.41425e+07
2 5.40423e+07
3 5.40088e+07
Now with regularization...
Begin: 5.10206e+07
0 5.099e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

28-Sep-2024 04:44:57 UTC  Closed output file "np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup.root"
28-Sep-2024 04:44:57 UTC  Closed input file "np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              707.212       1033.19       1902.26       980.546       243.173        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0290422      0.87288       1.49512      0.907631      0.433887        35     
produce:fembfilter:PDHDFEMBFilter                       5.88098       8.17422       11.214        7.86715       1.04873        35     
produce:wclsdatahd:WireCellToolkit                      271.688       323.223       568.932       322.944       47.0276        35     
produce:gaushit:GausHitFinder                          0.777084       1.54913       2.38349       1.4678       0.354228        35     
produce:nhitsfilter:NumberOfHitsFilter                0.00416613     0.0127536     0.175871     0.00776131     0.0280606       35     
produce:reco3d:SpacePointSolver                        0.960012       3.1946        9.97354       2.73477       1.8907         35     
produce:hitpdune:DisambigFromSpacePoints               0.654836       2.01578       3.95618       1.90555      0.728914        35     
produce:pandora:StandardPandora                         14.0097       64.0939       205.036       60.3627       35.3335        35     
produce:pandoraWriter:StandardPandora                  0.319268      0.667771       3.02935      0.594901      0.427943        35     
produce:pandoraTrack:LArPandoraTrackCreation            1.71599       4.80005       8.23922       4.98323       1.55433        35     
produce:pandoraShower:LArPandoraShowerCreation          1.75825       4.33777       7.46561       4.12714       1.44032        35     
produce:pandoracalo:Calorimetry                         1.28649       3.17582       9.4304        3.11885       1.41933        35     
produce:pandoracalonosce:Calorimetry                   0.804116       2.36696       4.31634       2.35081      0.902675        35     
produce:pandorapid:Chi2ParticleID                      0.0140275     0.0818128      1.6887       0.0225704     0.276659        35     
produce:pandoraShowercalo:ShowerCalorimetry             1.90184       4.45026       8.40485       4.01877       1.59628        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.76437       3.93084       7.31851       3.49116       1.40877        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.228874      0.587702       5.44793      0.430985      0.844629        35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.064701      0.142067      0.345653      0.124969      0.0536553       35     
produce:emtrkmichelid:EmTrackMichelId                   357.442       592.324        1100         549.467       180.944        35     
[art]:TriggerResults:TriggerResultInserter            0.00222251    0.00403159     0.0120232    0.00377602    0.00179046       35     
end_path:out1:RootOutput                              0.000253239   0.000830347    0.0076733    0.000609044   0.00120497       35     
end_path:michelremoving:michelremoving                 0.201824      0.512174       2.0485       0.401657      0.311812        35     
end_path:michelremovinggnocchi:michelremoving          0.0850709     0.231766      0.870773      0.174543      0.162757        35     
end_path:calibanagnocchi:CalibAnaTree                  0.783473       2.35903       4.13417       2.53711      0.819418        35     
end_path:out1:RootOutput(write)                         2.98735       4.89982       8.03926       4.68721       1.22673        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5048.39 MB
  Peak resident set size usage (VmHWM): 110.588 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup.root
\tHists: np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462152.0,
    "core.end_time": 1727498718.0,
    "core.events": [
      18061,
      18065,
      18069,
      18073,
      18077,
      18081,
      18085,
      18089,
      18093,
      18097,
      18101,
      18105,
      18109,
      18113,
      18117,
      18121,
      18125,
      18129,
      18133,
      18137,
      18141,
      18145,
      18149,
      18153,
      18157,
      18161,
      18165,
      18169,
      18173,
      18177,
      18181,
      18185,
      18189,
      18193,
      18197
    ],
    "core.event_count": 35,
    "core.first_event_number": 18061,
    "core.last_event_number": 18197,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754_reco_stage1_reco_stage2_20240928T044457_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727462152.0,
    "core.end_time": 1727498718.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27334
    ],
    "core.runs_subruns": [
      2733400001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027334_0129_dataflow1_datawriter_0_20240621T041754.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:10:42 UTC       justIN version: 01.01.09