justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262996.10@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID262996.10@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3449
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 06:58:30
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-09-26 09:16:11
From worker nodeHostnameccwcondor0620
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 07:10:36
Input fileshd-protodune:np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402.hdf5
JobscriptExit code0
Real time56m (3413s)
CPU time53m (3229s = 94%)
Outputting started2024-09-26 08:07:30
Output fileshd-protodune-det-reco:np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup.root
hd-protodune-det-reco:np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup_hists.root
Finished2024-09-26 09:16:11
Saved logsjustin-logs:262996.10-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

er with 67569 traces, 67569 summary
Retagger: tagging trace set: gauss with 49530 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49530 traces tagged "gauss"
FrameSaver: q=1.19444e+06 n=892107 tag=gauss
wclsFrameSaver: saving 67569 traces tagged "wiener"
FrameSaver: q=1.2985e+06 n=810276 tag=wiener
2040 hits in TPC 0
1777 hits in TPC 1
5626 hits in TPC 2
3965 hits in TPC 3
3280 hits in TPC 4
5122 hits in TPC 5
8848 hits in TPC 6
4940 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1545 XUs and 383 XVs -> 25 XUVs
C:0 T:2 21079 XUs and 38295 XVs -> 885 XUVs
C:0 T:3 160 XUs and 398 XVs -> 5 XUVs
C:0 T:4 0 XUs and 0 XVs -> 0 XUVs
C:0 T:5 72781 XUs and 27827 XVs -> 2640 XUVs
C:0 T:6 32481 XUs and 41084 XVs -> 1105 XUVs
C:0 T:7 278 XUs and 445 XVs -> 14 XUVs
4674 XUVs total
1979 collection wire objects
4674 potential space points
Neighbour search...
424360 tests to find 149430 neighbours
Iterating with no regularization...
Begin: 2.34233e+07
0 1.77204e+07
1 1.71214e+07
2 1.70595e+07
3 1.70394e+07
4 1.70322e+07
Now with regularization...
Begin: 1.6092e+07
0 1.60821e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 10:07:20 CEST  Closed output file "np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup.root"
26-Sep-2024 10:07:20 CEST  Closed input file "np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              54.4283       76.7215       115.695       73.4444       13.4371        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000473498    0.0026025    0.00381922    0.00250611    0.000842881      30     
produce:fembfilter:PDHDFEMBFilter                      0.498433      0.559374      0.789327       0.5237       0.0748895       30     
produce:wclsdatahd:WireCellToolkit                      30.0032       32.9403       39.3026       32.3306       2.24644        30     
produce:gaushit:GausHitFinder                           0.3456       0.554668      0.860958      0.544231      0.121915        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000225582   0.000327333   0.000772067   0.00030631    9.4133e-05       30     
produce:reco3d:SpacePointSolver                        0.199273       0.99951       2.06408      0.951143      0.493657        30     
produce:hitpdune:DisambigFromSpacePoints               0.152169      0.418141       1.03147      0.388622      0.183998        30     
produce:pandora:StandardPandora                         5.00955       10.1979       18.7466       10.289        3.56112        30     
produce:pandoraWriter:StandardPandora                  0.0759269     0.128868      0.205456      0.127998      0.0286653       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.670003       1.54211       3.28784       1.50603      0.561621        30     
produce:pandoraShower:LArPandoraShowerCreation         0.591711       1.80803       4.10418       1.76362      0.764735        30     
produce:pandoracalo:Calorimetry                        0.314835      0.720123       1.25743      0.703996      0.223098        30     
produce:pandoracalonosce:Calorimetry                    0.28621      0.653828       1.27962      0.631855      0.235244        30     
produce:pandorapid:Chi2ParticleID                      0.0011471    0.00177762    0.00394469    0.00164391    0.000566754      30     
produce:pandoraShowercalo:ShowerCalorimetry             0.44177       1.51216       3.4114        1.51243      0.609151        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.431117       1.37107       2.81516       1.28758      0.515651        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0683725      0.11218      0.188141      0.104392      0.0296799       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0232085     0.0403202     0.0641666     0.0384541    0.00942894       30     
produce:emtrkmichelid:EmTrackMichelId                    13.29        21.7466       45.1849       20.4458       5.91739        30     
[art]:TriggerResults:TriggerResultInserter            2.8424e-05    6.41008e-05   0.000142798   6.0979e-05    2.39764e-05      30     
end_path:out1:RootOutput                               7.765e-06    1.82569e-05   3.8282e-05    1.69915e-05   6.94867e-06      30     
end_path:michelremoving:michelremoving                 0.0175221     0.0793342     0.274101      0.036912      0.0742949       30     
end_path:michelremovinggnocchi:michelremoving          0.0167051     0.0706375     0.265403      0.0349999     0.0674484       30     
end_path:calibanagnocchi:CalibAnaTree                  0.214259      0.463204       1.01133       0.42627      0.199142        30     
end_path:out1:RootOutput(write)                        0.365524      0.597142       0.92544      0.598874      0.116879        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4912.97 MB
  Peak resident set size usage (VmHWM): 2352.37 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup.root
\tHists: np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727335687.0,
    "core.end_time": 1727338041.0,
    "core.events": [
      182187,
      182195,
      182203,
      182211,
      182219,
      182227,
      182235,
      182243,
      182251,
      182259,
      182267,
      182275,
      182283,
      182291,
      182299,
      182307,
      182315,
      182323,
      182331,
      182339,
      182347,
      182355,
      182363,
      182371,
      182379,
      182387,
      182395,
      182403,
      182411,
      182419
    ],
    "core.event_count": 30,
    "core.first_event_number": 182187,
    "core.last_event_number": 182419,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402_reco_stage1_reco_stage2_20240926T080720_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727335687.0,
    "core.end_time": 1727338041.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_0759_dataflow3_datawriter_0_20240907T032402.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:28:26 UTC       justIN version: 01.01.08