justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244742.47@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244742.47@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 04:14:53
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 05:22:50
From worker nodeHostnamewn-snel-016.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 04:16:38
Input fileshd-protodune:np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539.hdf5
JobscriptExit code0
Real time1h (3884s)
CPU time59m (3556s = 91%)
Outputting started2024-08-19 05:21:35
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup_hists.root
Finished2024-08-19 05:22:50
Saved logsjustin-logs:244742.47-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

trace set: gauss with 58667 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58667 traces tagged "gauss"
FrameSaver: q=1.27273e+06 n=1083670 tag=gauss
wclsFrameSaver: saving 79147 traces tagged "wiener"
FrameSaver: q=1.38677e+06 n=984428 tag=wiener
6203 hits in TPC 0
4601 hits in TPC 1
4844 hits in TPC 2
3340 hits in TPC 3
6120 hits in TPC 4
8322 hits in TPC 5
5307 hits in TPC 6
2841 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1826 XUs and 1669 XVs -> 64 XUVs
C:0 T:2 32251 XUs and 25870 XVs -> 804 XUVs
C:0 T:3 25 XUs and 25 XVs -> 0 XUVs
C:0 T:4 488 XUs and 659 XVs -> 31 XUVs
C:0 T:5 45323 XUs and 57817 XVs -> 1706 XUVs
C:0 T:6 15381 XUs and 18586 XVs -> 583 XUVs
C:0 T:7 30 XUs and 89 XVs -> 0 XUVs
3188 XUVs total
1564 collection wire objects
3188 potential space points
Neighbour search...
110994 tests to find 63752 neighbours
Iterating with no regularization...
Begin: 8.22786e+06
0 7.64528e+06
1 7.60817e+06
2 7.60454e+06
Now with regularization...
Begin: 7.21838e+06
0 7.21731e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 07:21:13 CEST  Closed output file "np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup.root"
19-Aug-2024 07:21:13 CEST  Closed input file "np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              62.9852       88.8973       119.126       90.3428       14.8983        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000298349   0.00180527    0.00380872    0.00190658    0.000869263      30     
produce:fembfilter:PDHDFEMBFilter                      0.498532      0.554531      0.782724       0.51473      0.0825172       30     
produce:wclsdatahd:WireCellToolkit                      28.4591       32.7437       38.8577       31.922        3.29357        30     
produce:gaushit:GausHitFinder                          0.389973      0.599781      0.860801      0.611876      0.127943        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000222397   0.000344621   0.000483466   0.000353593   6.32304e-05      30     
produce:reco3d:SpacePointSolver                        0.254296      0.864181       2.08895      0.774596      0.458358        30     
produce:hitpdune:DisambigFromSpacePoints               0.158779      0.451348      0.787449      0.459085      0.145533        30     
produce:pandora:StandardPandora                         7.17728       16.3356       30.7866       16.1714       6.07768        30     
produce:pandoraWriter:StandardPandora                  0.0803061     0.150104      0.211165      0.147056      0.0358314       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.471439       1.35758       3.63054       1.32308      0.641905        30     
produce:pandoraShower:LArPandoraShowerCreation         0.514046       1.42994       3.19743       1.28208      0.690351        30     
produce:pandoracalo:Calorimetry                        0.277298      0.669113       1.71658      0.668571      0.291362        30     
produce:pandoracalonosce:Calorimetry                    0.24668      0.614456       1.64143      0.601591       0.27682        30     
produce:pandorapid:Chi2ParticleID                     0.00112385    0.00175884    0.00279564    0.00174815    0.000358016      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.424666       1.30908       3.25926       1.18801      0.671091        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.40283       1.28795       3.16944       1.19017      0.648091        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0711352     0.124222      0.179942      0.123743      0.0297898       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0242779     0.0442856     0.0627224     0.0442909     0.010272        30     
produce:emtrkmichelid:EmTrackMichelId                   17.6046       28.0456       39.5109       28.4959       5.38027        30     
[art]:TriggerResults:TriggerResultInserter            1.8364e-05    2.4884e-05    7.8076e-05    2.14655e-05   1.15589e-05      30     
end_path:out1:RootOutput                               3.897e-06    5.46353e-06    2.149e-05     4.784e-06    3.05512e-06      30     
end_path:michelremoving:michelremoving                 0.0244071     0.123804      0.543941      0.0457197     0.131441        30     
end_path:michelremovinggnocchi:michelremoving          0.022502      0.124575      0.578953      0.0453996     0.135264        30     
end_path:calibanagnocchi:CalibAnaTree                  0.349489      0.853854       2.11916      0.816851      0.364904        30     
end_path:out1:RootOutput(write)                        0.739287       1.09643       1.39881       1.09217      0.145994        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4975.37 MB
  Peak resident set size usage (VmHWM): 2655.33 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup.root
\tHists: np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724042169.0,
    "core.end_time": 1724044873.0,
    "core.events": [
      312727,
      312735,
      312743,
      312751,
      312759,
      312767,
      312775,
      312783,
      312791,
      312799,
      312807,
      312815,
      312823,
      312831,
      312839,
      312847,
      312855,
      312863,
      312871,
      312879,
      312887,
      312895,
      312903,
      312911,
      312919,
      312927,
      312935,
      312943,
      312951,
      312959
    ],
    "core.event_count": 30,
    "core.first_event_number": 312727,
    "core.last_event_number": 312959,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539_reco_stage1_reco_stage2_20240819T052113_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724042169.0,
    "core.end_time": 1724044873.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1303_dataflow7_datawriter_0_20240819T011539.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:15:06 UTC       justIN version: 01.01.08