justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 261750.142@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID261750.142@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3389
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-25 02:35:50
SiteUK_Brunel
EntryCMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat2024-09-25 07:17:51
From worker nodeHostnamewn-b7-04-00.brunel.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5645 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-25 03:46:28
Input fileshd-protodune:np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651.hdf5
JobscriptExit code0
Real time3h (12561s)
CPU time3h (11351s = 90%)
Outputting started2024-09-25 07:15:50
Output fileshd-protodune-det-reco:np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup.root
hd-protodune-det-reco:np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup_hists.root
Finished2024-09-25 07:17:51
Saved logsjustin-logs:261750.142-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

r: tagging trace set: gauss with 48678 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48678 traces tagged "gauss"
FrameSaver: q=1.04384e+06 n=911947 tag=gauss
wclsFrameSaver: saving 63947 traces tagged "wiener"
FrameSaver: q=1.11285e+06 n=824477 tag=wiener
4206 hits in TPC 0
2368 hits in TPC 1
4408 hits in TPC 2
2694 hits in TPC 3
4333 hits in TPC 4
6536 hits in TPC 5
6109 hits in TPC 6
3039 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 128 XUs and 112 XVs -> 26 XUVs
C:0 T:2 8237 XUs and 11891 XVs -> 533 XUVs
C:0 T:3 76 XUs and 85 XVs -> 3 XUVs
C:0 T:4 49 XUs and 64 XVs -> 0 XUVs
C:0 T:5 19210 XUs and 19027 XVs -> 575 XUVs
C:0 T:6 13066 XUs and 13992 XVs -> 478 XUVs
C:0 T:7 146 XUs and 90 XVs -> 2 XUVs
1617 XUVs total
1168 collection wire objects
1617 potential space points
Neighbour search...
24847 tests to find 12732 neighbours
Iterating with no regularization...
Begin: 5.90044e+06
0 5.54554e+06
1 5.53323e+06
2 5.53182e+06
Now with regularization...
Begin: 5.17747e+06
0 5.17701e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

25-Sep-2024 08:15:33 BST  Closed output file "np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup.root"
25-Sep-2024 08:15:33 BST  Closed input file "np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              232.294       311.002       396.191       306.341       45.2537        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000581133   0.00340976     0.0181096    0.00325631    0.00294251       30     
produce:fembfilter:PDHDFEMBFilter                       1.57263       1.82012       1.99774       1.81461      0.103445        30     
produce:wclsdatahd:WireCellToolkit                      74.2257       102.965       125.93        105.017       15.527         30     
produce:gaushit:GausHitFinder                          0.947516       1.77394       2.66218       1.83192      0.464915        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000435496   0.000705242    0.0010441    0.000726351   0.000124289      30     
produce:reco3d:SpacePointSolver                        0.303819       1.81886       5.28773       1.29358        1.219         30     
produce:hitpdune:DisambigFromSpacePoints                0.37242       1.56445       2.5946        1.5995       0.614796        30     
produce:pandora:StandardPandora                         13.4028       30.7659       64.0477       28.7352       12.6935        30     
produce:pandoraWriter:StandardPandora                  0.158448      0.304339       0.44988      0.327209      0.0862503       30     
produce:pandoraTrack:LArPandoraTrackCreation            1.24306       2.81888       4.43976       2.8013        1.00858        30     
produce:pandoraShower:LArPandoraShowerCreation          1.40809       3.45649       6.50569       3.59698       1.43201        30     
produce:pandoracalo:Calorimetry                        0.709534       1.41501       2.1808        1.4156       0.430112        30     
produce:pandoracalonosce:Calorimetry                   0.640391       1.27692       1.93748       1.25542       0.38398        30     
produce:pandorapid:Chi2ParticleID                      0.0020369    0.00410043    0.00701256    0.00422185    0.00126456       30     
produce:pandoraShowercalo:ShowerCalorimetry             1.36112       3.19439       5.58067       3.18679       1.27431        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.3596        3.12989       5.44961       3.02752       1.27293        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.156521      0.346993      0.509361      0.362326      0.106027        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0565317     0.122312      0.174306      0.135148      0.0368461       30     
produce:emtrkmichelid:EmTrackMichelId                   110.833       150.727       199.279       145.006       24.6906        30     
[art]:TriggerResults:TriggerResultInserter            3.3504e-05    4.89958e-05   9.5208e-05    4.57755e-05   1.28554e-05      30     
end_path:out1:RootOutput                               9.668e-06    1.40961e-05   3.1498e-05    1.2653e-05    4.37434e-06      30     
end_path:michelremoving:michelremoving                 0.0375423     0.259719      0.737426      0.0833105      0.24122        30     
end_path:michelremovinggnocchi:michelremoving          0.0424811     0.248042      0.724837      0.0698395     0.238663        30     
end_path:calibanagnocchi:CalibAnaTree                  0.454768       1.07454       1.56324      0.998816      0.298747        30     
end_path:out1:RootOutput(write)                        0.943137       1.77785       2.48784        1.765       0.353354        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4917.01 MB
  Peak resident set size usage (VmHWM): 2577.13 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup.root
\tHists: np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727239117.0,
    "core.end_time": 1727248534.0,
    "core.events": [
      687845,
      687853,
      687861,
      687869,
      687877,
      687885,
      687893,
      687901,
      687909,
      687917,
      687925,
      687933,
      687941,
      687949,
      687957,
      687965,
      687973,
      687981,
      687989,
      687997,
      688005,
      688013,
      688021,
      688029,
      688037,
      688045,
      688053,
      688061,
      688069,
      688101
    ],
    "core.event_count": 30,
    "core.first_event_number": 687845,
    "core.last_event_number": 688101,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651_reco_stage1_reco_stage2_20240925T071533_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727239117.0,
    "core.end_time": 1727248534.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29006
    ],
    "core.runs_subruns": [
      2900600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029006_2866_dataflow5_datawriter_0_20240901T145651.hdf5"
    }
  ]
}
justIN time: 2024-11-17 08:18:07 UTC       justIN version: 01.01.09