justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244742.39@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244742.39@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 04:14:53
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 05:22:25
From worker nodeHostnamewn-snel-002.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 04:16:35
Input fileshd-protodune:np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134.hdf5
JobscriptExit code0
Real time1h (3876s)
CPU time58m (3494s = 90%)
Outputting started2024-08-19 05:21:12
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup_hists.root
Finished2024-08-19 05:22:25
Saved logsjustin-logs:244742.39-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ging trace set: wiener with 83227 traces, 83227 summary
Retagger: tagging trace set: gauss with 61452 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61452 traces tagged "gauss"
FrameSaver: q=1.33357e+06 n=1142504 tag=gauss
wclsFrameSaver: saving 83227 traces tagged "wiener"
FrameSaver: q=1.47419e+06 n=1042021 tag=wiener
11139 hits in TPC 0
7431 hits in TPC 1
4621 hits in TPC 2
1831 hits in TPC 3
5807 hits in TPC 4
7915 hits in TPC 5
4051 hits in TPC 6
3070 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7328 XUs and 5907 XVs -> 706 XUVs
C:0 T:2 6327 XUs and 9879 XVs -> 945 XUVs
C:0 T:3 326 XUs and 370 XVs -> 27 XUVs
C:0 T:4 1161 XUs and 1045 XVs -> 30 XUVs
C:0 T:5 42846 XUs and 56843 XVs -> 1949 XUVs
C:0 T:6 12515 XUs and 11517 XVs -> 370 XUVs
C:0 T:7 79 XUs and 62 XVs -> 5 XUVs
4032 XUVs total
1624 collection wire objects
4032 potential space points
Neighbour search...
111180 tests to find 58408 neighbours
Iterating with no regularization...
Begin: 9.00039e+06
0 8.34674e+06
1 8.29297e+06
2 8.28832e+06
Now with regularization...
Begin: 7.78306e+06
0 7.78177e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 07:21:02 CEST  Closed output file "np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup.root"
19-Aug-2024 07:21:02 CEST  Closed input file "np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              62.795        87.6686       135.763       83.8911       17.504         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000393099   0.00198226    0.00357546    0.00192675    0.00092764       30     
produce:fembfilter:PDHDFEMBFilter                      0.489865      0.578426      0.979987      0.523259      0.112984        30     
produce:wclsdatahd:WireCellToolkit                      28.6063       30.2085       33.6303       30.0201       1.31432        30     
produce:gaushit:GausHitFinder                          0.404574      0.618169      0.969166       0.61388      0.130691        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000263535   0.000419985   0.000748296   0.000391641   0.000119486      30     
produce:reco3d:SpacePointSolver                        0.202177       1.1022        5.65359      0.805248       0.99133        30     
produce:hitpdune:DisambigFromSpacePoints               0.244075      0.499986       1.25987      0.447686      0.231189        30     
produce:pandora:StandardPandora                         8.55312       18.8964       47.5129       16.5398       10.3627        30     
produce:pandoraWriter:StandardPandora                  0.106879      0.164099      0.238593      0.167464      0.0336277       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.548166       1.30838       3.34208       1.17248      0.596729        30     
produce:pandoraShower:LArPandoraShowerCreation         0.578557       1.41903       3.40732       1.24306      0.716751        30     
produce:pandoracalo:Calorimetry                        0.280313      0.594255       1.47992      0.553129      0.240955        30     
produce:pandoracalonosce:Calorimetry                   0.261856      0.544806       1.37037      0.495662       0.23179        30     
produce:pandorapid:Chi2ParticleID                     0.00109359    0.00181072    0.00325155    0.00172632    0.000444146      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.487919       1.15168       2.89833       1.05088      0.567257        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.478362       1.13655       2.8442        1.04718      0.573045        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0631766     0.124931      0.229577       0.12657      0.0324866       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0256858     0.0480854     0.109913      0.0444862     0.0182676       30     
produce:emtrkmichelid:EmTrackMichelId                   18.0691       27.0268       38.6707       26.8134       5.24029        30     
[art]:TriggerResults:TriggerResultInserter            1.7122e-05    2.79919e-05   7.7266e-05    2.44305e-05   1.08232e-05      30     
end_path:out1:RootOutput                               4.228e-06    6.18157e-06   2.3073e-05    5.6105e-06    3.21825e-06      30     
end_path:michelremoving:michelremoving                 0.0264208     0.109016      0.508399      0.0401865     0.124563        30     
end_path:michelremovinggnocchi:michelremoving          0.0230767     0.106976      0.498407      0.0383284     0.123314        30     
end_path:calibanagnocchi:CalibAnaTree                  0.358948      0.745041       1.26494      0.706033      0.250655        30     
end_path:out1:RootOutput(write)                        0.869652       1.13948       1.46585       1.14831      0.145185        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4966.17 MB
  Peak resident set size usage (VmHWM): 2645.56 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup.root
\tHists: np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724042198.0,
    "core.end_time": 1724044863.0,
    "core.events": [
      311040,
      311048,
      311056,
      311064,
      311080,
      311088,
      311096,
      311104,
      311112,
      311120,
      311128,
      311136,
      311144,
      311152,
      311160,
      311168,
      311176,
      311184,
      311192,
      311200,
      311216,
      311224,
      311232,
      311240,
      311256,
      311264,
      311272,
      311280,
      311288,
      311296
    ],
    "core.event_count": 30,
    "core.first_event_number": 311040,
    "core.last_event_number": 311296,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134_reco_stage1_reco_stage2_20240819T052102_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724042198.0,
    "core.end_time": 1724044863.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1296_dataflow0_datawriter_0_20240819T011134.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:16:34 UTC       justIN version: 01.01.08