justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266194.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID266194.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3552
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-29 03:33:55
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2024-09-29 05:02:25
From worker nodeHostnamecomp22-11
cpuinfoIntel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-29 03:35:36
Input fileshd-protodune:np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252.hdf5
JobscriptExit code0
Real time1h (5141s)
CPU time1h (4677s = 90%)
Outputting started2024-09-29 05:01:18
Output fileshd-protodune-det-reco:np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup.root
hd-protodune-det-reco:np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup_hists.root
Finished2024-09-29 05:02:25
Saved logsjustin-logs:266194.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ts in TPC 3
1577 hits in TPC 4
2685 hits in TPC 5
4084 hits in TPC 6
2279 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 335 XUs and 157 XVs -> 3 XUVs
C:0 T:2 2860 XUs and 2190 XVs -> 127 XUVs
C:0 T:3 259 XUs and 527 XVs -> 44 XUVs
C:0 T:4 106 XUs and 72 XVs -> 33 XUVs
C:0 T:5 11973 XUs and 9162 XVs -> 392 XUVs
C:0 T:6 6251 XUs and 9516 XVs -> 840 XUVs
C:0 T:7 78 XUs and 118 XVs -> 2 XUVs
1441 XUVs total
530 collection wire objects
1441 potential space points
Neighbour search...
41569 tests to find 26292 neighbours
Iterating with no regularization...
Begin: 3.66421e+06
0 3.27936e+06
1 3.2488e+06
2 3.24461e+06
3 3.24368e+06
Now with regularization...
Begin: 3.01585e+06
0 3.01531e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 3198 TrkackID 1 startx, y, z 347.899 513.217 304.187  wireno, peakt tpcno 447 4193.68 5 dist 0min T, max_T1155.1 5538.79
no of hits closeby  0   event 3198 TrkackID 1 startx, y, z 347.899 513.217 304.187  wireno, peakt tpcno 447 4193.68 5 dist 0min T, max_T1155.1 5538.79
29-Sep-2024 06:01:07 BST  Closed output file "np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup.root"
29-Sep-2024 06:01:07 BST  Closed input file "np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              63.3363       97.2647       171.768       91.1477       24.4526        39     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000405887   0.00150445    0.00502423    0.00114413    0.00120356       39     
produce:fembfilter:PDHDFEMBFilter                      0.605756      0.644095      0.679627      0.645405      0.0108144       39     
produce:wclsdatahd:WireCellToolkit                      42.2905        44.86        52.1019       44.3844       1.82314        39     
produce:gaushit:GausHitFinder                           0.44845      0.744036       1.2399       0.700381      0.186252        39     
produce:nhitsfilter:NumberOfHitsFilter                0.000306497   0.000461179   0.000692522   0.000443596   9.70976e-05      39     
produce:reco3d:SpacePointSolver                        0.216543       2.26497       18.3078       1.04857       3.25429        39     
produce:hitpdune:DisambigFromSpacePoints                0.19508      0.630153       2.07155      0.560331      0.372395        39     
produce:pandora:StandardPandora                         5.21653       13.5351       34.0254       12.1593       6.45905        39     
produce:pandoraWriter:StandardPandora                  0.102589      0.180088      0.282139      0.173684      0.0436493       39     
produce:pandoraTrack:LArPandoraTrackCreation             1.424        3.72107       9.17577       3.70956       1.68339        39     
produce:pandoraShower:LArPandoraShowerCreation         0.949261       5.13644       13.187        4.55708       2.95465        39     
produce:pandoracalo:Calorimetry                        0.487104       1.42615       3.78348       1.36152      0.713981        39     
produce:pandoracalonosce:Calorimetry                   0.456175       1.35866       3.7091        1.32703      0.700002        39     
produce:pandorapid:Chi2ParticleID                     0.00137945    0.00198022    0.00291262    0.00196279    0.000368764      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.650408       3.81775       11.1652       3.43824       2.42786        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.659261       3.74262       10.9357       3.33915       2.39733        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0733168     0.135528      0.225077      0.130474      0.0363113       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0317681     0.0564916     0.0984024     0.0539392     0.0147938       39     
produce:emtrkmichelid:EmTrackMichelId                   7.53623       12.6351       20.2933       12.1706       2.99811        39     
[art]:TriggerResults:TriggerResultInserter            3.8677e-05    4.94185e-05   7.0949e-05    4.9627e-05    4.93967e-06      39     
end_path:out1:RootOutput                              1.2204e-05    1.65927e-05   2.7914e-05    1.6187e-05    2.79396e-06      39     
end_path:michelremoving:michelremoving                 0.0290022     0.115167      0.525487      0.0749651     0.104683        39     
end_path:michelremovinggnocchi:michelremoving          0.0240309     0.113341      0.520419      0.0727265     0.104034        39     
end_path:calibanagnocchi:CalibAnaTree                  0.297374       1.08009       3.10561       1.03316      0.605188        39     
end_path:out1:RootOutput(write)                        0.419012      0.763393       1.31763      0.732036      0.205592        39     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5899.09 MB
  Peak resident set size usage (VmHWM): 2974.21 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup.root
\tHists: np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727582220.0,
    "core.end_time": 1727586069.0,
    "core.events": [
      3122,
      3124,
      3126,
      3128,
      3130,
      3132,
      3134,
      3136,
      3138,
      3140,
      3142,
      3144,
      3146,
      3148,
      3150,
      3152,
      3154,
      3156,
      3158,
      3160,
      3162,
      3164,
      3166,
      3168,
      3170,
      3172,
      3174,
      3176,
      3178,
      3180,
      3182,
      3184,
      3186,
      3188,
      3190,
      3192,
      3194,
      3196,
      3198
    ],
    "core.event_count": 39,
    "core.first_event_number": 3122,
    "core.last_event_number": 3198,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252_reco_stage1_reco_stage2_20240929T050107_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727582220.0,
    "core.end_time": 1727586069.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29389
    ],
    "core.runs_subruns": [
      2938900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029389_0040_dataflow0_datawriter_0_20240929T021252.hdf5"
    }
  ]
}
justIN time: 2024-09-29 05:22:30 UTC       justIN version: 01.01.08