justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254511.95@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID254511.95@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3194
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-11 22:12:20
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-09-12 02:56:25
From worker nodeHostnamen149.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5120 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-11 23:13:08
Input fileshd-protodune:np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406.hdf5
Outputting started2024-09-12 02:54:34
Output files
Finished2024-09-12 02:56:25
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

set: gauss with 49440 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49440 traces tagged "gauss"
FrameSaver: q=1.30547e+06 n=998773 tag=gauss
wclsFrameSaver: saving 62899 traces tagged "wiener"
FrameSaver: q=1.39557e+06 n=926178 tag=wiener
5655 hits in TPC 0
4600 hits in TPC 1
3160 hits in TPC 2
1963 hits in TPC 3
5570 hits in TPC 4
8789 hits in TPC 5
3427 hits in TPC 6
3754 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 467 XUs and 376 XVs -> 6 XUVs
C:0 T:2 7114 XUs and 6745 XVs -> 359 XUVs
C:0 T:3 34 XUs and 98 XVs -> 1 XUVs
C:0 T:4 123 XUs and 151 XVs -> 9 XUVs
C:0 T:5 51783 XUs and 42987 XVs -> 3595 XUVs
C:0 T:6 6286 XUs and 6264 XVs -> 335 XUVs
C:0 T:7 1001 XUs and 780 XVs -> 25 XUVs
4330 XUVs total
1490 collection wire objects
4330 potential space points
Neighbour search...
272820 tests to find 107472 neighbours
Iterating with no regularization...
Begin: 5.87731e+07
0 4.83826e+07
1 4.7798e+07
2 4.77411e+07
3 4.77315e+07
Now with regularization...
Begin: 4.6253e+07
0 4.62186e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

12-Sep-2024 03:54:19 BST  Closed output file "np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1_reco_stage2_20240912T025419_keepup.root"
12-Sep-2024 03:54:19 BST  Closed input file "np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              95.6008       188.99        257.413       190.068       35.1797        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00061431    0.00311344    0.00501438    0.00333428    0.00124306       30     
produce:fembfilter:PDHDFEMBFilter                       1.10114       1.45538       1.96022       1.54871      0.271088        30     
produce:wclsdatahd:WireCellToolkit                      59.7972       75.6254       100.644       72.7908       10.6707        30     
produce:gaushit:GausHitFinder                          0.870151       1.60727       4.58239       1.45198      0.637791        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000387074   0.000625407   0.00135307    0.000565933   0.000178195      30     
produce:reco3d:SpacePointSolver                        0.462931       2.73735       6.93591       2.38306       1.48748        29     
produce:hitpdune:DisambigFromSpacePoints               0.608495       1.49701       2.79452       1.33722      0.594373        29     
produce:pandora:StandardPandora                         9.13919       28.0683       46.6909       26.9276       9.47443        29     
produce:pandoraWriter:StandardPandora                  0.178665      0.295017      0.416481      0.292413      0.0571869       29     
produce:pandoraTrack:LArPandoraTrackCreation            1.40022       3.59357       6.92372       3.71514       1.27789        29     
produce:pandoraShower:LArPandoraShowerCreation          1.61358       4.51742       9.11306       4.1071        2.29314        29     
produce:pandoracalo:Calorimetry                        0.681639       1.51318       3.09835       1.40948      0.532112        29     
produce:pandoracalonosce:Calorimetry                   0.603755       1.41507       2.86547       1.3916       0.486091        29     
produce:pandorapid:Chi2ParticleID                     0.00178565     0.0034051    0.00588059    0.00336159    0.000839748      29     
produce:pandoraShowercalo:ShowerCalorimetry             1.42049       3.65664       8.45998       2.98079       1.90895        29     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.45774       3.57047       7.80263       3.30186       1.73476        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.143771      0.306184      0.471125      0.287523      0.075534        29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0542514      0.11308       0.15665      0.107411      0.0243161       29     
produce:emtrkmichelid:EmTrackMichelId                   39.9197       59.4045       82.5316       58.1533       10.6661        29     
[art]:TriggerResults:TriggerResultInserter            3.9906e-05    5.99775e-05   0.000118981   5.97375e-05   1.38592e-05      30     
end_path:out1:RootOutput                              1.2115e-05    1.73802e-05   3.5639e-05    1.66615e-05   4.77243e-06      30     
end_path:michelremoving:michelremoving                6.4285e-05     0.200741      0.507157      0.166278      0.146118        30     
end_path:michelremovinggnocchi:michelremoving         4.1626e-05     0.196203      0.494472      0.162556      0.146355        30     
end_path:calibanagnocchi:CalibAnaTree                 3.3081e-05      1.10904       2.39397       1.04544      0.446008        30     
end_path:out1:RootOutput(write)                         1.07775       1.60372       2.34498       1.53048      0.335287        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4972.32 MB
  Peak resident set size usage (VmHWM): 2645.91 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1_reco_stage2_20240912T025419_keepup.root
\tHists: np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1_reco_stage2_20240912T025419_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1_reco_stage2_20240912T025419_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1_reco_stage2_20240912T025419_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726103914.0,
    "core.end_time": 1726109661.0,
    "core.events": [
      312360,
      312368,
      312376,
      312384,
      312400,
      312408,
      312416,
      312424,
      312432,
      312440,
      312448,
      312456,
      312464,
      312472,
      312480,
      312488,
      312496,
      312504,
      312512,
      312520,
      312528,
      312536,
      312544,
      312552,
      312560,
      312568,
      312576,
      312584,
      312592,
      312600
    ],
    "core.event_count": 30,
    "core.first_event_number": 312360,
    "core.last_event_number": 312600,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28557
    ],
    "core.runs_subruns": [
      2855700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406_reco_stage1_reco_stage2_20240912T025419_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1726103914.0,
    "core.end_time": 1726109661.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28557
    ],
    "core.runs_subruns": [
      2855700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028557_1301_dataflow0_datawriter_0_20240807T021406.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:12:17 UTC       justIN version: 01.01.09