justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 77774.4@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID77774.4@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3451
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 00:14:30
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-09-26 05:12:26
From worker nodeHostnameccwcondor0597
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 03:27:22
Input fileshd-protodune:np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525.hdf5
Outputting started2024-09-26 04:31:14
Output files
Finished2024-09-26 05:12:26
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ng cooked to 5859 ticks
wclsFrameSaver: saving 29726 traces tagged "gauss"
FrameSaver: q=628342 n=515008 tag=gauss
wclsFrameSaver: saving 38883 traces tagged "wiener"
FrameSaver: q=682250 n=468686 tag=wiener
1682 hits in TPC 0
1622 hits in TPC 1
3548 hits in TPC 2
2054 hits in TPC 3
2216 hits in TPC 4
3898 hits in TPC 5
2826 hits in TPC 6
1728 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 98 XUs and 60 XVs -> 0 XUVs
C:0 T:2 64303 XUs and 39694 XVs -> 922 XUVs
C:0 T:3 11 XUs and 17 XVs -> 0 XUVs
C:0 T:4 141 XUs and 211 XVs -> 4 XUVs
C:0 T:5 5560 XUs and 5931 XVs -> 289 XUVs
C:0 T:6 4127 XUs and 3846 XVs -> 324 XUVs
C:0 T:7 84 XUs and 99 XVs -> 0 XUVs
1539 XUVs total
814 collection wire objects
1539 potential space points
Neighbour search...
30579 tests to find 15324 neighbours
Iterating with no regularization...
Begin: 1.05832e+07
0 9.63942e+06
1 9.5972e+06
2 9.58658e+06
3 9.58281e+06
Now with regularization...
Begin: 9.2306e+06
0 9.22854e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

26-Sep-2024 06:31:03 CEST  Closed output file "np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1_reco_stage2_20240926T043103_keepup.root"
26-Sep-2024 06:31:03 CEST  Closed input file "np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              48.3948       86.9193       125.112       85.7845       16.6308        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000579877   0.00298349    0.00494586    0.00308712    0.00119013       30     
produce:fembfilter:PDHDFEMBFilter                      0.508085      0.687037      0.813939      0.714105      0.0802237       30     
produce:wclsdatahd:WireCellToolkit                      31.721        39.093        45.2733       39.4314       3.81315        30     
produce:gaushit:GausHitFinder                          0.333294      0.671547       1.63724      0.641665      0.245077        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000199495   0.000333968   0.000769673   0.000312116   0.000107126      30     
produce:reco3d:SpacePointSolver                        0.211601       0.90977        2.98        0.716492      0.647648        29     
produce:hitpdune:DisambigFromSpacePoints               0.105645      0.471653       1.26607      0.440814      0.260739        29     
produce:pandora:StandardPandora                         5.14026       10.5753       20.9815       9.61881       4.3045         29     
produce:pandoraWriter:StandardPandora                  0.0764529     0.147138      0.241771       0.15712      0.0384034       29     
produce:pandoraTrack:LArPandoraTrackCreation           0.508469       1.57682       3.87143       1.42238      0.645743        29     
produce:pandoraShower:LArPandoraShowerCreation         0.636838       1.82214       5.36567       1.62175      0.919687        29     
produce:pandoracalo:Calorimetry                        0.321663      0.751135       1.72332      0.742728      0.271126        29     
produce:pandoracalonosce:Calorimetry                   0.316013       0.69497       1.67752      0.638396      0.280664        29     
produce:pandorapid:Chi2ParticleID                     0.00123104    0.00207928    0.00498403    0.00198023    0.000689043      29     
produce:pandoraShowercalo:ShowerCalorimetry            0.339457       1.56817       3.85956       1.45018      0.675167        29     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.376602       1.49132       4.06305       1.39379       0.71167        29     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0591746     0.129646      0.191436      0.129776      0.0349298       29     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0224319     0.045896      0.0702229     0.046907      0.0109386       29     
produce:emtrkmichelid:EmTrackMichelId                   16.4696       26.2762       37.3245       27.2894       5.67493        29     
[art]:TriggerResults:TriggerResultInserter            3.2831e-05    6.58815e-05   0.000104195   6.68705e-05   1.61876e-05      30     
end_path:out1:RootOutput                               1.051e-05    1.87041e-05   4.4313e-05    1.77035e-05   6.1851e-06       30     
end_path:michelremoving:michelremoving                6.3839e-05     0.0598632      0.26864      0.0382801     0.0559507       30     
end_path:michelremovinggnocchi:michelremoving         4.9653e-05     0.0558852     0.261953      0.0396992     0.0525348       30     
end_path:calibanagnocchi:CalibAnaTree                 4.9142e-05     0.533932       1.18309      0.495396      0.242884        30     
end_path:out1:RootOutput(write)                        0.359763      0.696605       1.20748      0.682441       0.20378        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4927.28 MB
  Peak resident set size usage (VmHWM): 2355.8 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1_reco_stage2_20240926T043103_keepup.root
\tHists: np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1_reco_stage2_20240926T043103_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1_reco_stage2_20240926T043103_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1_reco_stage2_20240926T043103_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322345.0,
    "core.end_time": 1727325064.0,
    "core.events": [
      456270,
      456278,
      456286,
      456294,
      456302,
      456310,
      456318,
      456326,
      456334,
      456342,
      456350,
      456358,
      456366,
      456374,
      456382,
      456390,
      456398,
      456406,
      456414,
      456422,
      456430,
      456438,
      456446,
      456454,
      456462,
      456470,
      456478,
      456486,
      456494,
      456502
    ],
    "core.event_count": 30,
    "core.first_event_number": 456270,
    "core.last_event_number": 456502,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525_reco_stage1_reco_stage2_20240926T043103_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727322345.0,
    "core.end_time": 1727325064.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29107
    ],
    "core.runs_subruns": [
      2910700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029107_1901_dataflow6_datawriter_0_20240907T225525.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:21:32 UTC       justIN version: 01.01.08