justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79922.48@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79922.48@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3513
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 07:40:52
SiteUS_UChicago
EntryEngage_US_MWT2_uct2_gk02_condce_mcore
Last heartbeat2024-09-27 17:10:37
From worker nodeHostnameiut2-c309.iu.edu
cpuinfoIntel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 12:15:48
Input fileshd-protodune:np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657.hdf5
Outputting started2024-09-27 17:00:48
Output files
Finished2024-09-27 17:10:37
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

es, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56581 traces tagged "gauss"
FrameSaver: q=2.04087e+06 n=1063109 tag=gauss
wclsFrameSaver: saving 73321 traces tagged "wiener"
FrameSaver: q=2.20528e+06 n=972385 tag=wiener
3579 hits in TPC 0
3388 hits in TPC 1
8759 hits in TPC 2
5387 hits in TPC 3
2945 hits in TPC 4
4830 hits in TPC 5
10380 hits in TPC 6
4267 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 727 XUs and 521 XVs -> 8 XUVs
C:0 T:2 55866 XUs and 44590 XVs -> 1340 XUVs
C:0 T:3 777 XUs and 883 XVs -> 28 XUVs
C:0 T:4 29 XUs and 21 XVs -> 0 XUVs
C:0 T:5 10540 XUs and 11210 XVs -> 314 XUVs
C:0 T:6 70329 XUs and 61954 XVs -> 2263 XUVs
C:0 T:7 634 XUs and 604 XVs -> 20 XUVs
3973 XUVs total
1991 collection wire objects
3973 potential space points
Neighbour search...
138305 tests to find 77536 neighbours
Iterating with no regularization...
Begin: 2.81239e+07
0 2.56244e+07
1 2.54621e+07
2 2.54479e+07
Now with regularization...
Begin: 2.40387e+07
0 2.40325e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

27-Sep-2024 13:00:36 EDT  Closed output file "np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1_reco_stage2_20240927T170036_keepup.root"
27-Sep-2024 13:00:36 EDT  Closed input file "np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              100.486       149.092       236.519       147.203       31.5836        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00048437    0.00237559    0.00633365    0.00171269    0.00166302       35     
produce:fembfilter:PDHDFEMBFilter                      0.726783       1.03895       1.11562       1.07208      0.0947155       35     
produce:wclsdatahd:WireCellToolkit                      52.1028       60.8746       65.8773       60.9234       3.13272        35     
produce:gaushit:GausHitFinder                          0.726425       1.2492        1.9433        1.20714       0.30045        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000427129   0.000607945   0.00086258    0.000569053   0.000117482      35     
produce:reco3d:SpacePointSolver                        0.470088       1.5424        5.03107       1.3453       0.911755        35     
produce:hitpdune:DisambigFromSpacePoints               0.515739       1.18464       2.90554      0.975308      0.563426        35     
produce:pandora:StandardPandora                         12.3119       29.4011       57.4121       29.3691       11.0384        35     
produce:pandoraWriter:StandardPandora                  0.156162      0.274687      0.435851      0.279372      0.0632687       35     
produce:pandoraTrack:LArPandoraTrackCreation            2.14212       5.88505       12.1417       5.45881       2.56827        35     
produce:pandoraShower:LArPandoraShowerCreation          1.72193       6.68139       17.7005       6.06439       3.65305        35     
produce:pandoracalo:Calorimetry                        0.842357       2.17449       5.0034        1.9649        1.02921        35     
produce:pandoracalonosce:Calorimetry                   0.802554       2.07276       4.86108       1.9962       0.991128        35     
produce:pandorapid:Chi2ParticleID                     0.00164403    0.00326967    0.00528704    0.00319085    0.000906764      35     
produce:pandoraShowercalo:ShowerCalorimetry             1.33392       4.9936        15.8141       4.18518       3.11903        35     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.3505        4.94366       14.8871       4.22606       2.96361        35     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.108275      0.207862      0.346267      0.191145      0.059582        35     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0427745     0.0849301     0.150576      0.0832459     0.0262578       35     
produce:emtrkmichelid:EmTrackMichelId                   13.5063       22.9114       34.0755       23.3039       4.46166        35     
[art]:TriggerResults:TriggerResultInserter             4.65e-05     7.2363e-05    0.000116172   7.1695e-05    1.42552e-05      35     
end_path:out1:RootOutput                              1.2576e-05    1.84682e-05   3.3061e-05    1.8396e-05    3.79596e-06      35     
end_path:michelremoving:michelremoving                 0.0431996     0.177619       0.64573      0.0949719     0.143756        35     
end_path:michelremovinggnocchi:michelremoving          0.0394963     0.165837      0.632126      0.0915565     0.139241        35     
end_path:calibanagnocchi:CalibAnaTree                  0.531725       1.65549       4.25866       1.4096       0.864272        35     
end_path:out1:RootOutput(write)                         0.64423       1.26779       2.10251       1.26369      0.345888        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5877.51 MB
  Peak resident set size usage (VmHWM): 2975.43 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1_reco_stage2_20240927T170036_keepup.root
\tHists: np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1_reco_stage2_20240927T170036_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1_reco_stage2_20240927T170036_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1_reco_stage2_20240927T170036_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727451162.0,
    "core.end_time": 1727456437.0,
    "core.events": [
      13739,
      13743,
      13747,
      13751,
      13755,
      13759,
      13763,
      13767,
      13771,
      13775,
      13779,
      13783,
      13787,
      13791,
      13795,
      13799,
      13803,
      13807,
      13811,
      13815,
      13819,
      13823,
      13827,
      13831,
      13835,
      13839,
      13843,
      13847,
      13851,
      13855,
      13859,
      13863,
      13867,
      13871,
      13875
    ],
    "core.event_count": 35,
    "core.first_event_number": 13739,
    "core.last_event_number": 13875,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27363
    ],
    "core.runs_subruns": [
      2736300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657_reco_stage1_reco_stage2_20240927T170036_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727451162.0,
    "core.end_time": 1727456437.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27363
    ],
    "core.runs_subruns": [
      2736300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027363_0097_dataflow1_datawriter_0_20240622T020657.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:30:19 UTC       justIN version: 01.01.08