justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269867.9@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269867.9@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3566
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 04:52:36
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 07:00:43
From worker nodeHostnamespool1607.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 05:47:12
Input fileshd-protodune:np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212.hdf5
Outputting started2024-10-05 06:58:56
Output files
Finished2024-10-05 07:00:43
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 71801 traces tagged "gauss"
FrameSaver: q=2.70001e+06 n=1210999 tag=gauss
wclsFrameSaver: saving 99235 traces tagged "wiener"
FrameSaver: q=2.95314e+06 n=1075868 tag=wiener
3614 hits in TPC 0
3276 hits in TPC 1
13322 hits in TPC 2
7988 hits in TPC 3
2379 hits in TPC 4
7247 hits in TPC 5
10217 hits in TPC 6
4686 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 3 XUs and 2 XVs -> 0 XUVs
C:0 T:1 4769 XUs and 1997 XVs -> 41 XUVs
C:0 T:2 122796 XUs and 82106 XVs -> 2153 XUVs
C:0 T:3 843 XUs and 633 XVs -> 40 XUVs
C:0 T:4 33 XUs and 14 XVs -> 0 XUVs
C:0 T:5 24302 XUs and 19232 XVs -> 774 XUVs
C:0 T:6 102907 XUs and 49281 XVs -> 1601 XUVs
C:0 T:7 73 XUs and 81 XVs -> 3 XUVs
4612 XUVs total
2429 collection wire objects
4612 potential space points
Neighbour search...
124222 tests to find 63046 neighbours
Iterating with no regularization...
Begin: 7.62853e+07
0 7.15456e+07
1 7.12833e+07
2 7.12569e+07
Now with regularization...
Begin: 6.90809e+07
0 6.90714e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

05-Oct-2024 06:58:35 UTC  Closed output file "np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1_reco_stage2_20241005T065835_keepup.root"
05-Oct-2024 06:58:35 UTC  Closed input file "np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              48.6525       79.8763       125.696       75.2039       15.4357        35     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000329933   0.00181144    0.00495151    0.00182379    0.00119289       35     
produce:fembfilter:PDHDFEMBFilter                      0.635518      0.707912       1.22933      0.669143      0.124257        35     
produce:wclsdatahd:WireCellToolkit                      42.0562       45.422        48.3306       45.3891       1.52283        35     
produce:gaushit:GausHitFinder                           0.4698       0.705916       1.32574      0.658977       0.20828        35     
produce:nhitsfilter:NumberOfHitsFilter                0.000307567   0.000430059   0.000663266   0.000422277   9.39608e-05      35     
produce:reco3d:SpacePointSolver                        0.153281      0.921716       3.91513      0.488969       0.85817        34     
produce:hitpdune:DisambigFromSpacePoints               0.172455      0.384202      0.969298      0.318731      0.184005        34     
produce:pandora:StandardPandora                         4.86219       10.6939       26.2679       8.8582        4.90085        34     
produce:pandoraWriter:StandardPandora                  0.0913496     0.138535      0.226546      0.139492      0.0335845       34     
produce:pandoraTrack:LArPandoraTrackCreation           0.352909       1.92326       4.99383       1.72625       1.04752        34     
produce:pandoraShower:LArPandoraShowerCreation         0.635904       2.26754       7.95969       1.76515       1.61122        34     
produce:pandoracalo:Calorimetry                        0.234955      0.768998       2.03312      0.666467      0.373251        34     
produce:pandoracalonosce:Calorimetry                   0.203478      0.716121       2.0078       0.620099       0.36205        34     
produce:pandorapid:Chi2ParticleID                     0.00123395    0.00190497    0.00779778    0.00168208    0.00107385       34     
produce:pandoraShowercalo:ShowerCalorimetry            0.473642       1.71304       5.76082       1.42045       1.11923        34     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.456531       1.67743       5.81044       1.3808        1.10677        34     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.062556      0.0949481      0.15422      0.0929748     0.0220976       34     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.024719      0.0375396     0.0629076     0.0367657    0.00955805       34     
produce:emtrkmichelid:EmTrackMichelId                   8.3169        11.1246       17.2074       10.8448       2.37746        34     
[art]:TriggerResults:TriggerResultInserter            2.7262e-05    4.73562e-05   8.3551e-05    4.5213e-05    1.44901e-05      35     
end_path:out1:RootOutput                               6.316e-06    1.52727e-05   3.1792e-05    1.3589e-05    6.43799e-06      35     
end_path:michelremoving:michelremoving                3.7162e-05     0.0651305     0.224621      0.0434816     0.0521301       35     
end_path:michelremovinggnocchi:michelremoving         1.8841e-05     0.0632576     0.223373      0.0348806     0.0517674       35     
end_path:calibanagnocchi:CalibAnaTree                 1.4498e-05     0.536383       1.51458      0.511511      0.282976        35     
end_path:out1:RootOutput(write)                        0.332119      0.622754      0.994252      0.601828      0.146578        35     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5847.91 MB
  Peak resident set size usage (VmHWM): 2408.53 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1_reco_stage2_20241005T065835_keepup.root
\tHists: np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1_reco_stage2_20241005T065835_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1_reco_stage2_20241005T065835_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1_reco_stage2_20241005T065835_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728108684.0,
    "core.end_time": 1728111516.0,
    "core.events": [
      213222,
      213226,
      213230,
      213234,
      213238,
      213242,
      213246,
      213250,
      213254,
      213258,
      213262,
      213266,
      213270,
      213274,
      213278,
      213282,
      213286,
      213290,
      213294,
      213298,
      213302,
      213306,
      213310,
      213314,
      213318,
      213322,
      213326,
      213330,
      213334,
      213338,
      213342,
      213346,
      213350,
      213354,
      213358
    ],
    "core.event_count": 35,
    "core.first_event_number": 213222,
    "core.last_event_number": 213358,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212_reco_stage1_reco_stage2_20241005T065835_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728108684.0,
    "core.end_time": 1728111516.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27425
    ],
    "core.runs_subruns": [
      2742500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027425_1523_dataflow2_datawriter_0_20240625T220212.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:15:36 UTC       justIN version: 01.01.09