justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269279.144@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID269279.144@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3589
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-04 16:48:36
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-10-04 20:42:37
From worker nodeHostnamedunegli-4177563-0-fnpc17104.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-04 17:30:42
Input fileshd-protodune:np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154.hdf5
JobscriptExit code0
Real time3h (11454s)
CPU time1h (6417s = 56%)
Outputting started2024-10-04 20:41:37
Output fileshd-protodune-det-reco:np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup.root
hd-protodune-det-reco:np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup_hists.root
Finished2024-10-04 20:42:37
Saved logsjustin-logs:269279.144-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

:0 26 XUs and 18 XVs -> 0 XUVs
C:0 T:1 1882 XUs and 916 XVs -> 9 XUVs
C:0 T:2 15772 XUs and 9411 XVs -> 316 XUVs
C:0 T:3 243 XUs and 220 XVs -> 9 XUVs
C:0 T:4 332 XUs and 161 XVs -> 9 XUVs
C:0 T:5 17050 XUs and 9167 XVs -> 140 XUVs
C:0 T:6 21732 XUs and 23009 XVs -> 2416 XUVs
C:0 T:7 625 XUs and 989 XVs -> 89 XUVs
2988 XUVs total
1053 collection wire objects
2988 potential space points
Neighbour search...
131694 tests to find 81358 neighbours
Iterating with no regularization...
Begin: 1.59835e+07
0 1.41473e+07
1 1.39833e+07
2 1.39593e+07
3 1.39527e+07
Now with regularization...
Begin: 1.30146e+07
0 1.30108e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 7440 TrkackID 3 startx, y, z 125.851 307.786 307.994  wireno, peakt tpcno 307 1596.13 2 dist 175.605min T, max_T3.52565 1627.9
no of hits closeby  0   event 7440 TrkackID 3 startx, y, z 125.851 307.786 307.994  wireno, peakt tpcno 307 1596.13 2 dist 175.605min T, max_T3.52565 1627.9
04-Oct-2024 20:40:32 UTC  Closed output file "np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup.root"
04-Oct-2024 20:40:32 UTC  Closed input file "np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              85.2335       143.088       278.303       131.366       43.2727        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000717079    0.0134615     0.210359     0.00379306     0.038142        40     
produce:fembfilter:PDHDFEMBFilter                       1.00452       1.70231       3.78539       1.52219      0.613111        40     
produce:wclsdatahd:WireCellToolkit                      38.2927       52.485        69.7846       51.172        8.10071        40     
produce:gaushit:GausHitFinder                          0.533665      0.990448       1.5872       0.941388       0.28444        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000344858    0.0217285     0.463795     0.00055826     0.0817428       40     
produce:reco3d:SpacePointSolver                        0.269971       3.37483       22.8133       1.32266       4.64988        40     
produce:hitpdune:DisambigFromSpacePoints               0.289689       1.02993       5.14869      0.790621      0.800055        40     
produce:pandora:StandardPandora                         7.58673       22.4798       69.7075       18.3961       13.1108        40     
produce:pandoraWriter:StandardPandora                  0.112631      0.610981       4.28615      0.223869       1.02879        40     
produce:pandoraTrack:LArPandoraTrackCreation           0.966691       4.2061        11.2933       3.39158       2.39408        40     
produce:pandoraShower:LArPandoraShowerCreation         0.765661       5.57572       21.4453       4.1369        4.20058        40     
produce:pandoracalo:Calorimetry                        0.410379       1.62742       4.24227       1.30742       1.02877        40     
produce:pandoracalonosce:Calorimetry                   0.377748       1.57332       4.56901       1.15436       1.07643        40     
produce:pandorapid:Chi2ParticleID                     0.00139664    0.00226877    0.00368335    0.00213023    0.00057331       40     
produce:pandoraShowercalo:ShowerCalorimetry            0.691695       4.16088       16.7425       3.0318        3.37701        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.675508       3.86474       14.7065       3.03883       3.04531        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0653995      0.14153      0.229538      0.135594      0.0375458       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0300938     0.0560233     0.0906611     0.0545733     0.0151388       40     
produce:emtrkmichelid:EmTrackMichelId                   16.4936       34.0736       57.8465       33.4919       10.7293        40     
[art]:TriggerResults:TriggerResultInserter            2.7811e-05    5.94359e-05   9.0063e-05    5.72115e-05   1.39293e-05      40     
end_path:out1:RootOutput                               9.459e-06    1.70131e-05   2.8094e-05    1.5239e-05    4.57411e-06      40     
end_path:michelremoving:michelremoving                 0.0314444     0.119991       0.64618      0.0826265      0.10319        40     
end_path:michelremovinggnocchi:michelremoving          0.0258025     0.114425      0.861811      0.0736139     0.149489        40     
end_path:calibanagnocchi:CalibAnaTree                  0.319608       1.47722       3.85707       1.18812      0.984571        40     
end_path:out1:RootOutput(write)                        0.532839       2.97709       18.3885       2.01493       3.39062        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5076.85 MB
  Peak resident set size usage (VmHWM): 2739.07 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup.root
\tHists: np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728068638.0,
    "core.end_time": 1728074486.0,
    "core.events": [
      7401,
      7402,
      7403,
      7404,
      7405,
      7406,
      7407,
      7408,
      7409,
      7410,
      7411,
      7412,
      7413,
      7414,
      7415,
      7416,
      7417,
      7418,
      7419,
      7420,
      7421,
      7422,
      7423,
      7424,
      7425,
      7426,
      7427,
      7428,
      7429,
      7430,
      7431,
      7432,
      7433,
      7434,
      7435,
      7436,
      7437,
      7438,
      7439,
      7440
    ],
    "core.event_count": 40,
    "core.first_event_number": 7401,
    "core.last_event_number": 7440,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27783
    ],
    "core.runs_subruns": [
      2778300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154_reco_stage1_reco_stage2_20241004T204031_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728068638.0,
    "core.end_time": 1728074486.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27783
    ],
    "core.runs_subruns": [
      2778300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027783_0185_dataflow0_datawriter_0_20240707T062154.hdf5"
    }
  ]
}
justIN time: 2024-11-24 11:44:06 UTC       justIN version: 01.01.09