srun: Warning: can't honor --ntasks-per-node set to 16 which doesn't match the requested tasks 24 with the number of requested nodes 24. Ignoring --ntasks-per-node. Shared memory islands host a minimum of 16 and a maximum of 16 MPI ranks. We shall use 24 MPI ranks in total for assisting one-sided communication (1 per shared memory node). ___ __ ____ ___ ____ ____ __ / __) /__\ ( _ \ / __)( ___)(_ _)___ /. | ( (_-. /(__)\ )(_) )( (_-. )__) )( (___)(_ _) \___/(__)(__)(____/ \___/(____) (__) (_) This is Gadget, version 4.0. Git commit 2ed5308cb4e4c756612897b0d764685b32645ece, Sat Nov 5 20:24:26 2022 +0000 Code was compiled with the following compiler and flags: mpicxx -std=c++11 -ggdb -O3 -march=native -Wall -Wno-format-security -Wno-unknown-pragmas -I/cosma/home/dp004/dc-spri1/Libs/include -I../binaries/forward_PM2048_O3_io//build -Isrc Code was compiled with the following settings: ASMTH=1.5 DEBUG_MD5 DISABLE_GRAVCOST DOUBLEPRECISION=1 FORCE_EQUAL_TIMESTEPS IDS_48BIT MULTIPOLE_ORDER=3 NEUTRINOS NEUTRINOS_DELTAF NEUTRINOS_MOVE_WITH_RELATISTIC_VELOCITIES NSOFTCLASSES=1 NTYPES=6 PERIODIC PMGRID=2048 POSITIONS_IN_32BIT PRESERVE_SHMEM_BINARY_INVARIANCE SELFGRAVITY TIMESTEP_FILE_WRITE VELOCITIES_IN_32BIT Running on 360 MPI tasks. BEGRUN: Size of particle structure 160 [bytes] BEGRUN: Size of sph particle structure 192 [bytes] BEGRUN: Size of gravity tree node 120 [bytes] BEGRUN: Size of neighbour tree node 152 [bytes] BEGRUN: Size of subfind auxiliary data 36 [bytes] ------------------------------------------------------------------------------------------------------------------------- AvailMem: Largest = 127819.32 Mb (on task= 210), Smallest = 127517.53 Mb (on task= 0), Average = 127696.75 Mb Total Mem: Largest = 128910.93 Mb (on task= 0), Smallest = 128910.84 Mb (on task= 45), Average = 128910.92 Mb Committed_AS: Largest = 1393.40 Mb (on task= 0), Smallest = 1091.60 Mb (on task= 210), Average = 1214.17 Mb SwapTotal: Largest = 0.00 Mb (on task= 0), Smallest = 0.00 Mb (on task= 0), Average = 0.00 Mb SwapFree: Largest = 0.00 Mb (on task= 0), Smallest = 0.00 Mb (on task= 0), Average = 0.00 Mb AllocMem: Largest = 1393.40 Mb (on task= 0), Smallest = 1091.60 Mb (on task= 210), Average = 1214.17 Mb avail /dev/shm: Largest = 64446.43 Mb (on task= 0), Smallest = 64446.36 Mb (on task= 45), Average = 64446.42 Mb ------------------------------------------------------------------------------------------------------------------------- Task=0 has the maximum commited memory and is host: m5142.pri.cosma7.alces.network ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Obtaining parameters from file 'param.txt': InitCondFile /cosma5/data/durham/dc-elbe1/nubg_new/ICs/NUBG_M060_N1024_6044/ics OutputDir ./output SnapshotFileBase snapshot OutputListFilename ./outputs.txt ICFormat 3 SnapFormat 3 TimeLimitCPU 259200 CpuTimeBetRestartFile 7200 MaxMemSize 4000 TimeBegin 0.03125 TimeMax 1 ComovingIntegrationOn 1 Omega0 0.309693 OmegaLambda 0.688821 OmegaBaryon 0.0489747 HubbleParam 0.6766 BoxSize 676.6 Hubble 100 OmegaCurvature 0 Neutrino_SummedPartMass_in_eV 0.06 NeutrinoNumDegenerateMassiveSpecies 1 NeutrinoNumMasslessSpecies 2.0308 NeutrinoTemperature 1.95176 CMBTemperature 2.7255 ArtBulkViscConst 1 InitGasTemp 1 MinEgySpec 1 OutputListOn 1 TimeBetSnapshot 0 TimeOfFirstSnapshot 0 TimeBetStatistics 0.01 NumFilesPerSnapshot 4 MaxFilesWithConcurrentIO 4 ErrTolIntAccuracy 0.05 CourantFac 0.3 MaxSizeTimestep 0.02 MinSizeTimestep 0 TypeOfOpeningCriterion 0 ErrTolTheta 0.75 ErrTolThetaMax 1 ErrTolForceAcc 0.005 TopNodeFactor 4 ActivePartFracForNewDomainDecomp 0 DesNumNgb 64 MaxNumNgbDeviation 1 UnitLength_in_cm 3.08568e+24 UnitMass_in_g 1.98843e+43 UnitVelocity_in_cm_per_s 100000 GravityConstantInternal 43.0096 SofteningComovingClass0 0.0264297 SofteningMaxPhysClass0 0.0264297 SofteningClassOfPartType0 0 SofteningClassOfPartType1 0 SofteningClassOfPartType2 0 SofteningClassOfPartType3 0 SofteningClassOfPartType4 0 SofteningClassOfPartType5 0 MALLOC: Allocation of shared memory took 0.00047493 sec found 2 times in output-list. BEGRUN: Omega0 = 0.30969270 BEGRUN: OmegaLambda = 0.68882116 BEGRUN: OmegaCurvature = 0.00000000 BEGRUN: OmegaNeutrino = 0.00140720 BEGRUN: OmegaRelNeutrino = 0.00002491 BEGRUN: OmegaRad = 0.00005402 BEGRUN: NeutrinoMatterFraction = 0.00452332 BEGRUN: NeutrinoVelScale = 840.366 BEGRUN: h = 0.6766 BEGRUN: G (internal units) = 43.0096 BEGRUN: G (code units) = 6.67428e-08 BEGRUN: UnitMass_in_g = 1.98843e+43 BEGRUN: UnitLenth_in_cm = 3.08568e+24 BEGRUN: UnitTime_in_s = 3.08568e+19 BEGRUN: UnitVelocity_in_cm_per_s = 100000 BEGRUN: UnitDensity_in_cgs = 6.76799e-31 BEGRUN: UnitEnergy_in_cgs = 1.98844e+53 BEGRUN: OmegaTot - 1 = -0.00000000 RESTART: Loading restart files... RESTART: Loading restart files group #1 out of 90... RESTART: Loading restart files group #2 out of 90... RESTART: Loading restart files group #3 out of 90... RESTART: Loading restart files group #4 out of 90... RESTART: Loading restart files group #5 out of 90... RESTART: Loading restart files group #6 out of 90... RESTART: Loading restart files group #7 out of 90... RESTART: Loading restart files group #8 out of 90... RESTART: Loading restart files group #9 out of 90... RESTART: Loading restart files group #10 out of 90... RESTART: Loading restart files group #11 out of 90... RESTART: Loading restart files group #12 out of 90... RESTART: Loading restart files group #13 out of 90... RESTART: Loading restart files group #14 out of 90... RESTART: Loading restart files group #15 out of 90... RESTART: Loading restart files group #16 out of 90... RESTART: Loading restart files group #17 out of 90... RESTART: Loading restart files group #18 out of 90... RESTART: Loading restart files group #19 out of 90... RESTART: Loading restart files group #20 out of 90... RESTART: Loading restart files group #21 out of 90... RESTART: Loading restart files group #22 out of 90... RESTART: Loading restart files group #23 out of 90... RESTART: Loading restart files group #24 out of 90... RESTART: Loading restart files group #25 out of 90... RESTART: Loading restart files group #26 out of 90... RESTART: Loading restart files group #27 out of 90... RESTART: Loading restart files group #28 out of 90... RESTART: Loading restart files group #29 out of 90... RESTART: Loading restart files group #30 out of 90... RESTART: Loading restart files group #31 out of 90... RESTART: Loading restart files group #32 out of 90... RESTART: Loading restart files group #33 out of 90... RESTART: Loading restart files group #34 out of 90... RESTART: Loading restart files group #35 out of 90... RESTART: Loading restart files group #36 out of 90... RESTART: Loading restart files group #37 out of 90... RESTART: Loading restart files group #38 out of 90... RESTART: Loading restart files group #39 out of 90... RESTART: Loading restart files group #40 out of 90... RESTART: Loading restart files group #41 out of 90... RESTART: Loading restart files group #42 out of 90... RESTART: Loading restart files group #43 out of 90... RESTART: Loading restart files group #44 out of 90... RESTART: Loading restart files group #45 out of 90... RESTART: Loading restart files group #46 out of 90... RESTART: Loading restart files group #47 out of 90... RESTART: Loading restart files group #48 out of 90... RESTART: Loading restart files group #49 out of 90... RESTART: Loading restart files group #50 out of 90... RESTART: Loading restart files group #51 out of 90... RESTART: Loading restart files group #52 out of 90... RESTART: Loading restart files group #53 out of 90... RESTART: Loading restart files group #54 out of 90... RESTART: Loading restart files group #55 out of 90... RESTART: Loading restart files group #56 out of 90... RESTART: Loading restart files group #57 out of 90... RESTART: Loading restart files group #58 out of 90... RESTART: Loading restart files group #59 out of 90... RESTART: Loading restart files group #60 out of 90... RESTART: Loading restart files group #61 out of 90... RESTART: Loading restart files group #62 out of 90... RESTART: Loading restart files group #63 out of 90... RESTART: Loading restart files group #64 out of 90... RESTART: Loading restart files group #65 out of 90... RESTART: Loading restart files group #66 out of 90... RESTART: Loading restart files group #67 out of 90... RESTART: Loading restart files group #68 out of 90... RESTART: Loading restart files group #69 out of 90... RESTART: Loading restart files group #70 out of 90... RESTART: Loading restart files group #71 out of 90... RESTART: Loading restart files group #72 out of 90... RESTART: Loading restart files group #73 out of 90... RESTART: Loading restart files group #74 out of 90... RESTART: Loading restart files group #75 out of 90... RESTART: Loading restart files group #76 out of 90... RESTART: Loading restart files group #77 out of 90... RESTART: Loading restart files group #78 out of 90... RESTART: Loading restart files group #79 out of 90... RESTART: Loading restart files group #80 out of 90... RESTART: Loading restart files group #81 out of 90... RESTART: Loading restart files group #82 out of 90... RESTART: Loading restart files group #83 out of 90... RESTART: Loading restart files group #84 out of 90... RESTART: Loading restart files group #85 out of 90... RESTART: Loading restart files group #86 out of 90... RESTART: Loading restart files group #87 out of 90... RESTART: Loading restart files group #88 out of 90... RESTART: Loading restart files group #89 out of 90... RESTART: Loading restart files group #90 out of 90... RESTART: done. load/save took 218.664 sec, total size 352287 MB, corresponds to effective I/O rate of 1611.08 MB/sec SNAPSHOT: Setting next time for snapshot file to Time_next= 0.501356 (DumpFlag=1) Sync-Point 902, Time: 0.364735, Redshift: 1.74171, Systemstep: 0.000308482, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 902). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 28.5662 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08847|1.04768 DOMAIN: combining multiple-domains took 0.290645 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 16.2748 sec) DOMAIN: domain decomposition done. (took in total 45.5223 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.01909 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 16.5417 sec =932527 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994994 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.271 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25484 sec PM-PERIODIC: done. (took 13.6653 seconds) TIMESTEPS: displacement time constraint: 0.0100267 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21019 sec PM-PERIODIC: done. (took 13.6645 seconds) TIMESTEPS: displacement time constraint: 0.0100266 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 903, Time: 0.365044, Redshift: 1.7394, Systemstep: 0.000308743, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 903). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80301 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08693|1.04768 DOMAIN: combining multiple-domains took 0.294803 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 5.16141 sec) DOMAIN: domain decomposition done. (took in total 7.65049 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.1936 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.96 MB) GRAVTREE: Tree construction done. took 16.5204 sec =932632 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994995 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.463 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 904, Time: 0.365353, Redshift: 1.73708, Systemstep: 0.000309004, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 904). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78555 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08475|1.01982 DOMAIN: combining multiple-domains took 0.286829 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.5856 sec) DOMAIN: domain decomposition done. (took in total 16.048 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.03179 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 16.6151 sec =932704 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994995 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.09 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 249.124 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 905, Time: 0.365662, Redshift: 1.73476, Systemstep: 0.000309266, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 905). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79367 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08476|1.01982 DOMAIN: combining multiple-domains took 0.286133 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.24934 sec) DOMAIN: domain decomposition done. (took in total 5.71923 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24657 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 16.62 sec =932777 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994996 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.09 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 249.155 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 906, Time: 0.365972, Redshift: 1.73245, Systemstep: 0.000309528, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 906). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82493 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08478|1.01982 DOMAIN: combining multiple-domains took 0.325422 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.36857 sec) DOMAIN: domain decomposition done. (took in total 4.9094 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23642 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.71 MB) GRAVTREE: Tree construction done. took 16.6305 sec =932867 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994996 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.09 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 248.885 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 907, Time: 0.366282, Redshift: 1.73014, Systemstep: 0.00030979, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 907). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79056 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08478|1.01982 DOMAIN: combining multiple-domains took 0.286396 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14178 sec) DOMAIN: domain decomposition done. (took in total 4.60862 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23113 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.71 MB) GRAVTREE: Tree construction done. took 16.6135 sec =932976 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994997 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.09 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 248.871 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 908, Time: 0.366592, Redshift: 1.72783, Systemstep: 0.000310052, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 908). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.789 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08482|1.01982 DOMAIN: combining multiple-domains took 0.285294 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.64685 sec) DOMAIN: domain decomposition done. (took in total 6.11215 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23525 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.71 MB) GRAVTREE: Tree construction done. took 16.6101 sec =933101 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994997 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.1 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 249.123 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 909, Time: 0.366902, Redshift: 1.72552, Systemstep: 0.000310314, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 909). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78908 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08952|1.01559 DOMAIN: combining multiple-domains took 0.293655 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3642 sec) DOMAIN: domain decomposition done. (took in total 14.8371 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.10483 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.5362 sec =933167 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994998 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.369 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 910, Time: 0.367213, Redshift: 1.72322, Systemstep: 0.000310577, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 910). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78915 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08954|1.01559 DOMAIN: combining multiple-domains took 0.285819 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17348 sec) DOMAIN: domain decomposition done. (took in total 5.63965 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26274 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.651 sec =933255 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994998 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.706 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24801 sec PM-PERIODIC: done. (took 13.5852 seconds) TIMESTEPS: displacement time constraint: 0.0100213 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23117 sec PM-PERIODIC: done. (took 13.6096 seconds) TIMESTEPS: displacement time constraint: 0.0100212 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 911, Time: 0.367523, Redshift: 1.72091, Systemstep: 0.00031084, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 911). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78902 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08959|1.01559 DOMAIN: combining multiple-domains took 0.285485 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20572 sec) DOMAIN: domain decomposition done. (took in total 5.67086 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21974 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.6049 sec =933346 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994999 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.694 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 912, Time: 0.367835, Redshift: 1.71861, Systemstep: 0.000311103, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 912). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78911 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08961|1.01559 DOMAIN: combining multiple-domains took 0.287451 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21137 sec) DOMAIN: domain decomposition done. (took in total 4.67818 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2933 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.5148 sec =933433 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.994999 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.946 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 913, Time: 0.368146, Redshift: 1.71631, Systemstep: 0.000311366, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 913). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83605 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08963|1.01559 DOMAIN: combining multiple-domains took 0.286643 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.64557 sec) DOMAIN: domain decomposition done. (took in total 6.15836 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2931 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.5116 sec =933533 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.571 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 914, Time: 0.368458, Redshift: 1.71402, Systemstep: 0.00031163, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 914). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7887 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08966|1.01559 DOMAIN: combining multiple-domains took 0.286036 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93456 sec) DOMAIN: domain decomposition done. (took in total 5.39956 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30089 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.5428 sec =933636 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.832 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 915, Time: 0.368769, Redshift: 1.71172, Systemstep: 0.000311894, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 915). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79404 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08966|1.01559 DOMAIN: combining multiple-domains took 0.285467 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.85029 sec) DOMAIN: domain decomposition done. (took in total 5.32141 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28918 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.5545 sec =933722 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995001 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.908 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 916, Time: 0.369082, Redshift: 1.70943, Systemstep: 0.000312158, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 916). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78832 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0904|1.04768 DOMAIN: combining multiple-domains took 0.286998 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.6027 sec) DOMAIN: domain decomposition done. (took in total 15.0679 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.06961 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 16.5667 sec =933798 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995001 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.77 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 917, Time: 0.369394, Redshift: 1.70714, Systemstep: 0.000312422, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 917). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.869 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09043|1.04768 DOMAIN: combining multiple-domains took 0.287199 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30423 sec) DOMAIN: domain decomposition done. (took in total 5.91678 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25984 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 16.5675 sec =933891 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995002 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.879 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 918, Time: 0.369707, Redshift: 1.70485, Systemstep: 0.000312686, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 918). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80002 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09045|1.04768 DOMAIN: combining multiple-domains took 0.287974 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.83205 sec) DOMAIN: domain decomposition done. (took in total 4.31051 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30492 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 16.571 sec =934008 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995002 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.776 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17967 sec PM-PERIODIC: done. (took 13.616 seconds) TIMESTEPS: displacement time constraint: 0.0100131 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17678 sec PM-PERIODIC: done. (took 13.5861 seconds) TIMESTEPS: displacement time constraint: 0.0100131 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 919, Time: 0.37002, Redshift: 1.70256, Systemstep: 0.000312951, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 919). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79757 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09049|1.04768 DOMAIN: combining multiple-domains took 0.287168 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.75551 sec) DOMAIN: domain decomposition done. (took in total 6.23099 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2603 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 16.5701 sec =934103 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995003 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.601 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 920, Time: 0.370333, Redshift: 1.70027, Systemstep: 0.000313216, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 920). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78633 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09054|1.04768 DOMAIN: combining multiple-domains took 0.286731 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11909 sec) DOMAIN: domain decomposition done. (took in total 5.58259 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24435 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 16.5796 sec =934200 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995003 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.44 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 921, Time: 0.370646, Redshift: 1.69799, Systemstep: 0.000313481, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 921). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78801 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09057|1.04768 DOMAIN: combining multiple-domains took 0.285858 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.54132 sec) DOMAIN: domain decomposition done. (took in total 6.00556 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24681 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 16.5637 sec =934284 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995004 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.04 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 253.071 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 922, Time: 0.37096, Redshift: 1.69571, Systemstep: 0.000313747, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 922). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78318 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09061|1.04768 DOMAIN: combining multiple-domains took 0.287538 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1361 sec) DOMAIN: domain decomposition done. (took in total 5.59705 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23588 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 16.5228 sec =934384 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995004 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.04 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.749 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 923, Time: 0.371274, Redshift: 1.69343, Systemstep: 0.000314012, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 923). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79452 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09065|1.04768 DOMAIN: combining multiple-domains took 0.286167 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.28815 sec) DOMAIN: domain decomposition done. (took in total 4.75896 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31391 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 16.6385 sec =934486 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995005 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.987 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 924, Time: 0.371588, Redshift: 1.69115, Systemstep: 0.000314278, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 924). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79113 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09066|1.04768 DOMAIN: combining multiple-domains took 0.285378 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.85529 sec) DOMAIN: domain decomposition done. (took in total 5.32164 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29163 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 16.6365 sec =934581 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995005 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.773 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 925, Time: 0.371903, Redshift: 1.68887, Systemstep: 0.000314544, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 925). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78518 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09068|1.04768 DOMAIN: combining multiple-domains took 0.285877 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.27276 sec) DOMAIN: domain decomposition done. (took in total 4.73308 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30777 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 16.5337 sec =934667 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995006 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.913 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 926, Time: 0.372218, Redshift: 1.6866, Systemstep: 0.00031481, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 926). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84905 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0867|1.04768 DOMAIN: combining multiple-domains took 0.286686 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56214 sec) DOMAIN: domain decomposition done. (took in total 6.08726 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29645 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 16.4641 sec =934771 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995006 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.128 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25342 sec PM-PERIODIC: done. (took 13.7367 seconds) TIMESTEPS: displacement time constraint: 0.00998773 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17595 sec PM-PERIODIC: done. (took 13.5138 seconds) TIMESTEPS: displacement time constraint: 0.00998772 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1071.61 sec, total size 352287 MB, corresponds to effective I/O rate of 328.744 MB/sec Sync-Point 927, Time: 0.372533, Redshift: 1.68433, Systemstep: 0.000315077, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 927). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78916 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08672|1.04768 DOMAIN: combining multiple-domains took 0.286162 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10978 sec) DOMAIN: domain decomposition done. (took in total 4.57443 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29909 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 16.5433 sec =934844 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995007 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.75 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 928, Time: 0.372848, Redshift: 1.68206, Systemstep: 0.000315343, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 928). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79333 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08675|1.04768 DOMAIN: combining multiple-domains took 0.285349 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.4959 sec) DOMAIN: domain decomposition done. (took in total 4.96339 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28827 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 16.4715 sec =934946 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995007 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.749 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 929, Time: 0.373164, Redshift: 1.67979, Systemstep: 0.00031561, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 929). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88675 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08676|1.04768 DOMAIN: combining multiple-domains took 0.285219 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.24743 sec) DOMAIN: domain decomposition done. (took in total 5.80785 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28212 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 16.5016 sec =935052 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995008 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.801 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 930, Time: 0.37348, Redshift: 1.67752, Systemstep: 0.000315878, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 930). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79503 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0868|1.04768 DOMAIN: combining multiple-domains took 0.285387 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.61209 sec) DOMAIN: domain decomposition done. (took in total 5.08217 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24964 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 16.5139 sec =935145 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995008 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.42 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.889 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 931, Time: 0.373796, Redshift: 1.67526, Systemstep: 0.000316145, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 931). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78995 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08682|1.04768 DOMAIN: combining multiple-domains took 0.284539 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37332 sec) DOMAIN: domain decomposition done. (took in total 4.83642 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28662 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.95 MB) GRAVTREE: Tree construction done. took 16.504 sec =935208 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995009 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.42 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.938 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 932, Time: 0.374112, Redshift: 1.67299, Systemstep: 0.000316413, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 932). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78745 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08684|1.04768 DOMAIN: combining multiple-domains took 0.285285 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90704 sec) DOMAIN: domain decomposition done. (took in total 5.36854 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21118 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.95 MB) GRAVTREE: Tree construction done. took 16.5303 sec =935324 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995009 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.43 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.898 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 933, Time: 0.374429, Redshift: 1.67073, Systemstep: 0.00031668, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 933). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79074 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08686|1.04768 DOMAIN: combining multiple-domains took 0.284113 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.30644 sec) DOMAIN: domain decomposition done. (took in total 4.77137 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29651 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.95 MB) GRAVTREE: Tree construction done. took 16.5398 sec =935432 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99501 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.43 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 253.194 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 934, Time: 0.374746, Redshift: 1.66848, Systemstep: 0.000316948, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 934). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79196 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08131|1.01559 DOMAIN: combining multiple-domains took 0.607969 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2604 sec) DOMAIN: domain decomposition done. (took in total 16.0493 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.99322 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.3 MB) GRAVTREE: Tree construction done. took 16.535 sec =935508 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99501 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.52 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 248.511 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28907 sec PM-PERIODIC: done. (took 13.6497 seconds) TIMESTEPS: displacement time constraint: 0.00998676 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27738 sec PM-PERIODIC: done. (took 13.5813 seconds) TIMESTEPS: displacement time constraint: 0.00998675 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 935, Time: 0.375063, Redshift: 1.66622, Systemstep: 0.000317217, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 935). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78024 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08133|1.01559 DOMAIN: combining multiple-domains took 0.284374 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.18078 sec) DOMAIN: domain decomposition done. (took in total 6.63379 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23466 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.3 MB) GRAVTREE: Tree construction done. took 16.566 sec =935593 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995011 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.53 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 249.117 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 936, Time: 0.375381, Redshift: 1.66396, Systemstep: 0.000317485, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 936). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79151 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08136|1.01559 DOMAIN: combining multiple-domains took 0.285412 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.66847 sec) DOMAIN: domain decomposition done. (took in total 5.13459 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2422 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.3 MB) GRAVTREE: Tree construction done. took 16.5566 sec =935697 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995011 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.53 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 248.913 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 937, Time: 0.375698, Redshift: 1.66171, Systemstep: 0.000317754, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 937). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.24878 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08138|1.01559 DOMAIN: combining multiple-domains took 0.312369 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.05364 sec) DOMAIN: domain decomposition done. (took in total 6.30394 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3238 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.31 MB) GRAVTREE: Tree construction done. took 16.5609 sec =935772 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995012 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.54 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 248.796 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 938, Time: 0.376016, Redshift: 1.65946, Systemstep: 0.000318023, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 938). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.9162 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08139|1.01559 DOMAIN: combining multiple-domains took 0.285957 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.53407 sec) DOMAIN: domain decomposition done. (took in total 6.12504 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24304 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.31 MB) GRAVTREE: Tree construction done. took 16.5469 sec =935883 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995012 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.54 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 249.284 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 939, Time: 0.376335, Redshift: 1.65721, Systemstep: 0.000318292, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 939). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84868 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08143|1.01559 DOMAIN: combining multiple-domains took 0.349162 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.55652 sec) DOMAIN: domain decomposition done. (took in total 5.14386 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27051 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.31 MB) GRAVTREE: Tree construction done. took 16.546 sec =935951 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995013 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.54 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 248.984 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 940, Time: 0.376653, Redshift: 1.65496, Systemstep: 0.000318562, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 940). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78673 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08145|1.01559 DOMAIN: combining multiple-domains took 0.286304 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.42193 sec) DOMAIN: domain decomposition done. (took in total 4.88417 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24221 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.31 MB) GRAVTREE: Tree construction done. took 16.568 sec =936043 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995013 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.55 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 248.942 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 941, Time: 0.376972, Redshift: 1.65272, Systemstep: 0.000318831, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 941). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78606 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0815|1.01559 DOMAIN: combining multiple-domains took 0.285034 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34668 sec) DOMAIN: domain decomposition done. (took in total 5.80631 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27514 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.32 MB) GRAVTREE: Tree construction done. took 16.5634 sec =936129 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995014 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.56 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 248.736 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 942, Time: 0.377291, Redshift: 1.65047, Systemstep: 0.000319101, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 942). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78154 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08961|1.01982 DOMAIN: combining multiple-domains took 0.284627 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.989 sec) DOMAIN: domain decomposition done. (took in total 15.4446 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.02289 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.5834 sec =936242 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995014 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.995 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.45064 sec PM-PERIODIC: done. (took 13.4973 seconds) TIMESTEPS: displacement time constraint: 0.00997679 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31936 sec PM-PERIODIC: done. (took 13.3378 seconds) TIMESTEPS: displacement time constraint: 0.00997676 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 943, Time: 0.37761, Redshift: 1.64823, Systemstep: 0.000319371, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 943). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.96078 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08956|1.01982 DOMAIN: combining multiple-domains took 0.285693 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15097 sec) DOMAIN: domain decomposition done. (took in total 5.78821 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21525 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.5918 sec =936336 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995015 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 249.084 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 944, Time: 0.37793, Redshift: 1.64599, Systemstep: 0.000319642, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 944). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79604 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08948|1.01982 DOMAIN: combining multiple-domains took 0.286257 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16188 sec) DOMAIN: domain decomposition done. (took in total 5.63477 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24892 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.5744 sec =936423 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995015 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 249.31 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 945, Time: 0.37825, Redshift: 1.64375, Systemstep: 0.000319912, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 945). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79232 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08944|1.01982 DOMAIN: combining multiple-domains took 0.285663 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18551 sec) DOMAIN: domain decomposition done. (took in total 4.65548 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29719 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.5846 sec =936511 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995016 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 249.499 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 946, Time: 0.37857, Redshift: 1.64152, Systemstep: 0.000320183, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 946). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.936 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09002|1.04768 DOMAIN: combining multiple-domains took 0.286346 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.1954 sec) DOMAIN: domain decomposition done. (took in total 15.8568 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.02835 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 16.5803 sec =936603 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995016 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 252.864 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 947, Time: 0.378891, Redshift: 1.63928, Systemstep: 0.000320454, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 947). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79801 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08726|1.04768 DOMAIN: combining multiple-domains took 0.286967 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93904 sec) DOMAIN: domain decomposition done. (took in total 5.4142 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24841 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 16.5544 sec =936698 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995017 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 253.633 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 948, Time: 0.379211, Redshift: 1.63705, Systemstep: 0.000320725, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 948). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78994 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08727|1.04768 DOMAIN: combining multiple-domains took 0.284548 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.32627 sec) DOMAIN: domain decomposition done. (took in total 4.78959 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28673 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 16.5599 sec =936809 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995017 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.689 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1100.37 sec, total size 352287 MB, corresponds to effective I/O rate of 320.154 MB/sec Sync-Point 949, Time: 0.379532, Redshift: 1.63482, Systemstep: 0.000320997, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 949). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7891 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08731|1.04768 DOMAIN: combining multiple-domains took 0.285092 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15488 sec) DOMAIN: domain decomposition done. (took in total 5.61799 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28931 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 16.5408 sec =936891 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995018 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 252.84 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 950, Time: 0.379854, Redshift: 1.63259, Systemstep: 0.000321268, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 950). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87042 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08736|1.04768 DOMAIN: combining multiple-domains took 0.362503 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37949 sec) DOMAIN: domain decomposition done. (took in total 5.00102 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28516 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 16.5467 sec =937015 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995018 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 252.85 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26082 sec PM-PERIODIC: done. (took 13.2774 seconds) TIMESTEPS: displacement time constraint: 0.00996236 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23232 sec PM-PERIODIC: done. (took 13.4862 seconds) TIMESTEPS: displacement time constraint: 0.00996231 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 951, Time: 0.380175, Redshift: 1.63037, Systemstep: 0.00032154, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 951). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78952 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08782|1.01982 DOMAIN: combining multiple-domains took 0.284938 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3136 sec) DOMAIN: domain decomposition done. (took in total 14.7757 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.08343 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 16.6356 sec =937089 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995019 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 249.687 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 952, Time: 0.380497, Redshift: 1.62814, Systemstep: 0.000321813, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 952). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79594 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08778|1.01982 DOMAIN: combining multiple-domains took 0.287399 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.04771 sec) DOMAIN: domain decomposition done. (took in total 5.52187 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27967 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 16.6196 sec =937190 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995019 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 249.504 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 953, Time: 0.380819, Redshift: 1.62592, Systemstep: 0.000322085, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 953). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7955 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08772|1.01982 DOMAIN: combining multiple-domains took 0.287307 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.51557 sec) DOMAIN: domain decomposition done. (took in total 4.99035 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27114 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 16.6244 sec =937298 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99502 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.58 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 954, Time: 0.381141, Redshift: 1.6237, Systemstep: 0.000322358, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 954). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79747 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08767|1.01982 DOMAIN: combining multiple-domains took 0.285661 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.29809 sec) DOMAIN: domain decomposition done. (took in total 4.77269 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28954 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 16.6225 sec =937367 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99502 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.56 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.283 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 955, Time: 0.381464, Redshift: 1.62148, Systemstep: 0.000322631, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 955). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79524 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08763|1.01982 DOMAIN: combining multiple-domains took 0.285943 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20228 sec) DOMAIN: domain decomposition done. (took in total 5.67423 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19669 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 16.6191 sec =937468 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995021 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.56 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.206 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 956, Time: 0.381787, Redshift: 1.61926, Systemstep: 0.000322904, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 956). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80718 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08874|1.04768 DOMAIN: combining multiple-domains took 0.285167 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.9638 sec) DOMAIN: domain decomposition done. (took in total 14.4473 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40141 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.17 MB) GRAVTREE: Tree construction done. took 16.6507 sec =937532 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995021 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.74 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.426 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 957, Time: 0.38211, Redshift: 1.61705, Systemstep: 0.000323177, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 957). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77943 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08884|1.04768 DOMAIN: combining multiple-domains took 0.285357 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.78271 sec) DOMAIN: domain decomposition done. (took in total 5.23596 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25965 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.18 MB) GRAVTREE: Tree construction done. took 16.6398 sec =937637 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995022 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.75 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.421 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 958, Time: 0.382434, Redshift: 1.61483, Systemstep: 0.000323451, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 958). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85169 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08897|1.04768 DOMAIN: combining multiple-domains took 0.382017 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.13298 sec) DOMAIN: domain decomposition done. (took in total 4.75543 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30004 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 16.6329 sec =937739 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995022 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.546 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21447 sec PM-PERIODIC: done. (took 13.3023 seconds) TIMESTEPS: displacement time constraint: 0.00997226 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20104 sec PM-PERIODIC: done. (took 13.551 seconds) TIMESTEPS: displacement time constraint: 0.00997224 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 959, Time: 0.382757, Redshift: 1.61262, Systemstep: 0.000323724, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 959). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.92689 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08741|1.01982 DOMAIN: combining multiple-domains took 0.2868 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.09 sec) DOMAIN: domain decomposition done. (took in total 15.7098 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.09415 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 16.6064 sec =937829 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995023 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.305 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 960, Time: 0.383081, Redshift: 1.61041, Systemstep: 0.000323998, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 960). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79707 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.0885|1.01982 DOMAIN: combining multiple-domains took 0.285313 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.90394 sec) DOMAIN: domain decomposition done. (took in total 6.37735 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.15329 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 16.5867 sec =937900 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995023 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.383 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 961, Time: 0.383406, Redshift: 1.6082, Systemstep: 0.000324273, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 961). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79681 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08845|1.01982 DOMAIN: combining multiple-domains took 0.286721 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.54707 sec) DOMAIN: domain decomposition done. (took in total 6.02156 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23531 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 16.6182 sec =937997 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995023 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.741 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 962, Time: 0.38373, Redshift: 1.606, Systemstep: 0.000324547, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 962). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80006 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08842|1.01982 DOMAIN: combining multiple-domains took 0.286241 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.52472 sec) DOMAIN: domain decomposition done. (took in total 6.00276 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25071 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 16.6057 sec =938115 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995024 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.343 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 963, Time: 0.384055, Redshift: 1.60379, Systemstep: 0.000324822, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 963). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79787 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08958|1.04768 DOMAIN: combining multiple-domains took 0.28467 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.7576 sec) DOMAIN: domain decomposition done. (took in total 16.2316 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.34801 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.6676 sec =938194 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995024 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.761 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 964, Time: 0.38438, Redshift: 1.60159, Systemstep: 0.000325097, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 964). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7854 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0897|1.04768 DOMAIN: combining multiple-domains took 0.285108 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.32673 sec) DOMAIN: domain decomposition done. (took in total 4.78714 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28366 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.6607 sec =938264 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995025 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.704 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 965, Time: 0.384705, Redshift: 1.59939, Systemstep: 0.000325372, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 965). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78347 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08983|1.04768 DOMAIN: combining multiple-domains took 0.2852 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.57808 sec) DOMAIN: domain decomposition done. (took in total 5.03684 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28201 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 16.6669 sec =938379 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995025 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.738 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 966, Time: 0.385031, Redshift: 1.59719, Systemstep: 0.000325647, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 966). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79356 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08991|1.04768 DOMAIN: combining multiple-domains took 0.285566 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.05857 sec) DOMAIN: domain decomposition done. (took in total 5.52773 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26898 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.31 MB) GRAVTREE: Tree construction done. took 16.674 sec =938460 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995026 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.93 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.9 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.39423 sec PM-PERIODIC: done. (took 13.4586 seconds) TIMESTEPS: displacement time constraint: 0.00996186 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2773 sec PM-PERIODIC: done. (took 13.4291 seconds) TIMESTEPS: displacement time constraint: 0.00996186 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 967, Time: 0.385357, Redshift: 1.595, Systemstep: 0.000325923, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 967). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78583 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09003|1.04768 DOMAIN: combining multiple-domains took 0.285464 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.46271 sec) DOMAIN: domain decomposition done. (took in total 4.93058 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26397 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 16.6702 sec =938536 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995026 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.921 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 968, Time: 0.385683, Redshift: 1.5928, Systemstep: 0.000326199, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 968). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79369 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09018|1.04768 DOMAIN: combining multiple-domains took 0.285137 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12284 sec) DOMAIN: domain decomposition done. (took in total 5.59169 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28446 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 16.6874 sec =938618 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995027 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.973 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 969, Time: 0.38601, Redshift: 1.59061, Systemstep: 0.000326475, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 969). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78232 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09028|1.04768 DOMAIN: combining multiple-domains took 0.286025 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.34647 sec) DOMAIN: domain decomposition done. (took in total 4.80508 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29468 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 16.7716 sec =938728 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995027 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.924 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 970, Time: 0.386336, Redshift: 1.58842, Systemstep: 0.000326751, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 970). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78971 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09041|1.04768 DOMAIN: combining multiple-domains took 0.286691 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.2485 sec) DOMAIN: domain decomposition done. (took in total 4.71884 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30759 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 16.847 sec =938814 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995028 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.029 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1138.78 sec, total size 352287 MB, corresponds to effective I/O rate of 309.355 MB/sec Sync-Point 971, Time: 0.386663, Redshift: 1.58623, Systemstep: 0.000327028, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 971). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79265 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09054|1.04768 DOMAIN: combining multiple-domains took 0.286301 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.63743 sec) DOMAIN: domain decomposition done. (took in total 5.10818 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2778 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 16.6887 sec =938890 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995028 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.066 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 972, Time: 0.386991, Redshift: 1.58404, Systemstep: 0.000327305, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 972). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78655 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08658|1.01559 DOMAIN: combining multiple-domains took 0.287105 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3346 sec) DOMAIN: domain decomposition done. (took in total 14.7988 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.05485 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.92 MB) GRAVTREE: Tree construction done. took 16.6278 sec =938982 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995029 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.39 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 251.7 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 973, Time: 0.387318, Redshift: 1.58186, Systemstep: 0.000327582, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 973). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79085 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08664|1.01559 DOMAIN: combining multiple-domains took 0.285072 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12573 sec) DOMAIN: domain decomposition done. (took in total 4.59143 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2755 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.92 MB) GRAVTREE: Tree construction done. took 16.6088 sec =939038 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995029 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.39 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.811 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 974, Time: 0.387646, Redshift: 1.57967, Systemstep: 0.000327859, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 974). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7889 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08665|1.01559 DOMAIN: combining multiple-domains took 0.351443 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.40352 sec) DOMAIN: domain decomposition done. (took in total 5.93432 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25974 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 16.6104 sec =939115 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995029 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.4 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.709 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20191 sec PM-PERIODIC: done. (took 13.3868 seconds) TIMESTEPS: displacement time constraint: 0.00992588 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26302 sec PM-PERIODIC: done. (took 13.7157 seconds) TIMESTEPS: displacement time constraint: 0.00992588 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 975, Time: 0.387974, Redshift: 1.57749, Systemstep: 0.000328137, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 975). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79974 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08665|1.01559 DOMAIN: combining multiple-domains took 0.284536 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.03572 sec) DOMAIN: domain decomposition done. (took in total 5.50996 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23488 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 16.6205 sec =939191 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99503 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.4 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.72 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 976, Time: 0.388303, Redshift: 1.57531, Systemstep: 0.000328414, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 976). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79986 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08515|1.01418 DOMAIN: combining multiple-domains took 0.285879 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.7501 sec) DOMAIN: domain decomposition done. (took in total 14.2263 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.97619 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.75 MB) GRAVTREE: Tree construction done. took 16.6777 sec =939287 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99503 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.15 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.599 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 977, Time: 0.388631, Redshift: 1.57313, Systemstep: 0.000328692, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 977). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78903 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08519|1.01418 DOMAIN: combining multiple-domains took 0.285516 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39927 sec) DOMAIN: domain decomposition done. (took in total 5.86393 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.214 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.75 MB) GRAVTREE: Tree construction done. took 16.6791 sec =939410 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995031 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.171 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 978, Time: 0.38896, Redshift: 1.57096, Systemstep: 0.000328971, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 978). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79009 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08521|1.01418 DOMAIN: combining multiple-domains took 0.285842 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36541 sec) DOMAIN: domain decomposition done. (took in total 5.8317 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21648 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.76 MB) GRAVTREE: Tree construction done. took 16.6574 sec =939511 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995031 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.288 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 979, Time: 0.38929, Redshift: 1.56878, Systemstep: 0.000329249, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 979). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78781 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0852|1.01418 DOMAIN: combining multiple-domains took 0.285864 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.92695 sec) DOMAIN: domain decomposition done. (took in total 5.39047 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18682 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.76 MB) GRAVTREE: Tree construction done. took 16.6707 sec =939584 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995032 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.541 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 980, Time: 0.389619, Redshift: 1.56661, Systemstep: 0.000329528, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 980). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78942 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08524|1.01418 DOMAIN: combining multiple-domains took 0.286164 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.59321 sec) DOMAIN: domain decomposition done. (took in total 5.05881 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22563 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.76 MB) GRAVTREE: Tree construction done. took 16.6711 sec =939694 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995032 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.17 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.006 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 981, Time: 0.389949, Redshift: 1.56444, Systemstep: 0.000329807, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 981). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79327 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08854|1.01699 DOMAIN: combining multiple-domains took 0.286928 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.8133 sec) DOMAIN: domain decomposition done. (took in total 15.2838 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17604 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 16.7135 sec =939772 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995033 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.936 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 982, Time: 0.390279, Redshift: 1.56227, Systemstep: 0.000330086, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 982). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79235 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08848|1.01699 DOMAIN: combining multiple-domains took 0.286684 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.16802 sec) DOMAIN: domain decomposition done. (took in total 4.63818 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28347 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 16.6634 sec =939861 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995033 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.807 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22669 sec PM-PERIODIC: done. (took 13.9281 seconds) TIMESTEPS: displacement time constraint: 0.00985527 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21416 sec PM-PERIODIC: done. (took 13.9189 seconds) TIMESTEPS: displacement time constraint: 0.00985526 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 983, Time: 0.390609, Redshift: 1.5601, Systemstep: 0.000330365, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 983). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79429 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08844|1.01699 DOMAIN: combining multiple-domains took 0.286582 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.10502 sec) DOMAIN: domain decomposition done. (took in total 5.57689 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27071 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 16.6846 sec =939943 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995034 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.764 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 984, Time: 0.39094, Redshift: 1.55794, Systemstep: 0.000330645, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 984). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79182 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08841|1.01699 DOMAIN: combining multiple-domains took 0.285623 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.88639 sec) DOMAIN: domain decomposition done. (took in total 5.35475 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20764 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 16.6733 sec =940021 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995034 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.682 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 985, Time: 0.391271, Redshift: 1.55577, Systemstep: 0.000330925, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 985). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79073 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08836|1.01699 DOMAIN: combining multiple-domains took 0.286144 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.08917 sec) DOMAIN: domain decomposition done. (took in total 4.5569 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28935 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 16.678 sec =940126 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995035 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.838 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 986, Time: 0.391602, Redshift: 1.55361, Systemstep: 0.000331205, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 986). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79915 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08829|1.01699 DOMAIN: combining multiple-domains took 0.285412 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.06585 sec) DOMAIN: domain decomposition done. (took in total 5.54193 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26612 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 16.6798 sec =940225 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995035 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.66 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.83 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 987, Time: 0.391934, Redshift: 1.55145, Systemstep: 0.000331485, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 987). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79196 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08837|1.01699 DOMAIN: combining multiple-domains took 0.285544 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41512 sec) DOMAIN: domain decomposition done. (took in total 5.88649 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26588 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 16.7562 sec =940316 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995036 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.082 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 988, Time: 0.392265, Redshift: 1.54929, Systemstep: 0.000331766, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 988). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78881 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08848|1.01699 DOMAIN: combining multiple-domains took 0.286049 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35179 sec) DOMAIN: domain decomposition done. (took in total 5.81843 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30093 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 16.7502 sec =940421 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995036 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.166 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 989, Time: 0.392598, Redshift: 1.54714, Systemstep: 0.000332047, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 989). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79527 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08858|1.01699 DOMAIN: combining multiple-domains took 0.285867 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11371 sec) DOMAIN: domain decomposition done. (took in total 5.58584 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30122 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 16.7429 sec =940484 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995037 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.117 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 990, Time: 0.39293, Redshift: 1.54498, Systemstep: 0.000332328, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 990). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79089 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08952|1.01699 DOMAIN: combining multiple-domains took 0.285286 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.76887 sec) DOMAIN: domain decomposition done. (took in total 6.23656 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.48544 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.7222 sec =940575 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995037 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.923 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25219 sec PM-PERIODIC: done. (took 13.7457 seconds) TIMESTEPS: displacement time constraint: 0.00979273 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20312 sec PM-PERIODIC: done. (took 13.6874 seconds) TIMESTEPS: displacement time constraint: 0.00979272 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 991, Time: 0.393262, Redshift: 1.54283, Systemstep: 0.000332609, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 991). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80008 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08956|1.01699 DOMAIN: combining multiple-domains took 0.287348 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.13542 sec) DOMAIN: domain decomposition done. (took in total 5.61482 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25472 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.7218 sec =940662 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995038 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 253.092 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1091.14 sec, total size 352287 MB, corresponds to effective I/O rate of 322.862 MB/sec Sync-Point 992, Time: 0.393595, Redshift: 1.54068, Systemstep: 0.000332891, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 992). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79622 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0896|1.01699 DOMAIN: combining multiple-domains took 0.287156 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.7419 sec) DOMAIN: domain decomposition done. (took in total 5.21802 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29507 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.7505 sec =940735 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995038 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 253.04 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 993, Time: 0.393929, Redshift: 1.53853, Systemstep: 0.000333173, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 993). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79419 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08967|1.01699 DOMAIN: combining multiple-domains took 0.285361 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.94573 sec) DOMAIN: domain decomposition done. (took in total 6.41682 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29809 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.737 sec =940831 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995038 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 253.171 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 994, Time: 0.394262, Redshift: 1.53638, Systemstep: 0.000333455, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 994). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79904 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08969|1.01699 DOMAIN: combining multiple-domains took 0.28552 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.13481 sec) DOMAIN: domain decomposition done. (took in total 4.61088 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28821 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.7449 sec =940923 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995039 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 253.134 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 995, Time: 0.394596, Redshift: 1.53424, Systemstep: 0.000333737, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 995). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79446 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08074|1.01418 DOMAIN: combining multiple-domains took 0.28713 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.7339 sec) DOMAIN: domain decomposition done. (took in total 14.2075 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33934 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.23 MB) GRAVTREE: Tree construction done. took 16.672 sec =941035 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99504 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.43 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 254.568 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 996, Time: 0.39493, Redshift: 1.5321, Systemstep: 0.000334019, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 996). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78773 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08085|1.01418 DOMAIN: combining multiple-domains took 0.28457 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.16231 sec) DOMAIN: domain decomposition done. (took in total 4.62429 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30605 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.24 MB) GRAVTREE: Tree construction done. took 16.6644 sec =941096 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99504 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.382 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 997, Time: 0.395264, Redshift: 1.52995, Systemstep: 0.000334302, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 997). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78555 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08094|1.01418 DOMAIN: combining multiple-domains took 0.283899 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44112 sec) DOMAIN: domain decomposition done. (took in total 5.89824 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26109 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.25 MB) GRAVTREE: Tree construction done. took 16.6682 sec =941176 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99504 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.46 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.52 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 998, Time: 0.395599, Redshift: 1.52781, Systemstep: 0.000334585, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 998). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80743 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08103|1.01418 DOMAIN: combining multiple-domains took 0.405718 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2045 sec) DOMAIN: domain decomposition done. (took in total 5.80664 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25682 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.26 MB) GRAVTREE: Tree construction done. took 16.6898 sec =941270 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995041 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.48 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.596 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22768 sec PM-PERIODIC: done. (took 13.6714 seconds) TIMESTEPS: displacement time constraint: 0.00971707 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22575 sec PM-PERIODIC: done. (took 13.8817 seconds) TIMESTEPS: displacement time constraint: 0.00971705 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 999, Time: 0.395934, Redshift: 1.52568, Systemstep: 0.000334868, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 999). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78647 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08113|1.01418 DOMAIN: combining multiple-domains took 0.284492 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22881 sec) DOMAIN: domain decomposition done. (took in total 5.68795 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25156 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.28 MB) GRAVTREE: Tree construction done. took 16.6866 sec =941340 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995041 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.5 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.733 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1000, Time: 0.396269, Redshift: 1.52354, Systemstep: 0.000335152, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1000). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80965 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08123|1.01418 DOMAIN: combining multiple-domains took 0.28417 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18497 sec) DOMAIN: domain decomposition done. (took in total 5.70625 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27878 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.29 MB) GRAVTREE: Tree construction done. took 16.7028 sec =941462 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995042 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.576 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1001, Time: 0.396604, Redshift: 1.52141, Systemstep: 0.000335435, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1001). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78147 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08133|1.01418 DOMAIN: combining multiple-domains took 0.285592 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09378 sec) DOMAIN: domain decomposition done. (took in total 4.54919 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30097 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.3 MB) GRAVTREE: Tree construction done. took 16.709 sec =941550 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995042 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.53 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.74 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1002, Time: 0.39694, Redshift: 1.51927, Systemstep: 0.000335719, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1002). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78515 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08141|1.01418 DOMAIN: combining multiple-domains took 0.285205 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.43882 sec) DOMAIN: domain decomposition done. (took in total 4.89747 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30371 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.31 MB) GRAVTREE: Tree construction done. took 16.7427 sec =941652 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995043 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.54 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.652 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1003, Time: 0.397276, Redshift: 1.51714, Systemstep: 0.000336004, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1003). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85095 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08152|1.01418 DOMAIN: combining multiple-domains took 0.284928 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.45073 sec) DOMAIN: domain decomposition done. (took in total 4.97554 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30821 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.32 MB) GRAVTREE: Tree construction done. took 16.7126 sec =941731 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995043 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.56 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.756 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1004, Time: 0.397612, Redshift: 1.51501, Systemstep: 0.000336288, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1004). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79061 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0816|1.01418 DOMAIN: combining multiple-domains took 0.283902 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38989 sec) DOMAIN: domain decomposition done. (took in total 5.85676 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27493 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.33 MB) GRAVTREE: Tree construction done. took 16.6762 sec =941829 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995044 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.573 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1005, Time: 0.397949, Redshift: 1.51289, Systemstep: 0.000336573, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1005). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7859 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08169|1.01418 DOMAIN: combining multiple-domains took 0.283984 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.402 sec) DOMAIN: domain decomposition done. (took in total 4.85972 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30128 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.34 MB) GRAVTREE: Tree construction done. took 16.6825 sec =941902 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995044 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.829 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1006, Time: 0.398286, Redshift: 1.51076, Systemstep: 0.000336858, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1006). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78288 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08178|1.01418 DOMAIN: combining multiple-domains took 0.28378 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.45478 sec) DOMAIN: domain decomposition done. (took in total 4.91093 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31143 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.35 MB) GRAVTREE: Tree construction done. took 16.826 sec =941982 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995044 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.138 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.1778 sec PM-PERIODIC: done. (took 13.736 seconds) TIMESTEPS: displacement time constraint: 0.0096709 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.14715 sec PM-PERIODIC: done. (took 13.701 seconds) TIMESTEPS: displacement time constraint: 0.00967091 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1007, Time: 0.398623, Redshift: 1.50864, Systemstep: 0.000337143, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1007). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78819 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08187|1.01418 DOMAIN: combining multiple-domains took 0.28571 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.33966 sec) DOMAIN: domain decomposition done. (took in total 5.80391 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22373 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.36 MB) GRAVTREE: Tree construction done. took 16.8028 sec =942096 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995045 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.62 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 255.034 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1008, Time: 0.39896, Redshift: 1.50652, Systemstep: 0.000337428, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1008). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78393 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08195|1.01418 DOMAIN: combining multiple-domains took 0.28497 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.53771 sec) DOMAIN: domain decomposition done. (took in total 5.99551 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28277 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.37 MB) GRAVTREE: Tree construction done. took 16.7329 sec =942173 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995045 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.63 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.177 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1009, Time: 0.399298, Redshift: 1.5044, Systemstep: 0.000337714, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1009). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78598 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08206|1.01418 DOMAIN: combining multiple-domains took 0.285552 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.00777 sec) DOMAIN: domain decomposition done. (took in total 5.46849 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28284 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.38 MB) GRAVTREE: Tree construction done. took 16.7359 sec =942286 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995046 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.65 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.02 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1010, Time: 0.399636, Redshift: 1.50228, Systemstep: 0.000338, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1010). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78489 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08217|1.01418 DOMAIN: combining multiple-domains took 0.287569 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62993 sec) DOMAIN: domain decomposition done. (took in total 5.09137 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29743 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.4 MB) GRAVTREE: Tree construction done. took 16.732 sec =942357 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995046 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.66 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.316 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1011, Time: 0.399974, Redshift: 1.50016, Systemstep: 0.000338286, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1011). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79404 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08227|1.01418 DOMAIN: combining multiple-domains took 0.285204 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.01947 sec) DOMAIN: domain decomposition done. (took in total 5.48845 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23631 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.41 MB) GRAVTREE: Tree construction done. took 16.7463 sec =942426 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995047 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.68 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.038 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1012, Time: 0.400313, Redshift: 1.49805, Systemstep: 0.000338572, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1012). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78395 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08236|1.01418 DOMAIN: combining multiple-domains took 0.286977 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.88013 sec) DOMAIN: domain decomposition done. (took in total 5.34172 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27908 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.42 MB) GRAVTREE: Tree construction done. took 16.7438 sec =942511 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995047 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.7 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.466 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1013, Time: 0.400652, Redshift: 1.49593, Systemstep: 0.000338859, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1013). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.03485 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08244|1.01418 DOMAIN: combining multiple-domains took 0.287999 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60135 sec) DOMAIN: domain decomposition done. (took in total 6.3133 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22834 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.43 MB) GRAVTREE: Tree construction done. took 16.7492 sec =942600 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995048 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.71 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.314 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1099.91 sec, total size 352287 MB, corresponds to effective I/O rate of 320.287 MB/sec Sync-Point 1014, Time: 0.400991, Redshift: 1.49382, Systemstep: 0.000339146, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1014). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.785 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08254|1.01418 DOMAIN: combining multiple-domains took 0.28498 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.37357 sec) DOMAIN: domain decomposition done. (took in total 5.83205 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21472 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.44 MB) GRAVTREE: Tree construction done. took 16.7222 sec =942695 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995048 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.73 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.515 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29727 sec PM-PERIODIC: done. (took 13.9554 seconds) TIMESTEPS: displacement time constraint: 0.00957325 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27684 sec PM-PERIODIC: done. (took 13.7956 seconds) TIMESTEPS: displacement time constraint: 0.00957325 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1015, Time: 0.40133, Redshift: 1.49171, Systemstep: 0.000339433, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1015). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79296 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08262|1.01418 DOMAIN: combining multiple-domains took 0.286738 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38591 sec) DOMAIN: domain decomposition done. (took in total 5.85422 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22801 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.45 MB) GRAVTREE: Tree construction done. took 16.7584 sec =942770 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995049 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.74 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.239 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1016, Time: 0.40167, Redshift: 1.48961, Systemstep: 0.00033972, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1016). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78995 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08885|1.01418 DOMAIN: combining multiple-domains took 0.28593 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.84587 sec) DOMAIN: domain decomposition done. (took in total 5.31056 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23504 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.18 MB) GRAVTREE: Tree construction done. took 16.6999 sec =942842 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995049 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.75 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.993 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1017, Time: 0.40201, Redshift: 1.4875, Systemstep: 0.000340007, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1017). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79831 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08902|1.04768 DOMAIN: combining multiple-domains took 0.285507 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.6614 sec) DOMAIN: domain decomposition done. (took in total 16.135 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30991 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 16.6568 sec =942938 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99505 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.069 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1018, Time: 0.40235, Redshift: 1.4854, Systemstep: 0.000340295, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1018). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78756 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08906|1.04768 DOMAIN: combining multiple-domains took 0.284459 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.81893 sec) DOMAIN: domain decomposition done. (took in total 5.28008 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29451 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 16.7479 sec =943030 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99505 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 251.815 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1019, Time: 0.402691, Redshift: 1.4833, Systemstep: 0.000340583, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1019). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7892 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0891|1.04768 DOMAIN: combining multiple-domains took 0.287413 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.56876 sec) DOMAIN: domain decomposition done. (took in total 5.03487 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28694 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 16.6356 sec =943127 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995051 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.8 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.441 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1020, Time: 0.403032, Redshift: 1.4812, Systemstep: 0.000340872, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1020). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78999 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08911|1.04768 DOMAIN: combining multiple-domains took 0.28459 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.13391 sec) DOMAIN: domain decomposition done. (took in total 5.59803 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28305 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 16.6746 sec =943195 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995051 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.8 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.097 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1021, Time: 0.403373, Redshift: 1.4791, Systemstep: 0.00034116, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1021). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79217 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08913|1.04768 DOMAIN: combining multiple-domains took 0.284932 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41031 sec) DOMAIN: domain decomposition done. (took in total 5.87666 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27948 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 16.6759 sec =943267 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995051 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.8 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.303 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1022, Time: 0.403714, Redshift: 1.477, Systemstep: 0.000341449, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1022). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78513 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08918|1.04768 DOMAIN: combining multiple-domains took 0.284942 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.66235 sec) DOMAIN: domain decomposition done. (took in total 5.12191 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23012 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 16.6813 sec =943351 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995052 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.81 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.059 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25147 sec PM-PERIODIC: done. (took 13.7987 seconds) TIMESTEPS: displacement time constraint: 0.00945152 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27058 sec PM-PERIODIC: done. (took 13.6179 seconds) TIMESTEPS: displacement time constraint: 0.00945152 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1023, Time: 0.404056, Redshift: 1.4749, Systemstep: 0.000341738, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1023). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78952 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08919|1.04768 DOMAIN: combining multiple-domains took 0.284974 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.39652 sec) DOMAIN: domain decomposition done. (took in total 4.85989 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23432 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 16.6802 sec =943429 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995052 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.81 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.094 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1024, Time: 0.404398, Redshift: 1.47281, Systemstep: 0.000342027, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1024). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78734 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08922|1.04768 DOMAIN: combining multiple-domains took 0.286966 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07836 sec) DOMAIN: domain decomposition done. (took in total 4.54183 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29231 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 16.7377 sec =943526 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995053 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.207 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1025, Time: 0.40474, Redshift: 1.47072, Systemstep: 0.000342317, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1025). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79102 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08926|1.04768 DOMAIN: combining multiple-domains took 0.285616 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06173 sec) DOMAIN: domain decomposition done. (took in total 4.52778 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29965 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 16.6622 sec =943605 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995053 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.14 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1026, Time: 0.405083, Redshift: 1.46863, Systemstep: 0.000342607, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1026). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79072 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08928|1.04768 DOMAIN: combining multiple-domains took 0.286133 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.3982 sec) DOMAIN: domain decomposition done. (took in total 5.86412 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22567 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 16.7201 sec =943702 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995054 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.83 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.43 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1027, Time: 0.405426, Redshift: 1.46654, Systemstep: 0.000342897, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1027). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79505 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0893|1.04768 DOMAIN: combining multiple-domains took 0.285219 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.61169 sec) DOMAIN: domain decomposition done. (took in total 5.08104 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28608 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 16.6867 sec =943772 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995054 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.83 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.103 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1028, Time: 0.405769, Redshift: 1.46446, Systemstep: 0.000343187, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1028). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80305 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08933|1.04768 DOMAIN: combining multiple-domains took 0.285476 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.28316 sec) DOMAIN: domain decomposition done. (took in total 4.76144 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29369 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 16.7439 sec =943866 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995054 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.83 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.265 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1029, Time: 0.406112, Redshift: 1.46237, Systemstep: 0.000343477, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1029). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79379 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08937|1.04768 DOMAIN: combining multiple-domains took 0.284802 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10701 sec) DOMAIN: domain decomposition done. (took in total 4.57533 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29426 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.7952 sec =943966 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995055 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.84 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.445 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1030, Time: 0.406456, Redshift: 1.46029, Systemstep: 0.000343768, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1030). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79322 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08938|1.04768 DOMAIN: combining multiple-domains took 0.288062 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.32912 sec) DOMAIN: domain decomposition done. (took in total 5.80354 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20122 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.6726 sec =944055 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995055 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.84 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.691 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.37131 sec PM-PERIODIC: done. (took 13.6829 seconds) TIMESTEPS: displacement time constraint: 0.00934674 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27634 sec PM-PERIODIC: done. (took 13.5964 seconds) TIMESTEPS: displacement time constraint: 0.00934674 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1031, Time: 0.4068, Redshift: 1.45821, Systemstep: 0.000344059, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1031). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.03045 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08941|1.04768 DOMAIN: combining multiple-domains took 0.286151 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.34771 sec) DOMAIN: domain decomposition done. (took in total 5.10651 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24974 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.6975 sec =944147 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995056 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.302 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1032, Time: 0.407145, Redshift: 1.45613, Systemstep: 0.00034435, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1032). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7921 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08945|1.04768 DOMAIN: combining multiple-domains took 0.285508 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.86886 sec) DOMAIN: domain decomposition done. (took in total 6.33583 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23036 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.6994 sec =944218 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995056 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.226 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1033, Time: 0.407489, Redshift: 1.45405, Systemstep: 0.000344642, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1033). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78507 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08945|1.04768 DOMAIN: combining multiple-domains took 0.286681 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30953 sec) DOMAIN: domain decomposition done. (took in total 5.77089 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27223 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.7034 sec =944275 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995057 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.516 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1034, Time: 0.407834, Redshift: 1.45198, Systemstep: 0.000344934, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1034). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78487 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08948|1.04768 DOMAIN: combining multiple-domains took 0.285502 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.7364 sec) DOMAIN: domain decomposition done. (took in total 5.19686 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23862 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.7171 sec =944364 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995057 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.23 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1035, Time: 0.408179, Redshift: 1.4499, Systemstep: 0.000345226, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1035). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78579 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0895|1.04768 DOMAIN: combining multiple-domains took 0.284898 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8556 sec) DOMAIN: domain decomposition done. (took in total 5.31686 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27377 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.8831 sec =944444 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995057 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.344 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1104.25 sec, total size 352287 MB, corresponds to effective I/O rate of 319.027 MB/sec Sync-Point 1036, Time: 0.408525, Redshift: 1.44783, Systemstep: 0.000345518, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1036). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78678 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08951|1.04768 DOMAIN: combining multiple-domains took 0.285958 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.74374 sec) DOMAIN: domain decomposition done. (took in total 5.20735 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23319 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.7226 sec =944520 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995058 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.347 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1037, Time: 0.408871, Redshift: 1.44576, Systemstep: 0.00034581, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1037). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78676 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08955|1.04768 DOMAIN: combining multiple-domains took 0.285204 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34774 sec) DOMAIN: domain decomposition done. (took in total 5.80953 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29071 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.6941 sec =944627 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995058 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.403 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1038, Time: 0.409217, Redshift: 1.44369, Systemstep: 0.000346103, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1038). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78924 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08957|1.04768 DOMAIN: combining multiple-domains took 0.285745 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98106 sec) DOMAIN: domain decomposition done. (took in total 5.44527 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24101 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.7066 sec =944696 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995059 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.279 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26569 sec PM-PERIODIC: done. (took 13.5868 seconds) TIMESTEPS: displacement time constraint: 0.0092207 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25691 sec PM-PERIODIC: done. (took 13.6996 seconds) TIMESTEPS: displacement time constraint: 0.00922071 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1039, Time: 0.409563, Redshift: 1.44163, Systemstep: 0.000346396, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1039). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78755 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0896|1.04768 DOMAIN: combining multiple-domains took 0.286278 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09399 sec) DOMAIN: domain decomposition done. (took in total 4.55687 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2857 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.7499 sec =944790 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995059 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.397 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1040, Time: 0.40991, Redshift: 1.43956, Systemstep: 0.000346689, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1040). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7943 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08962|1.04768 DOMAIN: combining multiple-domains took 0.284904 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.20237 sec) DOMAIN: domain decomposition done. (took in total 4.67074 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29266 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.697 sec =944878 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99506 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.533 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1041, Time: 0.410257, Redshift: 1.4375, Systemstep: 0.000346983, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1041). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.89289 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08964|1.04768 DOMAIN: combining multiple-domains took 0.289051 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89661 sec) DOMAIN: domain decomposition done. (took in total 5.46764 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25622 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.6985 sec =944943 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99506 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.471 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1042, Time: 0.410604, Redshift: 1.43544, Systemstep: 0.000347276, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1042). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78584 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08968|1.04768 DOMAIN: combining multiple-domains took 0.286412 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47541 sec) DOMAIN: domain decomposition done. (took in total 5.93701 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21201 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.7047 sec =945052 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995061 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 251.344 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1043, Time: 0.410952, Redshift: 1.43338, Systemstep: 0.00034757, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1043). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78516 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08787|1.01418 DOMAIN: combining multiple-domains took 0.286217 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.0378 sec) DOMAIN: domain decomposition done. (took in total 14.4993 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33141 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 16.8503 sec =945145 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995061 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.223 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1044, Time: 0.4113, Redshift: 1.43132, Systemstep: 0.000347865, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1044). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79852 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08782|1.01418 DOMAIN: combining multiple-domains took 0.286857 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.9576 sec) DOMAIN: domain decomposition done. (took in total 4.43414 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28633 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 16.7464 sec =945212 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995061 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.573 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1045, Time: 0.411648, Redshift: 1.42926, Systemstep: 0.000348159, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1045). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79297 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08776|1.01418 DOMAIN: combining multiple-domains took 0.286548 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45496 sec) DOMAIN: domain decomposition done. (took in total 5.92491 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29563 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 16.7611 sec =945311 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995062 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 249.967 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1046, Time: 0.411996, Redshift: 1.42721, Systemstep: 0.000348454, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1046). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80532 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0877|1.01418 DOMAIN: combining multiple-domains took 0.286459 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.74217 sec) DOMAIN: domain decomposition done. (took in total 6.22313 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26111 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 16.7258 sec =945380 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995062 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.455 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34455 sec PM-PERIODIC: done. (took 13.8527 seconds) TIMESTEPS: displacement time constraint: 0.00908601 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31975 sec PM-PERIODIC: done. (took 13.6124 seconds) TIMESTEPS: displacement time constraint: 0.00908602 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1047, Time: 0.412345, Redshift: 1.42515, Systemstep: 0.000348749, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1047). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79663 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08433|1.01418 DOMAIN: combining multiple-domains took 0.287514 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16418 sec) DOMAIN: domain decomposition done. (took in total 5.64141 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28276 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.65 MB) GRAVTREE: Tree construction done. took 16.7637 sec =945433 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995063 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.02 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.993 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1048, Time: 0.412694, Redshift: 1.4231, Systemstep: 0.000349044, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1048). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78564 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08434|1.01418 DOMAIN: combining multiple-domains took 0.288509 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05825 sec) DOMAIN: domain decomposition done. (took in total 4.52181 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27783 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.65 MB) GRAVTREE: Tree construction done. took 16.8479 sec =945541 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995063 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.02 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.02 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1049, Time: 0.413043, Redshift: 1.42105, Systemstep: 0.000349339, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1049). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78585 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08435|1.01418 DOMAIN: combining multiple-domains took 0.28625 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22118 sec) DOMAIN: domain decomposition done. (took in total 4.68306 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28242 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.65 MB) GRAVTREE: Tree construction done. took 16.7335 sec =945632 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995064 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.02 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.997 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1050, Time: 0.413393, Redshift: 1.41901, Systemstep: 0.000349635, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1050). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78777 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08439|1.01418 DOMAIN: combining multiple-domains took 0.28667 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60897 sec) DOMAIN: domain decomposition done. (took in total 6.07282 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2234 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.66 MB) GRAVTREE: Tree construction done. took 16.7964 sec =945704 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995064 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.938 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1051, Time: 0.413743, Redshift: 1.41696, Systemstep: 0.000349931, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1051). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78884 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0844|1.01418 DOMAIN: combining multiple-domains took 0.284618 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09909 sec) DOMAIN: domain decomposition done. (took in total 4.56277 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27519 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.66 MB) GRAVTREE: Tree construction done. took 16.7573 sec =945795 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995064 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.193 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1052, Time: 0.414093, Redshift: 1.41492, Systemstep: 0.000350227, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1052). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78657 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08443|1.01418 DOMAIN: combining multiple-domains took 0.284879 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.58713 sec) DOMAIN: domain decomposition done. (took in total 5.04768 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26901 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.66 MB) GRAVTREE: Tree construction done. took 16.8586 sec =945894 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995065 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.081 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1053, Time: 0.414444, Redshift: 1.41287, Systemstep: 0.000350524, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1053). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7932 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08447|1.01418 DOMAIN: combining multiple-domains took 0.283874 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.98875 sec) DOMAIN: domain decomposition done. (took in total 4.45576 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28053 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.67 MB) GRAVTREE: Tree construction done. took 16.7921 sec =945999 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995066 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.097 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1054, Time: 0.414795, Redshift: 1.41083, Systemstep: 0.00035082, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1054). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78843 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08448|1.01418 DOMAIN: combining multiple-domains took 0.285361 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62308 sec) DOMAIN: domain decomposition done. (took in total 5.08609 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28291 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.67 MB) GRAVTREE: Tree construction done. took 16.7712 sec =946069 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995066 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.199 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34437 sec PM-PERIODIC: done. (took 13.672 seconds) TIMESTEPS: displacement time constraint: 0.00894931 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31384 sec PM-PERIODIC: done. (took 13.5441 seconds) TIMESTEPS: displacement time constraint: 0.00894933 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1055, Time: 0.415146, Redshift: 1.40879, Systemstep: 0.000351117, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1055). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78897 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08448|1.01418 DOMAIN: combining multiple-domains took 0.409764 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89696 sec) DOMAIN: domain decomposition done. (took in total 5.48627 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22143 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.67 MB) GRAVTREE: Tree construction done. took 16.799 sec =946136 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995066 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.594 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1056, Time: 0.415497, Redshift: 1.40676, Systemstep: 0.000351415, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1056). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79585 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08449|1.01418 DOMAIN: combining multiple-domains took 0.284592 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95921 sec) DOMAIN: domain decomposition done. (took in total 5.4288 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23574 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.67 MB) GRAVTREE: Tree construction done. took 16.7718 sec =946211 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995067 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.022 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1057, Time: 0.415849, Redshift: 1.40472, Systemstep: 0.000351712, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1057). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78344 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08452|1.01418 DOMAIN: combining multiple-domains took 0.285792 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.33651 sec) DOMAIN: domain decomposition done. (took in total 4.7948 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24166 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.7803 sec =946288 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995067 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.42 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1043.01 sec, total size 352287 MB, corresponds to effective I/O rate of 337.761 MB/sec Sync-Point 1058, Time: 0.416201, Redshift: 1.40269, Systemstep: 0.00035201, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1058). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82444 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08456|1.01418 DOMAIN: combining multiple-domains took 0.410979 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.25512 sec) DOMAIN: domain decomposition done. (took in total 4.87999 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27637 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.7797 sec =946367 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995067 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.086 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1059, Time: 0.416553, Redshift: 1.40065, Systemstep: 0.000352308, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1059). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78672 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08461|1.01418 DOMAIN: combining multiple-domains took 0.285691 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42523 sec) DOMAIN: domain decomposition done. (took in total 5.88809 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23998 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7786 sec =946411 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995068 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.164 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1060, Time: 0.416906, Redshift: 1.39862, Systemstep: 0.000352606, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1060). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78624 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0846|1.01418 DOMAIN: combining multiple-domains took 0.286738 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.61637 sec) DOMAIN: domain decomposition done. (took in total 6.07933 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24892 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.7828 sec =946511 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995068 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.258 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1061, Time: 0.417259, Redshift: 1.3966, Systemstep: 0.000352904, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1061). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79407 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08463|1.01418 DOMAIN: combining multiple-domains took 0.286229 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.35355 sec) DOMAIN: domain decomposition done. (took in total 4.82323 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.236 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7771 sec =946590 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995069 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.19 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1062, Time: 0.417612, Redshift: 1.39457, Systemstep: 0.000353203, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1062). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78801 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08465|1.01418 DOMAIN: combining multiple-domains took 0.288035 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30169 sec) DOMAIN: domain decomposition done. (took in total 5.76709 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2137 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.8237 sec =946658 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995069 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.371 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.39411 sec PM-PERIODIC: done. (took 13.7545 seconds) TIMESTEPS: displacement time constraint: 0.00884626 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24001 sec PM-PERIODIC: done. (took 13.5928 seconds) TIMESTEPS: displacement time constraint: 0.00884628 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1063, Time: 0.417965, Redshift: 1.39254, Systemstep: 0.000353502, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1063). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79451 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08452|1.01699 DOMAIN: combining multiple-domains took 0.285747 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.1981 sec) DOMAIN: domain decomposition done. (took in total 15.6844 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.12806 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.67 MB) GRAVTREE: Tree construction done. took 16.7575 sec =946759 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995069 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.365 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1064, Time: 0.418319, Redshift: 1.39052, Systemstep: 0.000353801, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1064). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78774 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08455|1.01699 DOMAIN: combining multiple-domains took 0.284144 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.09514 sec) DOMAIN: domain decomposition done. (took in total 5.55738 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29019 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.775 sec =946828 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99507 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.713 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1065, Time: 0.418673, Redshift: 1.3885, Systemstep: 0.000354101, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1065). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7901 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08457|1.01699 DOMAIN: combining multiple-domains took 0.284951 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39204 sec) DOMAIN: domain decomposition done. (took in total 5.85723 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21161 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.7646 sec =946921 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99507 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.314 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1066, Time: 0.419028, Redshift: 1.38648, Systemstep: 0.000354401, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1066). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78862 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08459|1.01699 DOMAIN: combining multiple-domains took 0.285488 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19422 sec) DOMAIN: domain decomposition done. (took in total 5.65782 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22414 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.7578 sec =947020 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995071 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.952 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1067, Time: 0.419382, Redshift: 1.38446, Systemstep: 0.000354701, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1067). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.96283 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0846|1.01699 DOMAIN: combining multiple-domains took 0.286006 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98401 sec) DOMAIN: domain decomposition done. (took in total 5.62374 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28492 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.7719 sec =947107 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995071 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.982 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1068, Time: 0.419737, Redshift: 1.38244, Systemstep: 0.000355001, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1068). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84346 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08464|1.01699 DOMAIN: combining multiple-domains took 0.286702 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1351 sec) DOMAIN: domain decomposition done. (took in total 5.65528 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2672 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7691 sec =947164 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995072 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.116 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1069, Time: 0.420093, Redshift: 1.38043, Systemstep: 0.000355301, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1069). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85006 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08465|1.01699 DOMAIN: combining multiple-domains took 0.288453 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.32649 sec) DOMAIN: domain decomposition done. (took in total 5.85824 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29861 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7753 sec =947244 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995072 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.942 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1070, Time: 0.420448, Redshift: 1.37841, Systemstep: 0.000355602, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1070). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78976 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08467|1.01699 DOMAIN: combining multiple-domains took 0.286613 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.49446 sec) DOMAIN: domain decomposition done. (took in total 4.96307 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2815 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7557 sec =947315 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995072 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.872 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20592 sec PM-PERIODIC: done. (took 13.429 seconds) TIMESTEPS: displacement time constraint: 0.00870998 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.16835 sec PM-PERIODIC: done. (took 13.3823 seconds) TIMESTEPS: displacement time constraint: 0.00870999 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1071, Time: 0.420804, Redshift: 1.3764, Systemstep: 0.000355903, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1071). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79053 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08467|1.01699 DOMAIN: combining multiple-domains took 0.285131 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.23364 sec) DOMAIN: domain decomposition done. (took in total 4.70055 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29226 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7533 sec =947388 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995073 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 251.178 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1072, Time: 0.42116, Redshift: 1.37439, Systemstep: 0.000356204, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1072). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.94714 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08468|1.01699 DOMAIN: combining multiple-domains took 0.284151 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.47005 sec) DOMAIN: domain decomposition done. (took in total 7.09255 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26661 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.7581 sec =947480 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995073 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.927 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1073, Time: 0.421517, Redshift: 1.37238, Systemstep: 0.000356506, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1073). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79154 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0847|1.01699 DOMAIN: combining multiple-domains took 0.285997 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12921 sec) DOMAIN: domain decomposition done. (took in total 4.59978 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29008 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 16.7652 sec =947584 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995074 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.08 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 250.969 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1074, Time: 0.421874, Redshift: 1.37038, Systemstep: 0.000356808, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1074). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79148 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08554|1.01699 DOMAIN: combining multiple-domains took 0.286182 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.55304 sec) DOMAIN: domain decomposition done. (took in total 6.02167 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40736 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.7821 sec =947642 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995074 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.21 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.307 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1075, Time: 0.422231, Redshift: 1.36837, Systemstep: 0.00035711, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1075). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79154 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08558|1.01699 DOMAIN: combining multiple-domains took 0.286046 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43826 sec) DOMAIN: domain decomposition done. (took in total 5.90672 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22501 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.7814 sec =947721 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995075 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.202 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1076, Time: 0.422588, Redshift: 1.36637, Systemstep: 0.000357412, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1076). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79516 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08559|1.01699 DOMAIN: combining multiple-domains took 0.286815 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26622 sec) DOMAIN: domain decomposition done. (took in total 4.73896 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27439 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.7879 sec =947803 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995075 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.327 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1077, Time: 0.422946, Redshift: 1.36437, Systemstep: 0.000357715, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1077). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78706 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08561|1.01699 DOMAIN: combining multiple-domains took 0.286208 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.07359 sec) DOMAIN: domain decomposition done. (took in total 5.53752 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26055 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.7776 sec =947915 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995076 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.444 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1078, Time: 0.423304, Redshift: 1.36237, Systemstep: 0.000358017, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1078). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7894 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08561|1.01699 DOMAIN: combining multiple-domains took 0.285175 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29497 sec) DOMAIN: domain decomposition done. (took in total 5.76169 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26321 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.8365 sec =947976 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995076 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.329 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2117 sec PM-PERIODIC: done. (took 13.3328 seconds) TIMESTEPS: displacement time constraint: 0.00859712 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.207 sec PM-PERIODIC: done. (took 13.2937 seconds) TIMESTEPS: displacement time constraint: 0.00859711 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1079, Time: 0.423662, Redshift: 1.36037, Systemstep: 0.00035832, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1079). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79067 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08564|1.01699 DOMAIN: combining multiple-domains took 0.284961 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.43544 sec) DOMAIN: domain decomposition done. (took in total 4.90168 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28004 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.7952 sec =948026 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995076 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.49 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1082.05 sec, total size 352287 MB, corresponds to effective I/O rate of 325.575 MB/sec Sync-Point 1080, Time: 0.424021, Redshift: 1.35837, Systemstep: 0.000358624, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1080). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79081 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08567|1.01699 DOMAIN: combining multiple-domains took 0.286251 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62421 sec) DOMAIN: domain decomposition done. (took in total 5.0928 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24143 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.7831 sec =948123 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995077 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.54 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1081, Time: 0.42438, Redshift: 1.35638, Systemstep: 0.000358927, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1081). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79362 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08568|1.01699 DOMAIN: combining multiple-domains took 0.285744 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.37665 sec) DOMAIN: domain decomposition done. (took in total 5.84678 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26688 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.8044 sec =948209 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995077 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.398 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1082, Time: 0.424739, Redshift: 1.35439, Systemstep: 0.000359231, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1082). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79483 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08568|1.01699 DOMAIN: combining multiple-domains took 0.28488 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.60843 sec) DOMAIN: domain decomposition done. (took in total 5.07917 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27682 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.7973 sec =948293 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995077 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.6 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1083, Time: 0.425099, Redshift: 1.3524, Systemstep: 0.000359535, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1083). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.02239 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08572|1.01699 DOMAIN: combining multiple-domains took 0.286466 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.08132 sec) DOMAIN: domain decomposition done. (took in total 5.79354 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24325 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 16.8213 sec =948394 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995078 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.668 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1084, Time: 0.425458, Redshift: 1.35041, Systemstep: 0.00035984, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1084). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78689 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08575|1.01699 DOMAIN: combining multiple-domains took 0.287742 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21205 sec) DOMAIN: domain decomposition done. (took in total 4.67726 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25038 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 16.8207 sec =948469 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995078 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.613 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1085, Time: 0.425819, Redshift: 1.34842, Systemstep: 0.000360144, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1085). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79061 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08576|1.01418 DOMAIN: combining multiple-domains took 0.285484 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.072 sec) DOMAIN: domain decomposition done. (took in total 15.5385 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.03875 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 16.7604 sec =948586 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995079 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.382 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1086, Time: 0.426179, Redshift: 1.34643, Systemstep: 0.000360449, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1086). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78479 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08574|1.01418 DOMAIN: combining multiple-domains took 0.286326 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.82973 sec) DOMAIN: domain decomposition done. (took in total 6.29073 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20953 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 16.855 sec =948646 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995079 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.615 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21861 sec PM-PERIODIC: done. (took 13.4258 seconds) TIMESTEPS: displacement time constraint: 0.00853133 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22182 sec PM-PERIODIC: done. (took 13.3685 seconds) TIMESTEPS: displacement time constraint: 0.00853134 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1087, Time: 0.42654, Redshift: 1.34445, Systemstep: 0.000360754, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1087). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7953 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08569|1.01418 DOMAIN: combining multiple-domains took 0.284783 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.20143 sec) DOMAIN: domain decomposition done. (took in total 4.6708 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29371 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.7522 sec =948737 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99508 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.497 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1088, Time: 0.426901, Redshift: 1.34246, Systemstep: 0.000361059, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1088). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78834 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08562|1.01418 DOMAIN: combining multiple-domains took 0.285283 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.1239 sec) DOMAIN: domain decomposition done. (took in total 4.58745 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29469 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.7639 sec =948799 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99508 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.385 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1089, Time: 0.427262, Redshift: 1.34048, Systemstep: 0.000361365, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1089). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87492 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08558|1.01418 DOMAIN: combining multiple-domains took 0.382225 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.73776 sec) DOMAIN: domain decomposition done. (took in total 6.38438 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2334 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.7598 sec =948847 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99508 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.51 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1090, Time: 0.427624, Redshift: 1.3385, Systemstep: 0.000361671, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1090). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79097 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08553|1.01418 DOMAIN: combining multiple-domains took 0.2867 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.17856 sec) DOMAIN: domain decomposition done. (took in total 4.64635 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29327 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.79 MB) GRAVTREE: Tree construction done. took 16.7452 sec =948924 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995081 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.21 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.059 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1091, Time: 0.427986, Redshift: 1.33653, Systemstep: 0.000361977, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1091). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7904 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08547|1.01418 DOMAIN: combining multiple-domains took 0.285572 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.62834 sec) DOMAIN: domain decomposition done. (took in total 6.09393 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20739 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.79 MB) GRAVTREE: Tree construction done. took 16.7622 sec =949016 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995081 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.2 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.039 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1092, Time: 0.428348, Redshift: 1.33455, Systemstep: 0.000362284, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1092). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79817 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08542|1.01418 DOMAIN: combining multiple-domains took 0.285557 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36138 sec) DOMAIN: domain decomposition done. (took in total 5.83749 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26193 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.78 MB) GRAVTREE: Tree construction done. took 16.8175 sec =949074 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995082 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.2 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.785 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1093, Time: 0.428711, Redshift: 1.33258, Systemstep: 0.00036259, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1093). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78951 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08599|1.01699 DOMAIN: combining multiple-domains took 0.287199 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7394 sec) DOMAIN: domain decomposition done. (took in total 15.2066 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.36893 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 16.8971 sec =949180 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995082 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.723 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1094, Time: 0.429074, Redshift: 1.3306, Systemstep: 0.000362897, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1094). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79857 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08604|1.01699 DOMAIN: combining multiple-domains took 0.285867 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.31643 sec) DOMAIN: domain decomposition done. (took in total 4.79148 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29342 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 16.8204 sec =949253 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995082 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.3 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.748 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25532 sec PM-PERIODIC: done. (took 13.8111 seconds) TIMESTEPS: displacement time constraint: 0.00843444 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23674 sec PM-PERIODIC: done. (took 13.5673 seconds) TIMESTEPS: displacement time constraint: 0.00843445 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1095, Time: 0.429437, Redshift: 1.32863, Systemstep: 0.000363204, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1095). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.00015 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08523|1.01699 DOMAIN: combining multiple-domains took 0.285311 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.87813 sec) DOMAIN: domain decomposition done. (took in total 6.58209 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26151 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.76 MB) GRAVTREE: Tree construction done. took 16.8533 sec =949336 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995083 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.827 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1096, Time: 0.4298, Redshift: 1.32666, Systemstep: 0.000363512, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1096). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80291 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08407|1.01699 DOMAIN: combining multiple-domains took 0.28554 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.47766 sec) DOMAIN: domain decomposition done. (took in total 6.95688 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25388 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.8321 sec =949417 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995083 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 251.253 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1097, Time: 0.430164, Redshift: 1.32469, Systemstep: 0.000363819, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1097). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84057 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0841|1.01699 DOMAIN: combining multiple-domains took 0.410017 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71361 sec) DOMAIN: domain decomposition done. (took in total 6.35396 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28065 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.63 MB) GRAVTREE: Tree construction done. took 16.8317 sec =949493 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995084 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.876 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1098, Time: 0.430528, Redshift: 1.32273, Systemstep: 0.000364127, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1098). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79393 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08413|1.01699 DOMAIN: combining multiple-domains took 0.293034 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73894 sec) DOMAIN: domain decomposition done. (took in total 5.21632 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29194 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.63 MB) GRAVTREE: Tree construction done. took 16.8349 sec =949604 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995084 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 252.019 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1099, Time: 0.430893, Redshift: 1.32076, Systemstep: 0.000364436, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1099). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78774 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09247|1.01418 DOMAIN: combining multiple-domains took 0.284628 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.2617 sec) DOMAIN: domain decomposition done. (took in total 14.7242 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.06967 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.61 MB) GRAVTREE: Tree construction done. took 16.9276 sec =949675 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995085 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.934 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1100, Time: 0.431257, Redshift: 1.3188, Systemstep: 0.000364744, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1100). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79511 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09155|1.04768 DOMAIN: combining multiple-domains took 0.286677 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.4113 sec) DOMAIN: domain decomposition done. (took in total 15.8847 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.42435 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 16.8866 sec =949732 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995085 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.2 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.72 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1101, Time: 0.431622, Redshift: 1.31684, Systemstep: 0.000365053, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1101). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79944 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09158|1.04768 DOMAIN: combining multiple-domains took 0.286343 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.62142 sec) DOMAIN: domain decomposition done. (took in total 6.0978 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31365 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 16.8374 sec =949807 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995085 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.2 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.524 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1170.57 sec, total size 352287 MB, corresponds to effective I/O rate of 300.954 MB/sec Sync-Point 1102, Time: 0.431988, Redshift: 1.31488, Systemstep: 0.000365362, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1102). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79364 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09163|1.04768 DOMAIN: combining multiple-domains took 0.28686 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09917 sec) DOMAIN: domain decomposition done. (took in total 4.57095 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28895 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 16.7984 sec =949876 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995086 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.21 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.518 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.38804 sec PM-PERIODIC: done. (took 13.5578 seconds) TIMESTEPS: displacement time constraint: 0.00835185 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.64578 sec PM-PERIODIC: done. (took 13.8244 seconds) TIMESTEPS: displacement time constraint: 0.00835186 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1103, Time: 0.432353, Redshift: 1.31292, Systemstep: 0.000365671, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1103). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79177 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09065|1.01699 DOMAIN: combining multiple-domains took 0.287778 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5809 sec) DOMAIN: domain decomposition done. (took in total 15.0506 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.09919 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 16.858 sec =949971 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995086 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.188 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1104, Time: 0.432719, Redshift: 1.31097, Systemstep: 0.000365981, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1104). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79278 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09069|1.01699 DOMAIN: combining multiple-domains took 0.285783 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30398 sec) DOMAIN: domain decomposition done. (took in total 5.77369 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28179 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 16.8612 sec =950079 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995087 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.49 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1105, Time: 0.433086, Redshift: 1.30901, Systemstep: 0.000366291, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1105). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87906 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08405|1.01699 DOMAIN: combining multiple-domains took 0.339094 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.64573 sec) DOMAIN: domain decomposition done. (took in total 6.25517 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25311 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.8009 sec =950143 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995087 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.97 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 255.007 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1106, Time: 0.433452, Redshift: 1.30706, Systemstep: 0.000366601, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1106). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7928 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08406|1.01699 DOMAIN: combining multiple-domains took 0.287895 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.34325 sec) DOMAIN: domain decomposition done. (took in total 4.8135 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2718 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.8082 sec =950184 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995087 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.97 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 254.721 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1107, Time: 0.433819, Redshift: 1.30511, Systemstep: 0.000366911, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1107). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79727 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08409|1.01699 DOMAIN: combining multiple-domains took 0.289946 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.37443 sec) DOMAIN: domain decomposition done. (took in total 5.8615 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25522 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.793 sec =950229 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995088 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 254.572 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1108, Time: 0.434186, Redshift: 1.30316, Systemstep: 0.000367221, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1108). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79031 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08343|1.04768 DOMAIN: combining multiple-domains took 0.286386 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3565 sec) DOMAIN: domain decomposition done. (took in total 14.823 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.04477 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.55 MB) GRAVTREE: Tree construction done. took 16.7728 sec =950317 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995088 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.87 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.856 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1109, Time: 0.434554, Redshift: 1.30121, Systemstep: 0.000367532, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1109). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78157 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08056|1.04768 DOMAIN: combining multiple-domains took 0.283592 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98689 sec) DOMAIN: domain decomposition done. (took in total 5.44082 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.42631 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.21 MB) GRAVTREE: Tree construction done. took 16.7135 sec =950393 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995088 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.4 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.292 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1110, Time: 0.434922, Redshift: 1.29926, Systemstep: 0.000367843, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1110). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77811 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08053|1.04768 DOMAIN: combining multiple-domains took 0.283998 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.0824 sec) DOMAIN: domain decomposition done. (took in total 5.53242 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25808 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.21 MB) GRAVTREE: Tree construction done. took 16.8585 sec =950465 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995089 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.4 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.079 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35915 sec PM-PERIODIC: done. (took 13.378 seconds) TIMESTEPS: displacement time constraint: 0.0083159 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36316 sec PM-PERIODIC: done. (took 13.3868 seconds) TIMESTEPS: displacement time constraint: 0.00831591 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1111, Time: 0.43529, Redshift: 1.29732, Systemstep: 0.000368155, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1111). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77794 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0805|1.04768 DOMAIN: combining multiple-domains took 0.284138 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.85662 sec) DOMAIN: domain decomposition done. (took in total 4.30701 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2565 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.2 MB) GRAVTREE: Tree construction done. took 16.7148 sec =950541 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995089 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.39 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.676 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1112, Time: 0.435658, Redshift: 1.29538, Systemstep: 0.000368466, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1112). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78946 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08045|1.04768 DOMAIN: combining multiple-domains took 0.285428 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.0902 sec) DOMAIN: domain decomposition done. (took in total 4.56152 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25094 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.2 MB) GRAVTREE: Tree construction done. took 16.796 sec =950648 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99509 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.38 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.925 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1113, Time: 0.436027, Redshift: 1.29343, Systemstep: 0.000368778, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1113). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77812 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0804|1.04768 DOMAIN: combining multiple-domains took 0.28504 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.0844 sec) DOMAIN: domain decomposition done. (took in total 4.5358 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2642 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.19 MB) GRAVTREE: Tree construction done. took 16.7689 sec =950704 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99509 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.524 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1114, Time: 0.436396, Redshift: 1.29149, Systemstep: 0.000369091, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1114). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78186 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08037|1.04768 DOMAIN: combining multiple-domains took 0.284883 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.65683 sec) DOMAIN: domain decomposition done. (took in total 6.11172 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21197 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.19 MB) GRAVTREE: Tree construction done. took 16.7184 sec =950777 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99509 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.37 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.867 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1115, Time: 0.436766, Redshift: 1.28956, Systemstep: 0.000369403, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1115). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77919 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08032|1.04768 DOMAIN: combining multiple-domains took 0.285587 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.96543 sec) DOMAIN: domain decomposition done. (took in total 4.41821 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25062 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.18 MB) GRAVTREE: Tree construction done. took 16.7111 sec =950864 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995091 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.119 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1116, Time: 0.437135, Redshift: 1.28762, Systemstep: 0.000369716, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1116). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.00865 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08029|1.04768 DOMAIN: combining multiple-domains took 0.284422 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.6589 sec) DOMAIN: domain decomposition done. (took in total 5.38681 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24794 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.18 MB) GRAVTREE: Tree construction done. took 16.7047 sec =950929 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995091 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 250.938 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1117, Time: 0.437505, Redshift: 1.28569, Systemstep: 0.000370029, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1117). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78358 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08024|1.04768 DOMAIN: combining multiple-domains took 0.28417 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.91419 sec) DOMAIN: domain decomposition done. (took in total 6.37002 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24282 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.17 MB) GRAVTREE: Tree construction done. took 16.705 sec =951031 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995092 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.076 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1118, Time: 0.437876, Redshift: 1.28375, Systemstep: 0.000370342, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1118). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78428 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08018|1.04768 DOMAIN: combining multiple-domains took 0.283002 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.01316 sec) DOMAIN: domain decomposition done. (took in total 5.46869 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22808 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.16 MB) GRAVTREE: Tree construction done. took 16.7078 sec =951103 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995092 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.123 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31075 sec PM-PERIODIC: done. (took 13.5246 seconds) TIMESTEPS: displacement time constraint: 0.0082843 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.368 sec PM-PERIODIC: done. (took 13.7768 seconds) TIMESTEPS: displacement time constraint: 0.0082843 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1119, Time: 0.438246, Redshift: 1.28182, Systemstep: 0.000370655, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1119). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78422 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08014|1.04768 DOMAIN: combining multiple-domains took 0.282894 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12032 sec) DOMAIN: domain decomposition done. (took in total 4.57617 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24924 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.16 MB) GRAVTREE: Tree construction done. took 16.7076 sec =951185 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995092 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.33 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.651 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1120, Time: 0.438617, Redshift: 1.27989, Systemstep: 0.000370969, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1120). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78287 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08007|1.04768 DOMAIN: combining multiple-domains took 0.284311 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26324 sec) DOMAIN: domain decomposition done. (took in total 4.71818 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25747 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.15 MB) GRAVTREE: Tree construction done. took 16.7139 sec =951252 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995093 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.32 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.755 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1121, Time: 0.438989, Redshift: 1.27796, Systemstep: 0.000371283, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1121). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.08999 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08003|1.04768 DOMAIN: combining multiple-domains took 0.284313 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12649 sec) DOMAIN: domain decomposition done. (took in total 4.90613 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24886 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.15 MB) GRAVTREE: Tree construction done. took 16.7197 sec =951336 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995093 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.32 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.738 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1122, Time: 0.43936, Redshift: 1.27604, Systemstep: 0.000371597, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1122). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78287 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08|1.04768 DOMAIN: combining multiple-domains took 0.284527 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.73042 sec) DOMAIN: domain decomposition done. (took in total 6.18562 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25493 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.14 MB) GRAVTREE: Tree construction done. took 16.7327 sec =951423 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995094 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.31 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.279 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1127.57 sec, total size 352287 MB, corresponds to effective I/O rate of 312.431 MB/sec Sync-Point 1123, Time: 0.439732, Redshift: 1.27411, Systemstep: 0.000371912, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1123). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78438 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07996|1.04768 DOMAIN: combining multiple-domains took 0.285518 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.58504 sec) DOMAIN: domain decomposition done. (took in total 6.04322 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25204 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.14 MB) GRAVTREE: Tree construction done. took 16.7206 sec =951500 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995094 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.455 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1124, Time: 0.440104, Redshift: 1.27219, Systemstep: 0.000372227, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1124). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7851 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07991|1.04768 DOMAIN: combining multiple-domains took 0.287541 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06687 sec) DOMAIN: domain decomposition done. (took in total 4.52758 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2606 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.13 MB) GRAVTREE: Tree construction done. took 16.7244 sec =951597 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995095 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.179 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1125, Time: 0.440477, Redshift: 1.27027, Systemstep: 0.000372542, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1125). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7799 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07831|1.04768 DOMAIN: combining multiple-domains took 0.286543 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.87968 sec) DOMAIN: domain decomposition done. (took in total 6.33453 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26894 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.94 MB) GRAVTREE: Tree construction done. took 16.7795 sec =951675 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995095 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 249.401 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1126, Time: 0.44085, Redshift: 1.26835, Systemstep: 0.000372857, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1126). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78089 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07832|1.04768 DOMAIN: combining multiple-domains took 0.282474 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.64806 sec) DOMAIN: domain decomposition done. (took in total 5.09886 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26245 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.95 MB) GRAVTREE: Tree construction done. took 16.7183 sec =951725 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995095 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 249.585 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.39433 sec PM-PERIODIC: done. (took 13.944 seconds) TIMESTEPS: displacement time constraint: 0.00826594 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.38877 sec PM-PERIODIC: done. (took 13.5755 seconds) TIMESTEPS: displacement time constraint: 0.00826596 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1127, Time: 0.441223, Redshift: 1.26643, Systemstep: 0.000373173, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1127). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7741 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07834|1.04768 DOMAIN: combining multiple-domains took 0.284228 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.05287 sec) DOMAIN: domain decomposition done. (took in total 6.49839 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23269 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.95 MB) GRAVTREE: Tree construction done. took 16.7592 sec =951809 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995096 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.277 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1128, Time: 0.441597, Redshift: 1.26451, Systemstep: 0.000373489, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1128). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78175 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07837|1.04768 DOMAIN: combining multiple-domains took 0.283876 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12814 sec) DOMAIN: domain decomposition done. (took in total 5.58157 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24223 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.95 MB) GRAVTREE: Tree construction done. took 16.7455 sec =951884 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995096 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 250.871 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1129, Time: 0.44197, Redshift: 1.2626, Systemstep: 0.000373805, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1129). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77996 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07838|1.04768 DOMAIN: combining multiple-domains took 0.283394 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26886 sec) DOMAIN: domain decomposition done. (took in total 5.72201 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21915 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.95 MB) GRAVTREE: Tree construction done. took 16.8628 sec =951960 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995096 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.48 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1130, Time: 0.442344, Redshift: 1.26068, Systemstep: 0.000374121, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1130). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77663 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07841|1.04768 DOMAIN: combining multiple-domains took 0.284157 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.27757 sec) DOMAIN: domain decomposition done. (took in total 5.72584 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24761 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.96 MB) GRAVTREE: Tree construction done. took 16.8449 sec =952044 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995097 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.038 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1131, Time: 0.442719, Redshift: 1.25877, Systemstep: 0.000374438, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1131). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77689 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0784|1.04768 DOMAIN: combining multiple-domains took 0.283484 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.48984 sec) DOMAIN: domain decomposition done. (took in total 5.93802 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25587 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.95 MB) GRAVTREE: Tree construction done. took 16.7771 sec =952121 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995097 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.331 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1132, Time: 0.443094, Redshift: 1.25686, Systemstep: 0.000374755, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1132). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86413 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08366|1.04768 DOMAIN: combining multiple-domains took 0.285735 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31569 sec) DOMAIN: domain decomposition done. (took in total 5.89057 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.45612 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.57 MB) GRAVTREE: Tree construction done. took 16.8061 sec =952195 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995098 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.91 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.111 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1133, Time: 0.443469, Redshift: 1.25495, Systemstep: 0.000375072, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1133). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79264 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08371|1.04768 DOMAIN: combining multiple-domains took 0.285943 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.66364 sec) DOMAIN: domain decomposition done. (took in total 6.13153 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24271 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.58 MB) GRAVTREE: Tree construction done. took 16.8152 sec =952252 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995098 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.92 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.195 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1134, Time: 0.443844, Redshift: 1.25304, Systemstep: 0.00037539, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1134). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80999 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08374|1.04768 DOMAIN: combining multiple-domains took 0.352225 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.41853 sec) DOMAIN: domain decomposition done. (took in total 4.96925 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25417 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.58 MB) GRAVTREE: Tree construction done. took 16.8197 sec =952336 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995098 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.92 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.082 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25328 sec PM-PERIODIC: done. (took 13.6133 seconds) TIMESTEPS: displacement time constraint: 0.00819653 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29702 sec PM-PERIODIC: done. (took 13.9831 seconds) TIMESTEPS: displacement time constraint: 0.00819652 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1135, Time: 0.44422, Redshift: 1.25114, Systemstep: 0.000375707, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1135). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78985 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08377|1.04768 DOMAIN: combining multiple-domains took 0.284855 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.54809 sec) DOMAIN: domain decomposition done. (took in total 5.01809 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19205 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.59 MB) GRAVTREE: Tree construction done. took 16.8345 sec =952417 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995099 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.93 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.316 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1136, Time: 0.444596, Redshift: 1.24923, Systemstep: 0.000376025, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1136). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79746 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0838|1.04768 DOMAIN: combining multiple-domains took 0.286271 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.24109 sec) DOMAIN: domain decomposition done. (took in total 5.71425 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27508 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.59 MB) GRAVTREE: Tree construction done. took 16.8614 sec =952474 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995099 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.93 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.293 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1137, Time: 0.444972, Redshift: 1.24733, Systemstep: 0.000376344, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1137). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7835 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08384|1.04768 DOMAIN: combining multiple-domains took 0.283595 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.03535 sec) DOMAIN: domain decomposition done. (took in total 6.4923 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24578 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.59 MB) GRAVTREE: Tree construction done. took 16.8084 sec =952556 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9951 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.94 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.697 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1138, Time: 0.445349, Redshift: 1.24543, Systemstep: 0.000376662, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1138). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79309 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0839|1.04768 DOMAIN: combining multiple-domains took 0.284413 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.87084 sec) DOMAIN: domain decomposition done. (took in total 6.33742 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24365 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.6 MB) GRAVTREE: Tree construction done. took 16.937 sec =952636 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9951 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.147 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1139, Time: 0.445726, Redshift: 1.24353, Systemstep: 0.000376981, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1139). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77881 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08391|1.04768 DOMAIN: combining multiple-domains took 0.284393 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42326 sec) DOMAIN: domain decomposition done. (took in total 5.87555 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25082 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.6 MB) GRAVTREE: Tree construction done. took 16.9138 sec =952723 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9951 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.398 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1140, Time: 0.446103, Redshift: 1.24163, Systemstep: 0.0003773, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1140). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7828 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08392|1.04768 DOMAIN: combining multiple-domains took 0.284929 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.74309 sec) DOMAIN: domain decomposition done. (took in total 5.19937 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23611 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.6 MB) GRAVTREE: Tree construction done. took 16.8058 sec =952789 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995101 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.96 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1141, Time: 0.446481, Redshift: 1.23974, Systemstep: 0.00037762, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1141). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.09264 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08395|1.04768 DOMAIN: combining multiple-domains took 0.286457 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.38029 sec) DOMAIN: domain decomposition done. (took in total 5.14839 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26216 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.61 MB) GRAVTREE: Tree construction done. took 16.8009 sec =952846 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995101 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.517 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1142, Time: 0.446859, Redshift: 1.23784, Systemstep: 0.000377939, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1142). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78238 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08398|1.04768 DOMAIN: combining multiple-domains took 0.284565 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71837 sec) DOMAIN: domain decomposition done. (took in total 6.1745 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18237 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.61 MB) GRAVTREE: Tree construction done. took 16.8299 sec =952915 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995101 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.96 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.837 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26441 sec PM-PERIODIC: done. (took 13.7964 seconds) TIMESTEPS: displacement time constraint: 0.00806779 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27604 sec PM-PERIODIC: done. (took 13.7723 seconds) TIMESTEPS: displacement time constraint: 0.00806779 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1143, Time: 0.447237, Redshift: 1.23595, Systemstep: 0.000378259, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1143). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78531 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08402|1.04768 DOMAIN: combining multiple-domains took 0.334041 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.53396 sec) DOMAIN: domain decomposition done. (took in total 5.04313 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24586 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.8178 sec =952994 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995102 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.97 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.156 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1144, Time: 0.447616, Redshift: 1.23406, Systemstep: 0.000378579, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1144). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78974 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09296|1.04768 DOMAIN: combining multiple-domains took 0.285958 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.27414 sec) DOMAIN: domain decomposition done. (took in total 5.73877 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.44901 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 16.8877 sec =953056 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995102 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.442 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1225.74 sec, total size 352287 MB, corresponds to effective I/O rate of 287.407 MB/sec Sync-Point 1145, Time: 0.447994, Redshift: 1.23217, Systemstep: 0.0003789, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1145). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8017 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09302|1.04768 DOMAIN: combining multiple-domains took 0.288037 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.40163 sec) DOMAIN: domain decomposition done. (took in total 4.88227 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29968 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 16.902 sec =953133 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995102 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.752 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1146, Time: 0.448374, Redshift: 1.23028, Systemstep: 0.000379221, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1146). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79597 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09305|1.04768 DOMAIN: combining multiple-domains took 0.298849 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.61891 sec) DOMAIN: domain decomposition done. (took in total 5.10448 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25516 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 16.8938 sec =953213 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995103 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.654 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1147, Time: 0.448753, Redshift: 1.2284, Systemstep: 0.000379542, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1147). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79702 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09308|1.04768 DOMAIN: combining multiple-domains took 0.287006 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.491 sec) DOMAIN: domain decomposition done. (took in total 5.96437 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26517 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 16.9137 sec =953278 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995103 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.561 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1148, Time: 0.449133, Redshift: 1.22651, Systemstep: 0.000379863, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1148). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80079 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09311|1.04768 DOMAIN: combining multiple-domains took 0.286237 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22307 sec) DOMAIN: domain decomposition done. (took in total 5.70157 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22946 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 16.9257 sec =953339 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995104 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.659 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1149, Time: 0.449513, Redshift: 1.22463, Systemstep: 0.000380184, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1149). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79575 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08055|1.04768 DOMAIN: combining multiple-domains took 0.404106 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 5.41957 sec) DOMAIN: domain decomposition done. (took in total 8.01036 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24347 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.21 MB) GRAVTREE: Tree construction done. took 16.8178 sec =953411 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995104 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.4 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 252.676 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1150, Time: 0.449894, Redshift: 1.22275, Systemstep: 0.000380506, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1150). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79012 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0806|1.04768 DOMAIN: combining multiple-domains took 0.284475 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26279 sec) DOMAIN: domain decomposition done. (took in total 5.72622 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24555 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.21 MB) GRAVTREE: Tree construction done. took 16.796 sec =953482 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995104 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.41 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.268 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2365 sec PM-PERIODIC: done. (took 13.6343 seconds) TIMESTEPS: displacement time constraint: 0.00793282 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20629 sec PM-PERIODIC: done. (took 13.5679 seconds) TIMESTEPS: displacement time constraint: 0.00793282 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1151, Time: 0.450275, Redshift: 1.22087, Systemstep: 0.000380828, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1151). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.99301 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0807|1.04768 DOMAIN: combining multiple-domains took 0.292777 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.84222 sec) DOMAIN: domain decomposition done. (took in total 5.51642 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28153 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.23 MB) GRAVTREE: Tree construction done. took 16.8597 sec =953563 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995105 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.43 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.192 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1152, Time: 0.450656, Redshift: 1.21899, Systemstep: 0.000381151, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1152). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78149 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08078|1.04768 DOMAIN: combining multiple-domains took 0.292792 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.69154 sec) DOMAIN: domain decomposition done. (took in total 6.15406 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21758 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.24 MB) GRAVTREE: Tree construction done. took 16.8604 sec =953668 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995105 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.44 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.131 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1153, Time: 0.451037, Redshift: 1.21711, Systemstep: 0.000381473, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1153). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83085 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08088|1.04768 DOMAIN: combining multiple-domains took 0.291753 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71035 sec) DOMAIN: domain decomposition done. (took in total 6.26624 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23018 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.25 MB) GRAVTREE: Tree construction done. took 16.8814 sec =953726 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995106 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.366 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1154, Time: 0.451419, Redshift: 1.21524, Systemstep: 0.000381796, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1154). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78136 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09125|1.04768 DOMAIN: combining multiple-domains took 0.291517 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.03267 sec) DOMAIN: domain decomposition done. (took in total 5.49438 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.51821 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.47 MB) GRAVTREE: Tree construction done. took 16.8798 sec =953789 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995106 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.15 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.831 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1155, Time: 0.451801, Redshift: 1.21336, Systemstep: 0.000382119, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1155). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79266 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09128|1.04768 DOMAIN: combining multiple-domains took 0.295936 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.58176 sec) DOMAIN: domain decomposition done. (took in total 6.06073 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31764 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.47 MB) GRAVTREE: Tree construction done. took 16.9494 sec =953858 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995106 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.15 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.962 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1156, Time: 0.452184, Redshift: 1.21149, Systemstep: 0.000382443, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1156). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79354 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.097|1.04768 DOMAIN: combining multiple-domains took 0.286079 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.35577 sec) DOMAIN: domain decomposition done. (took in total 6.82608 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.47288 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.14 MB) GRAVTREE: Tree construction done. took 16.9042 sec =953930 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995107 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.08 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.254 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1157, Time: 0.452566, Redshift: 1.20962, Systemstep: 0.000382767, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1157). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79528 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09327|1.01559 DOMAIN: combining multiple-domains took 0.32921 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.8886 sec) DOMAIN: domain decomposition done. (took in total 15.4041 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.05379 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 16.9628 sec =954027 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995107 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.123 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1158, Time: 0.452949, Redshift: 1.20775, Systemstep: 0.000383091, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1158). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80371 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09321|1.01559 DOMAIN: combining multiple-domains took 0.287523 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.97994 sec) DOMAIN: domain decomposition done. (took in total 4.4632 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28913 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.7 MB) GRAVTREE: Tree construction done. took 16.9654 sec =954078 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995107 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.47 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.935 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21686 sec PM-PERIODIC: done. (took 13.4781 seconds) TIMESTEPS: displacement time constraint: 0.00778918 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25285 sec PM-PERIODIC: done. (took 13.2653 seconds) TIMESTEPS: displacement time constraint: 0.00778918 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1159, Time: 0.453333, Redshift: 1.20588, Systemstep: 0.000383415, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1159). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80632 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09314|1.01559 DOMAIN: combining multiple-domains took 0.289848 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45605 sec) DOMAIN: domain decomposition done. (took in total 5.94466 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20871 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.034 sec =954174 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995108 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.745 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1160, Time: 0.453717, Redshift: 1.20402, Systemstep: 0.000383739, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1160). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79775 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0931|1.01559 DOMAIN: combining multiple-domains took 0.288583 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45048 sec) DOMAIN: domain decomposition done. (took in total 5.92955 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29403 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 16.9445 sec =954264 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995108 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.781 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1161, Time: 0.454101, Redshift: 1.20215, Systemstep: 0.000384064, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1161). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79989 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09305|1.01559 DOMAIN: combining multiple-domains took 0.286981 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11285 sec) DOMAIN: domain decomposition done. (took in total 4.59215 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28402 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 16.9442 sec =954322 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995109 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.638 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1162, Time: 0.454485, Redshift: 1.20029, Systemstep: 0.000384389, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1162). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79824 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0851|1.01699 DOMAIN: combining multiple-domains took 0.286993 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.237 sec) DOMAIN: domain decomposition done. (took in total 15.715 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.01524 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.74 MB) GRAVTREE: Tree construction done. took 16.9566 sec =954388 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995109 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.14 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 251.561 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1163, Time: 0.45487, Redshift: 1.19843, Systemstep: 0.000384715, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1163). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79188 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08513|1.01699 DOMAIN: combining multiple-domains took 0.287022 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14802 sec) DOMAIN: domain decomposition done. (took in total 4.6181 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28008 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.75 MB) GRAVTREE: Tree construction done. took 16.9874 sec =954454 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995109 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.15 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.964 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1164, Time: 0.455255, Redshift: 1.19657, Systemstep: 0.00038504, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1164). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78682 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08883|1.01699 DOMAIN: combining multiple-domains took 0.287574 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34164 sec) DOMAIN: domain decomposition done. (took in total 5.80587 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.46162 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.18 MB) GRAVTREE: Tree construction done. took 16.901 sec =954505 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99511 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.75 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.406 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1165, Time: 0.45564, Redshift: 1.19471, Systemstep: 0.000385366, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1165). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78946 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.08886|1.01699 DOMAIN: combining multiple-domains took 0.287205 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.089 sec) DOMAIN: domain decomposition done. (took in total 5.55663 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26033 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.19 MB) GRAVTREE: Tree construction done. took 16.9875 sec =954578 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99511 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.76 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.436 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1215.53 sec, total size 352287 MB, corresponds to effective I/O rate of 289.822 MB/sec Sync-Point 1166, Time: 0.456026, Redshift: 1.19286, Systemstep: 0.000385693, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1166). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7901 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09161|1.04768 DOMAIN: combining multiple-domains took 0.28779 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2897 sec) DOMAIN: domain decomposition done. (took in total 15.7908 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.16139 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 16.8797 sec =954674 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99511 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.21 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.169 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19783 sec PM-PERIODIC: done. (took 13.517 seconds) TIMESTEPS: displacement time constraint: 0.00764053 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22753 sec PM-PERIODIC: done. (took 13.6099 seconds) TIMESTEPS: displacement time constraint: 0.00764054 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1167, Time: 0.456412, Redshift: 1.191, Systemstep: 0.000386019, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1167). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78935 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09165|1.04768 DOMAIN: combining multiple-domains took 0.286343 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.28329 sec) DOMAIN: domain decomposition done. (took in total 6.74865 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32399 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 16.8423 sec =954765 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995111 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.21 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.551 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1168, Time: 0.456798, Redshift: 1.18915, Systemstep: 0.000386346, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1168). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79359 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09169|1.04768 DOMAIN: combining multiple-domains took 0.285114 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11066 sec) DOMAIN: domain decomposition done. (took in total 4.57941 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3155 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 16.9788 sec =954815 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995111 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.141 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1169, Time: 0.457185, Redshift: 1.1873, Systemstep: 0.000386673, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1169). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79063 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09173|1.04768 DOMAIN: combining multiple-domains took 0.288526 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.16534 sec) DOMAIN: domain decomposition done. (took in total 4.6347 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32047 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 16.8588 sec =954883 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995111 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.225 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1170, Time: 0.457572, Redshift: 1.18545, Systemstep: 0.000387, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1170). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79038 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09175|1.04768 DOMAIN: combining multiple-domains took 0.28646 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.97468 sec) DOMAIN: domain decomposition done. (took in total 6.44046 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32571 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 16.8694 sec =954944 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995112 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.428 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1171, Time: 0.457959, Redshift: 1.1836, Systemstep: 0.000387328, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1171). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7863 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08274|1.04768 DOMAIN: combining multiple-domains took 0.285039 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.81307 sec) DOMAIN: domain decomposition done. (took in total 5.2739 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24594 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.47 MB) GRAVTREE: Tree construction done. took 16.8745 sec =955027 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995112 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.76 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.162 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1172, Time: 0.458347, Redshift: 1.18175, Systemstep: 0.000387656, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1172). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78238 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08283|1.04768 DOMAIN: combining multiple-domains took 0.410993 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.84194 sec) DOMAIN: domain decomposition done. (took in total 5.42273 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2642 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.48 MB) GRAVTREE: Tree construction done. took 16.8723 sec =955110 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995113 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.77 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.881 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1173, Time: 0.458735, Redshift: 1.17991, Systemstep: 0.000387984, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1173). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8015 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08294|1.04768 DOMAIN: combining multiple-domains took 0.29214 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49921 sec) DOMAIN: domain decomposition done. (took in total 5.98047 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27732 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.49 MB) GRAVTREE: Tree construction done. took 16.8682 sec =955190 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995113 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.79 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.987 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1174, Time: 0.459123, Redshift: 1.17806, Systemstep: 0.000388312, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1174). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.89288 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08303|1.04768 DOMAIN: combining multiple-domains took 0.292182 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.04216 sec) DOMAIN: domain decomposition done. (took in total 4.65521 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26905 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.5 MB) GRAVTREE: Tree construction done. took 16.888 sec =955251 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995113 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.81 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.019 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23873 sec PM-PERIODIC: done. (took 13.6727 seconds) TIMESTEPS: displacement time constraint: 0.00747385 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35226 sec PM-PERIODIC: done. (took 13.8354 seconds) TIMESTEPS: displacement time constraint: 0.00747385 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1175, Time: 0.459512, Redshift: 1.17622, Systemstep: 0.000388641, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1175). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78781 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08314|1.04768 DOMAIN: combining multiple-domains took 0.291359 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.53433 sec) DOMAIN: domain decomposition done. (took in total 6.00222 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28902 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.51 MB) GRAVTREE: Tree construction done. took 16.8883 sec =955322 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995114 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.82 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.471 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1176, Time: 0.459901, Redshift: 1.17438, Systemstep: 0.00038897, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1176). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79337 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08325|1.04768 DOMAIN: combining multiple-domains took 0.29571 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.13302 sec) DOMAIN: domain decomposition done. (took in total 4.6103 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26605 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.53 MB) GRAVTREE: Tree construction done. took 16.9978 sec =955403 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995114 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.84 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.5 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1177, Time: 0.46029, Redshift: 1.17254, Systemstep: 0.000389299, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1177). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78728 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08335|1.04768 DOMAIN: combining multiple-domains took 0.330749 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41977 sec) DOMAIN: domain decomposition done. (took in total 5.92651 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19192 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.54 MB) GRAVTREE: Tree construction done. took 16.9845 sec =955497 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995115 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.86 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.203 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1178, Time: 0.46068, Redshift: 1.17071, Systemstep: 0.000389629, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1178). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78629 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08346|1.04768 DOMAIN: combining multiple-domains took 0.293165 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.9179 sec) DOMAIN: domain decomposition done. (took in total 5.38646 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23025 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.55 MB) GRAVTREE: Tree construction done. took 16.9049 sec =955563 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995115 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.85 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1179, Time: 0.46107, Redshift: 1.16887, Systemstep: 0.000389958, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1179). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78281 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08358|1.04768 DOMAIN: combining multiple-domains took 0.295901 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.0485 sec) DOMAIN: domain decomposition done. (took in total 5.51649 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21618 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.56 MB) GRAVTREE: Tree construction done. took 16.89 sec =955633 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995115 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.9 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.44 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1180, Time: 0.46146, Redshift: 1.16704, Systemstep: 0.000390289, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1180). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79025 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08369|1.04768 DOMAIN: combining multiple-domains took 0.292341 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.92241 sec) DOMAIN: domain decomposition done. (took in total 4.39756 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27744 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.58 MB) GRAVTREE: Tree construction done. took 16.8988 sec =955713 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995116 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.91 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.759 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1181, Time: 0.461851, Redshift: 1.1652, Systemstep: 0.000390619, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1181). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.99904 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08376|1.04768 DOMAIN: combining multiple-domains took 0.320852 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.15054 sec) DOMAIN: domain decomposition done. (took in total 4.85862 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28742 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.59 MB) GRAVTREE: Tree construction done. took 16.8956 sec =955765 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995116 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.92 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.578 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1182, Time: 0.462242, Redshift: 1.16337, Systemstep: 0.00039095, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1182). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78856 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08387|1.04768 DOMAIN: combining multiple-domains took 0.292625 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16758 sec) DOMAIN: domain decomposition done. (took in total 5.63745 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24252 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.6 MB) GRAVTREE: Tree construction done. took 16.8673 sec =955810 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995116 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.94 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.902 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24131 sec PM-PERIODIC: done. (took 13.5694 seconds) TIMESTEPS: displacement time constraint: 0.00736916 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25322 sec PM-PERIODIC: done. (took 13.5677 seconds) TIMESTEPS: displacement time constraint: 0.00736917 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1183, Time: 0.462633, Redshift: 1.16154, Systemstep: 0.000391281, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1183). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78273 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.084|1.04768 DOMAIN: combining multiple-domains took 0.291724 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11966 sec) DOMAIN: domain decomposition done. (took in total 5.58306 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26717 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.61 MB) GRAVTREE: Tree construction done. took 16.9746 sec =955867 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995116 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.96 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.748 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1184, Time: 0.463024, Redshift: 1.15971, Systemstep: 0.000391612, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1184). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78043 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0841|1.04768 DOMAIN: combining multiple-domains took 0.292941 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.20747 sec) DOMAIN: domain decomposition done. (took in total 4.66924 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28078 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.63 MB) GRAVTREE: Tree construction done. took 17.0087 sec =955937 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995117 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.578 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1185, Time: 0.463416, Redshift: 1.15789, Systemstep: 0.000391943, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1185). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78861 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08421|1.04768 DOMAIN: combining multiple-domains took 0.294402 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71245 sec) DOMAIN: domain decomposition done. (took in total 6.18368 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24111 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.64 MB) GRAVTREE: Tree construction done. took 16.8398 sec =956002 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995117 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.543 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1186, Time: 0.463809, Redshift: 1.15606, Systemstep: 0.000392275, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1186). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78029 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08432|1.04768 DOMAIN: combining multiple-domains took 0.291767 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.69121 sec) DOMAIN: domain decomposition done. (took in total 6.15181 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.1925 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.65 MB) GRAVTREE: Tree construction done. took 16.8799 sec =956090 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995118 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.02 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.631 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1055.08 sec, total size 352287 MB, corresponds to effective I/O rate of 333.897 MB/sec Sync-Point 1187, Time: 0.464201, Redshift: 1.15424, Systemstep: 0.000392607, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1187). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79062 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08442|1.04768 DOMAIN: combining multiple-domains took 0.293496 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.27157 sec) DOMAIN: domain decomposition done. (took in total 4.74537 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28366 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.66 MB) GRAVTREE: Tree construction done. took 16.8827 sec =956166 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995118 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.013 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1188, Time: 0.464594, Redshift: 1.15242, Systemstep: 0.000392939, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1188). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78761 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08452|1.04768 DOMAIN: combining multiple-domains took 0.294615 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1146 sec) DOMAIN: domain decomposition done. (took in total 5.5864 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27091 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 16.9478 sec =956231 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995118 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.822 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1189, Time: 0.464987, Redshift: 1.1506, Systemstep: 0.000393272, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1189). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79237 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08463|1.04768 DOMAIN: combining multiple-domains took 0.294366 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.55659 sec) DOMAIN: domain decomposition done. (took in total 5.03277 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28753 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 16.9967 sec =956314 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995119 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.785 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1190, Time: 0.465381, Redshift: 1.14878, Systemstep: 0.000393605, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1190). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7869 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08475|1.04768 DOMAIN: combining multiple-domains took 0.293555 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89436 sec) DOMAIN: domain decomposition done. (took in total 5.36388 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29261 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 16.8523 sec =956352 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995119 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.09 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.247 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22265 sec PM-PERIODIC: done. (took 13.9984 seconds) TIMESTEPS: displacement time constraint: 0.00723413 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21747 sec PM-PERIODIC: done. (took 13.622 seconds) TIMESTEPS: displacement time constraint: 0.00723413 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1191, Time: 0.465775, Redshift: 1.14696, Systemstep: 0.000393938, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1191). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78594 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08487|1.04768 DOMAIN: combining multiple-domains took 0.292599 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39681 sec) DOMAIN: domain decomposition done. (took in total 5.86396 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25479 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.72 MB) GRAVTREE: Tree construction done. took 16.8648 sec =956420 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995119 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.1 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.877 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1192, Time: 0.466169, Redshift: 1.14514, Systemstep: 0.000394272, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1192). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81248 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08498|1.04768 DOMAIN: combining multiple-domains took 0.291986 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.4606 sec) DOMAIN: domain decomposition done. (took in total 4.95379 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25163 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.73 MB) GRAVTREE: Tree construction done. took 16.8639 sec =956512 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99512 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.12 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.037 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1193, Time: 0.466564, Redshift: 1.14333, Systemstep: 0.000394605, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1193). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84039 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08509|1.04768 DOMAIN: combining multiple-domains took 0.29228 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45339 sec) DOMAIN: domain decomposition done. (took in total 6.01614 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27944 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.74 MB) GRAVTREE: Tree construction done. took 16.8584 sec =956574 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99512 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.14 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.827 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1194, Time: 0.466959, Redshift: 1.14152, Systemstep: 0.000394939, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1194). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7788 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08518|1.04768 DOMAIN: combining multiple-domains took 0.291819 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.91753 sec) DOMAIN: domain decomposition done. (took in total 5.3767 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25942 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.75 MB) GRAVTREE: Tree construction done. took 16.8737 sec =956626 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99512 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.044 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1195, Time: 0.467354, Redshift: 1.13971, Systemstep: 0.000395274, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1195). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.799 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08532|1.04768 DOMAIN: combining multiple-domains took 0.292014 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30565 sec) DOMAIN: domain decomposition done. (took in total 5.78497 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30546 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.77 MB) GRAVTREE: Tree construction done. took 16.8909 sec =956727 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995121 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.18 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.211 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1196, Time: 0.46775, Redshift: 1.1379, Systemstep: 0.000395608, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1196). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79032 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08543|1.04768 DOMAIN: combining multiple-domains took 0.294347 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.33301 sec) DOMAIN: domain decomposition done. (took in total 5.80667 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23828 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.78 MB) GRAVTREE: Tree construction done. took 16.8818 sec =956785 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995121 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.2 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.6 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1197, Time: 0.468146, Redshift: 1.13609, Systemstep: 0.000395943, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1197). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81216 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08553|1.04768 DOMAIN: combining multiple-domains took 0.294736 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05146 sec) DOMAIN: domain decomposition done. (took in total 4.54765 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28919 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.79 MB) GRAVTREE: Tree construction done. took 16.8974 sec =956861 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995122 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.21 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.398 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1198, Time: 0.468542, Redshift: 1.13428, Systemstep: 0.000396278, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1198). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.0554 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08565|1.04768 DOMAIN: combining multiple-domains took 0.290724 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36125 sec) DOMAIN: domain decomposition done. (took in total 6.15367 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24607 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.8756 sec =956948 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995122 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.463 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24683 sec PM-PERIODIC: done. (took 14.0008 seconds) TIMESTEPS: displacement time constraint: 0.00708996 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18969 sec PM-PERIODIC: done. (took 13.7938 seconds) TIMESTEPS: displacement time constraint: 0.00708996 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1199, Time: 0.468939, Redshift: 1.13248, Systemstep: 0.000396614, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1199). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7836 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08573|1.04768 DOMAIN: combining multiple-domains took 0.292339 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36163 sec) DOMAIN: domain decomposition done. (took in total 5.82653 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26795 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 17.0053 sec =956999 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995122 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.978 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1200, Time: 0.469335, Redshift: 1.13067, Systemstep: 0.000396949, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1200). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78821 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08584|1.04768 DOMAIN: combining multiple-domains took 0.29337 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.94341 sec) DOMAIN: domain decomposition done. (took in total 5.41411 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22846 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 16.9005 sec =957087 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995123 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.554 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1201, Time: 0.469733, Redshift: 1.12887, Systemstep: 0.000397285, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1201). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78666 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08595|1.04768 DOMAIN: combining multiple-domains took 0.293794 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.46769 sec) DOMAIN: domain decomposition done. (took in total 5.93581 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2718 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.84 MB) GRAVTREE: Tree construction done. took 16.9028 sec =957165 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995123 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.28 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.685 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1202, Time: 0.47013, Redshift: 1.12707, Systemstep: 0.000397622, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1202). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79505 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08608|1.04768 DOMAIN: combining multiple-domains took 0.293317 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.51245 sec) DOMAIN: domain decomposition done. (took in total 4.98976 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3005 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.86 MB) GRAVTREE: Tree construction done. took 16.9066 sec =957235 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995123 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.776 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1203, Time: 0.470528, Redshift: 1.12527, Systemstep: 0.000397958, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1203). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78997 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08486|1.04768 DOMAIN: combining multiple-domains took 0.294072 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.86202 sec) DOMAIN: domain decomposition done. (took in total 5.35782 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25432 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.72 MB) GRAVTREE: Tree construction done. took 16.8722 sec =957324 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995124 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.1 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.083 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1204, Time: 0.470927, Redshift: 1.12347, Systemstep: 0.000398295, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1204). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79328 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08498|1.04768 DOMAIN: combining multiple-domains took 0.285068 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28276 sec) DOMAIN: domain decomposition done. (took in total 5.74963 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24039 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.73 MB) GRAVTREE: Tree construction done. took 16.8772 sec =957392 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995124 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.12 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.87 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1205, Time: 0.471325, Redshift: 1.12168, Systemstep: 0.000398632, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1205). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78402 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08509|1.04768 DOMAIN: combining multiple-domains took 0.285807 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89402 sec) DOMAIN: domain decomposition done. (took in total 5.35311 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27785 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.74 MB) GRAVTREE: Tree construction done. took 16.8691 sec =957446 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995125 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.14 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.956 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1206, Time: 0.471724, Redshift: 1.11988, Systemstep: 0.00039897, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1206). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7907 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08519|1.04768 DOMAIN: combining multiple-domains took 0.283804 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09197 sec) DOMAIN: domain decomposition done. (took in total 4.55566 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32977 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.75 MB) GRAVTREE: Tree construction done. took 16.8621 sec =957503 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995125 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.892 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21569 sec PM-PERIODIC: done. (took 13.7083 seconds) TIMESTEPS: displacement time constraint: 0.00694368 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29121 sec PM-PERIODIC: done. (took 14.137 seconds) TIMESTEPS: displacement time constraint: 0.00694368 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1207, Time: 0.472124, Redshift: 1.11809, Systemstep: 0.000399307, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1207). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78516 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08528|1.04768 DOMAIN: combining multiple-domains took 0.284593 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41481 sec) DOMAIN: domain decomposition done. (took in total 5.87419 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25993 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.76 MB) GRAVTREE: Tree construction done. took 16.8629 sec =957565 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995125 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.17 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.739 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1208, Time: 0.472523, Redshift: 1.1163, Systemstep: 0.000399645, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1208). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87744 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0854|1.04768 DOMAIN: combining multiple-domains took 0.371254 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05975 sec) DOMAIN: domain decomposition done. (took in total 4.69733 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29193 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.78 MB) GRAVTREE: Tree construction done. took 16.8584 sec =957630 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995125 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.19 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.81 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 995.705 sec, total size 352287 MB, corresponds to effective I/O rate of 353.806 MB/sec Sync-Point 1209, Time: 0.472923, Redshift: 1.11451, Systemstep: 0.000399984, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1209). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80246 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08547|1.04768 DOMAIN: combining multiple-domains took 0.285072 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.49221 sec) DOMAIN: domain decomposition done. (took in total 4.9687 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23421 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.79 MB) GRAVTREE: Tree construction done. took 17.0129 sec =957697 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995126 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.2 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.98 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1210, Time: 0.473323, Redshift: 1.11272, Systemstep: 0.000400322, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1210). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77835 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08557|1.04768 DOMAIN: combining multiple-domains took 0.287583 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09336 sec) DOMAIN: domain decomposition done. (took in total 4.54811 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28721 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 16.8674 sec =957774 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995126 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.036 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1211, Time: 0.473724, Redshift: 1.11093, Systemstep: 0.000400661, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1211). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79008 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08566|1.04768 DOMAIN: combining multiple-domains took 0.287037 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.9214 sec) DOMAIN: domain decomposition done. (took in total 6.38689 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19236 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 16.8591 sec =957840 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995127 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.922 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1212, Time: 0.474125, Redshift: 1.10915, Systemstep: 0.000401, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1212). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78923 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08574|1.04768 DOMAIN: combining multiple-domains took 0.287087 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.45665 sec) DOMAIN: domain decomposition done. (took in total 4.92159 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19887 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 16.8755 sec =957882 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995127 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.05 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1213, Time: 0.474526, Redshift: 1.10736, Systemstep: 0.00040134, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1213). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.95364 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08584|1.04768 DOMAIN: combining multiple-domains took 0.34409 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.38753 sec) DOMAIN: domain decomposition done. (took in total 5.07375 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28787 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 16.874 sec =957971 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995127 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.794 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1214, Time: 0.474928, Redshift: 1.10558, Systemstep: 0.00040168, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1214). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78597 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08024|1.04768 DOMAIN: combining multiple-domains took 0.285461 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.40273 sec) DOMAIN: domain decomposition done. (took in total 5.86267 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26249 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.17 MB) GRAVTREE: Tree construction done. took 16.811 sec =958026 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995127 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.882 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.16452 sec PM-PERIODIC: done. (took 14.0204 seconds) TIMESTEPS: displacement time constraint: 0.00685065 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20185 sec PM-PERIODIC: done. (took 13.5891 seconds) TIMESTEPS: displacement time constraint: 0.00685065 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1215, Time: 0.47533, Redshift: 1.1038, Systemstep: 0.00040202, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1215). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77878 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08025|1.04768 DOMAIN: combining multiple-domains took 0.285377 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.55444 sec) DOMAIN: domain decomposition done. (took in total 6.00697 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21983 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.17 MB) GRAVTREE: Tree construction done. took 16.8933 sec =958103 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995128 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 251.404 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1216, Time: 0.475733, Redshift: 1.10202, Systemstep: 0.00040236, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1216). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77996 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08026|1.04768 DOMAIN: combining multiple-domains took 0.285086 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35471 sec) DOMAIN: domain decomposition done. (took in total 5.8071 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27199 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.17 MB) GRAVTREE: Tree construction done. took 16.8395 sec =958189 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995128 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 252.293 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1217, Time: 0.476135, Redshift: 1.10024, Systemstep: 0.0004027, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1217). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.05157 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08028|1.04768 DOMAIN: combining multiple-domains took 0.286543 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.88631 sec) DOMAIN: domain decomposition done. (took in total 5.68058 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18036 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.18 MB) GRAVTREE: Tree construction done. took 16.8338 sec =958249 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995129 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.233 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1218, Time: 0.476538, Redshift: 1.09847, Systemstep: 0.000403041, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1218). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77541 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08028|1.04768 DOMAIN: combining multiple-domains took 0.284565 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.40546 sec) DOMAIN: domain decomposition done. (took in total 4.85321 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26533 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.18 MB) GRAVTREE: Tree construction done. took 16.8443 sec =958328 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995129 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.495 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1219, Time: 0.476942, Redshift: 1.09669, Systemstep: 0.000403383, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1219). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.98042 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08031|1.04768 DOMAIN: combining multiple-domains took 0.306753 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36252 sec) DOMAIN: domain decomposition done. (took in total 6.03803 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22776 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.18 MB) GRAVTREE: Tree construction done. took 16.8884 sec =958397 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995129 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.12 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1220, Time: 0.477345, Redshift: 1.09492, Systemstep: 0.000403724, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1220). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78434 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09215|1.02124 DOMAIN: combining multiple-domains took 0.285326 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.3699 sec) DOMAIN: domain decomposition done. (took in total 15.8301 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.08226 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.0266 sec =958478 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99513 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 255.742 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1221, Time: 0.477749, Redshift: 1.09315, Systemstep: 0.000404066, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1221). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84252 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09211|1.02124 DOMAIN: combining multiple-domains took 0.294927 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1168 sec) DOMAIN: domain decomposition done. (took in total 5.64607 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28403 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.0454 sec =958548 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99513 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.031 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1222, Time: 0.478154, Redshift: 1.09138, Systemstep: 0.000404408, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1222). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.0386 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09257|1.01559 DOMAIN: combining multiple-domains took 0.288157 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7716 sec) DOMAIN: domain decomposition done. (took in total 15.5034 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.00884 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.62 MB) GRAVTREE: Tree construction done. took 16.9788 sec =958601 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99513 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.856 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20078 sec PM-PERIODIC: done. (took 13.6961 seconds) TIMESTEPS: displacement time constraint: 0.0067632 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18398 sec PM-PERIODIC: done. (took 13.5957 seconds) TIMESTEPS: displacement time constraint: 0.00676321 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1223, Time: 0.478559, Redshift: 1.08961, Systemstep: 0.00040475, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1223). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82325 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09257|1.01559 DOMAIN: combining multiple-domains took 0.405937 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.47745 sec) DOMAIN: domain decomposition done. (took in total 5.09771 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32337 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.62 MB) GRAVTREE: Tree construction done. took 16.9778 sec =958681 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995131 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.947 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1224, Time: 0.478964, Redshift: 1.08784, Systemstep: 0.000405093, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1224). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82948 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08037|1.04768 DOMAIN: combining multiple-domains took 0.290318 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.0814 sec) DOMAIN: domain decomposition done. (took in total 15.5925 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33209 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.19 MB) GRAVTREE: Tree construction done. took 16.8597 sec =958736 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995131 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.37 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.712 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1225, Time: 0.479369, Redshift: 1.08607, Systemstep: 0.000405436, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1225). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78351 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0804|1.04768 DOMAIN: combining multiple-domains took 0.287696 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95999 sec) DOMAIN: domain decomposition done. (took in total 5.41881 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25681 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.19 MB) GRAVTREE: Tree construction done. took 16.8787 sec =958788 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995131 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.38 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.507 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1226, Time: 0.479775, Redshift: 1.08431, Systemstep: 0.000405779, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1226). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83352 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08042|1.04768 DOMAIN: combining multiple-domains took 0.291414 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.61465 sec) DOMAIN: domain decomposition done. (took in total 5.1276 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26403 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.19 MB) GRAVTREE: Tree construction done. took 16.8866 sec =958859 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995132 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.787 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.41765 sec PM-PERIODIC: done. (took 13.7848 seconds) TIMESTEPS: displacement time constraint: 0.00670884 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19677 sec PM-PERIODIC: done. (took 13.6292 seconds) TIMESTEPS: displacement time constraint: 0.00670884 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1227, Time: 0.480181, Redshift: 1.08255, Systemstep: 0.000406122, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1227). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7799 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08042|1.04768 DOMAIN: combining multiple-domains took 0.284735 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.80972 sec) DOMAIN: domain decomposition done. (took in total 5.26314 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26799 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.19 MB) GRAVTREE: Tree construction done. took 16.8796 sec =958921 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995132 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.38 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.799 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1228, Time: 0.480588, Redshift: 1.08079, Systemstep: 0.000406466, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1228). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7813 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08404|1.04768 DOMAIN: combining multiple-domains took 0.285269 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.22568 sec) DOMAIN: domain decomposition done. (took in total 6.68004 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.39507 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.911 sec =958979 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995132 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.97 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.804 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1229, Time: 0.480994, Redshift: 1.07903, Systemstep: 0.00040681, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1229). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78889 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08405|1.04768 DOMAIN: combining multiple-domains took 0.286526 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.05104 sec) DOMAIN: domain decomposition done. (took in total 5.51504 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2564 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.9144 sec =959056 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995133 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.97 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.791 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1230, Time: 0.481401, Redshift: 1.07727, Systemstep: 0.000407154, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1230). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85849 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08408|1.04768 DOMAIN: combining multiple-domains took 0.36933 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05211 sec) DOMAIN: domain decomposition done. (took in total 4.66843 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27521 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.62 MB) GRAVTREE: Tree construction done. took 16.9045 sec =959103 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995133 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.704 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27776 sec PM-PERIODIC: done. (took 13.5306 seconds) TIMESTEPS: displacement time constraint: 0.00664548 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25304 sec PM-PERIODIC: done. (took 13.8214 seconds) TIMESTEPS: displacement time constraint: 0.00664548 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1115.12 sec, total size 352287 MB, corresponds to effective I/O rate of 315.918 MB/sec Sync-Point 1231, Time: 0.481809, Redshift: 1.07551, Systemstep: 0.000407499, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1231). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78109 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08411|1.04768 DOMAIN: combining multiple-domains took 0.287728 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36719 sec) DOMAIN: domain decomposition done. (took in total 5.82506 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27872 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.63 MB) GRAVTREE: Tree construction done. took 16.9247 sec =959191 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995133 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 253.835 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1232, Time: 0.482217, Redshift: 1.07376, Systemstep: 0.000407844, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1232). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78419 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08908|1.04768 DOMAIN: combining multiple-domains took 0.28508 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.26918 sec) DOMAIN: domain decomposition done. (took in total 6.72765 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38798 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 16.95 sec =959244 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995134 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.279 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1233, Time: 0.482625, Redshift: 1.072, Systemstep: 0.000408189, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1233). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79082 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08915|1.04768 DOMAIN: combining multiple-domains took 0.285922 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05141 sec) DOMAIN: domain decomposition done. (took in total 4.51862 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29816 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 17.0894 sec =959316 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995134 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.8 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.358 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1234, Time: 0.483034, Redshift: 1.07025, Systemstep: 0.000408535, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1234). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78696 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08917|1.04768 DOMAIN: combining multiple-domains took 0.287127 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21947 sec) DOMAIN: domain decomposition done. (took in total 4.68568 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30047 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 16.944 sec =959402 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995134 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.81 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.346 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25543 sec PM-PERIODIC: done. (took 13.5679 seconds) TIMESTEPS: displacement time constraint: 0.00658926 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25843 sec PM-PERIODIC: done. (took 13.2559 seconds) TIMESTEPS: displacement time constraint: 0.00658927 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1235, Time: 0.483442, Redshift: 1.0685, Systemstep: 0.000408881, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1235). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78913 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08923|1.04768 DOMAIN: combining multiple-domains took 0.28722 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.87637 sec) DOMAIN: domain decomposition done. (took in total 6.343 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29215 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 16.9514 sec =959462 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995135 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.566 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1236, Time: 0.483852, Redshift: 1.06675, Systemstep: 0.000409227, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1236). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7841 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08927|1.04768 DOMAIN: combining multiple-domains took 0.286132 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.67433 sec) DOMAIN: domain decomposition done. (took in total 5.13376 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2819 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 16.9358 sec =959520 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995135 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.54 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1237, Time: 0.484261, Redshift: 1.065, Systemstep: 0.000409573, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1237). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78458 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08932|1.04768 DOMAIN: combining multiple-domains took 0.28561 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73459 sec) DOMAIN: domain decomposition done. (took in total 5.19363 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31917 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 16.9299 sec =959593 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995135 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.83 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.518 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1238, Time: 0.484671, Redshift: 1.06325, Systemstep: 0.00040992, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1238). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81153 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08935|1.04768 DOMAIN: combining multiple-domains took 0.288854 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19153 sec) DOMAIN: domain decomposition done. (took in total 5.68126 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29332 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 16.9466 sec =959668 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995136 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.84 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.265 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30434 sec PM-PERIODIC: done. (took 14.0982 seconds) TIMESTEPS: displacement time constraint: 0.00652477 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28048 sec PM-PERIODIC: done. (took 13.5248 seconds) TIMESTEPS: displacement time constraint: 0.00652478 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1239, Time: 0.485081, Redshift: 1.06151, Systemstep: 0.000410267, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1239). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78592 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08939|1.04768 DOMAIN: combining multiple-domains took 0.285675 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.68989 sec) DOMAIN: domain decomposition done. (took in total 5.15129 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29945 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.9319 sec =959721 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995136 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.84 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.488 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1240, Time: 0.485492, Redshift: 1.05977, Systemstep: 0.000410614, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1240). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8175 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08943|1.04768 DOMAIN: combining multiple-domains took 0.288609 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.40194 sec) DOMAIN: domain decomposition done. (took in total 4.89809 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27577 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.9502 sec =959805 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995137 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.564 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1241, Time: 0.485903, Redshift: 1.05802, Systemstep: 0.000410962, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1241). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78621 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08944|1.04768 DOMAIN: combining multiple-domains took 0.285541 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11707 sec) DOMAIN: domain decomposition done. (took in total 4.57891 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29081 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 16.9371 sec =959877 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995137 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.507 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1242, Time: 0.486314, Redshift: 1.05628, Systemstep: 0.00041131, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1242). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80446 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08948|1.04768 DOMAIN: combining multiple-domains took 0.288882 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20127 sec) DOMAIN: domain decomposition done. (took in total 5.68474 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23942 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.9357 sec =959948 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995137 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.352 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24624 sec PM-PERIODIC: done. (took 14.0455 seconds) TIMESTEPS: displacement time constraint: 0.00650907 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28299 sec PM-PERIODIC: done. (took 13.7111 seconds) TIMESTEPS: displacement time constraint: 0.00650907 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1243, Time: 0.486726, Redshift: 1.05454, Systemstep: 0.000411658, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1243). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.96039 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08951|1.04768 DOMAIN: combining multiple-domains took 0.376992 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.03912 sec) DOMAIN: domain decomposition done. (took in total 5.76608 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29649 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 16.9375 sec =960009 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995138 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.101 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1244, Time: 0.487138, Redshift: 1.05281, Systemstep: 0.000412006, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1244). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80586 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08955|1.04768 DOMAIN: combining multiple-domains took 0.288007 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28191 sec) DOMAIN: domain decomposition done. (took in total 5.76559 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25767 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 16.9772 sec =960078 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995138 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.323 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1245, Time: 0.48755, Redshift: 1.05107, Systemstep: 0.000412355, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1245). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78479 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08958|1.04768 DOMAIN: combining multiple-domains took 0.286778 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8328 sec) DOMAIN: domain decomposition done. (took in total 5.29434 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30202 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 17.055 sec =960131 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995138 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.939 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1246, Time: 0.487963, Redshift: 1.04934, Systemstep: 0.000412704, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1246). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78468 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08961|1.04768 DOMAIN: combining multiple-domains took 0.286381 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.10543 sec) DOMAIN: domain decomposition done. (took in total 6.56692 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22593 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 17.0485 sec =960180 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995138 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.295 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32931 sec PM-PERIODIC: done. (took 13.6728 seconds) TIMESTEPS: displacement time constraint: 0.00646292 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28169 sec PM-PERIODIC: done. (took 13.9281 seconds) TIMESTEPS: displacement time constraint: 0.00646292 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1247, Time: 0.488376, Redshift: 1.0476, Systemstep: 0.000413053, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1247). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78459 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08963|1.04768 DOMAIN: combining multiple-domains took 0.288001 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.9619 sec) DOMAIN: domain decomposition done. (took in total 5.42392 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29682 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.9552 sec =960280 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995139 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.485 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1248, Time: 0.488789, Redshift: 1.04587, Systemstep: 0.000413403, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1248). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78954 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08966|1.04768 DOMAIN: combining multiple-domains took 0.287537 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.46726 sec) DOMAIN: domain decomposition done. (took in total 5.93418 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2874 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 16.9581 sec =960335 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995139 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.006 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1249, Time: 0.489203, Redshift: 1.04414, Systemstep: 0.000413753, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1249). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78971 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08971|1.04768 DOMAIN: combining multiple-domains took 0.285812 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.014 sec) DOMAIN: domain decomposition done. (took in total 6.47982 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27606 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 16.9508 sec =960385 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995139 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.9 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.51 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1250, Time: 0.489617, Redshift: 1.04241, Systemstep: 0.000414103, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1250). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.00291 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08975|1.04768 DOMAIN: combining multiple-domains took 0.287467 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12481 sec) DOMAIN: domain decomposition done. (took in total 5.85003 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2523 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 16.9778 sec =960466 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99514 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.9 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.23 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29695 sec PM-PERIODIC: done. (took 13.5544 seconds) TIMESTEPS: displacement time constraint: 0.00642011 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.6075 sec PM-PERIODIC: done. (took 13.9561 seconds) TIMESTEPS: displacement time constraint: 0.0064201 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1251, Time: 0.490032, Redshift: 1.04068, Systemstep: 0.000414454, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1251). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79354 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08977|1.04768 DOMAIN: combining multiple-domains took 0.28545 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35967 sec) DOMAIN: domain decomposition done. (took in total 5.82877 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25832 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 16.9845 sec =960543 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99514 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.421 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1091.39 sec, total size 352287 MB, corresponds to effective I/O rate of 322.787 MB/sec Sync-Point 1252, Time: 0.490447, Redshift: 1.03896, Systemstep: 0.000414805, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1252). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79244 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08979|1.04768 DOMAIN: combining multiple-domains took 0.287717 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.01888 sec) DOMAIN: domain decomposition done. (took in total 6.48944 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2876 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 16.9555 sec =960598 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995141 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.888 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1253, Time: 0.490862, Redshift: 1.03723, Systemstep: 0.000415156, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1253). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79249 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0898|1.04768 DOMAIN: combining multiple-domains took 0.285964 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.5669 sec) DOMAIN: domain decomposition done. (took in total 6.0394 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26271 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 16.9693 sec =960635 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995141 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.746 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1254, Time: 0.491277, Redshift: 1.03551, Systemstep: 0.000415507, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1254). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78434 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08981|1.04768 DOMAIN: combining multiple-domains took 0.286232 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42988 sec) DOMAIN: domain decomposition done. (took in total 5.8902 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25986 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 16.9586 sec =960717 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995141 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.845 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24873 sec PM-PERIODIC: done. (took 13.515 seconds) TIMESTEPS: displacement time constraint: 0.00639949 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28166 sec PM-PERIODIC: done. (took 13.7633 seconds) TIMESTEPS: displacement time constraint: 0.00639949 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1255, Time: 0.491693, Redshift: 1.03379, Systemstep: 0.000415859, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1255). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7939 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09412|1.01982 DOMAIN: combining multiple-domains took 0.28688 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.4218 sec) DOMAIN: domain decomposition done. (took in total 15.8921 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.06599 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.81 MB) GRAVTREE: Tree construction done. took 17.0699 sec =960757 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995141 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.729 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1256, Time: 0.492109, Redshift: 1.03207, Systemstep: 0.000416211, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1256). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79907 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09414|1.01982 DOMAIN: combining multiple-domains took 0.288538 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.27291 sec) DOMAIN: domain decomposition done. (took in total 5.75303 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25762 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.81 MB) GRAVTREE: Tree construction done. took 17.1763 sec =960840 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995142 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.007 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1257, Time: 0.492526, Redshift: 1.03035, Systemstep: 0.000416563, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1257). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80218 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09418|1.01982 DOMAIN: combining multiple-domains took 0.288902 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.20968 sec) DOMAIN: domain decomposition done. (took in total 6.6936 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25282 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.81 MB) GRAVTREE: Tree construction done. took 17.1766 sec =960904 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995142 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.019 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1258, Time: 0.492943, Redshift: 1.02863, Systemstep: 0.000416916, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1258). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80238 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09421|1.01982 DOMAIN: combining multiple-domains took 0.289858 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45717 sec) DOMAIN: domain decomposition done. (took in total 5.9429 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27846 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.82 MB) GRAVTREE: Tree construction done. took 17.0924 sec =960986 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995142 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.63 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.839 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23752 sec PM-PERIODIC: done. (took 13.9657 seconds) TIMESTEPS: displacement time constraint: 0.00635221 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26338 sec PM-PERIODIC: done. (took 13.6193 seconds) TIMESTEPS: displacement time constraint: 0.00635221 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1259, Time: 0.49336, Redshift: 1.02692, Systemstep: 0.000417269, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1259). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81431 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09424|1.01982 DOMAIN: combining multiple-domains took 0.289154 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21804 sec) DOMAIN: domain decomposition done. (took in total 5.71451 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24437 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.82 MB) GRAVTREE: Tree construction done. took 17.0943 sec =961044 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995143 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.63 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.042 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1260, Time: 0.493778, Redshift: 1.0252, Systemstep: 0.000417622, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1260). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79374 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08999|1.04768 DOMAIN: combining multiple-domains took 0.28861 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.0456 sec) DOMAIN: domain decomposition done. (took in total 15.5214 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.1785 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 16.9513 sec =961099 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995143 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.94 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.064 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1261, Time: 0.494196, Redshift: 1.02349, Systemstep: 0.000417975, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1261). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78551 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09002|1.04768 DOMAIN: combining multiple-domains took 0.28755 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.87611 sec) DOMAIN: domain decomposition done. (took in total 4.33884 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30459 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 16.9564 sec =961154 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995143 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.778 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1262, Time: 0.494614, Redshift: 1.02178, Systemstep: 0.000418329, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1262). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79111 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09009|1.04768 DOMAIN: combining multiple-domains took 0.345816 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56568 sec) DOMAIN: domain decomposition done. (took in total 6.09202 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28256 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 16.9742 sec =961229 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995144 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.96 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.009 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24122 sec PM-PERIODIC: done. (took 13.6 seconds) TIMESTEPS: displacement time constraint: 0.00631078 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.42281 sec PM-PERIODIC: done. (took 14.0944 seconds) TIMESTEPS: displacement time constraint: 0.00631078 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1263, Time: 0.495033, Redshift: 1.02007, Systemstep: 0.000418683, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1263). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78369 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09011|1.04768 DOMAIN: combining multiple-domains took 0.28779 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.27509 sec) DOMAIN: domain decomposition done. (took in total 6.7371 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25092 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 16.9877 sec =961314 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995144 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.96 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.289 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1264, Time: 0.495452, Redshift: 1.01836, Systemstep: 0.000419038, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1264). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82187 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09012|1.04768 DOMAIN: combining multiple-domains took 0.287374 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29803 sec) DOMAIN: domain decomposition done. (took in total 5.79734 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30503 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 17.0269 sec =961372 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995144 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.96 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.681 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1265, Time: 0.495871, Redshift: 1.01665, Systemstep: 0.000419392, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1265). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78916 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09017|1.04768 DOMAIN: combining multiple-domains took 0.2865 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11907 sec) DOMAIN: domain decomposition done. (took in total 5.58513 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30517 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 16.9912 sec =961386 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995145 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.846 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1266, Time: 0.496291, Redshift: 1.01495, Systemstep: 0.000419747, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1266). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78518 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09018|1.04768 DOMAIN: combining multiple-domains took 0.286882 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.44081 sec) DOMAIN: domain decomposition done. (took in total 4.90343 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27725 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 16.9897 sec =961441 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995145 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.766 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24676 sec PM-PERIODIC: done. (took 14.0089 seconds) TIMESTEPS: displacement time constraint: 0.00626819 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29504 sec PM-PERIODIC: done. (took 13.7138 seconds) TIMESTEPS: displacement time constraint: 0.00626818 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1267, Time: 0.496711, Redshift: 1.01324, Systemstep: 0.000420103, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1267). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7846 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09021|1.04768 DOMAIN: combining multiple-domains took 0.286156 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.97813 sec) DOMAIN: domain decomposition done. (took in total 5.43931 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31501 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 16.984 sec =961531 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995145 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.738 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1268, Time: 0.497131, Redshift: 1.01154, Systemstep: 0.000420458, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1268). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78615 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09024|1.04768 DOMAIN: combining multiple-domains took 0.285157 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.92933 sec) DOMAIN: domain decomposition done. (took in total 5.39168 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26972 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 16.9841 sec =961601 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995146 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 254.816 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1269, Time: 0.497552, Redshift: 1.00984, Systemstep: 0.000420814, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1269). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78712 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09026|1.04768 DOMAIN: combining multiple-domains took 0.285686 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.23723 sec) DOMAIN: domain decomposition done. (took in total 4.70029 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30383 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 16.9794 sec =961666 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995146 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 254.852 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1270, Time: 0.497973, Redshift: 1.00814, Systemstep: 0.000421171, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1270). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78719 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09028|1.04768 DOMAIN: combining multiple-domains took 0.287825 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10335 sec) DOMAIN: domain decomposition done. (took in total 4.56843 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30899 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 16.9772 sec =961737 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995146 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 254.986 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26793 sec PM-PERIODIC: done. (took 14.0537 seconds) TIMESTEPS: displacement time constraint: 0.00622919 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.209 sec PM-PERIODIC: done. (took 14.2092 seconds) TIMESTEPS: displacement time constraint: 0.00622919 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1271, Time: 0.498395, Redshift: 1.00644, Systemstep: 0.000421527, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1271). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79064 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09031|1.04768 DOMAIN: combining multiple-domains took 0.286157 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.91734 sec) DOMAIN: domain decomposition done. (took in total 6.38383 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23977 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 16.9733 sec =961799 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995147 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.174 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1272, Time: 0.498817, Redshift: 1.00474, Systemstep: 0.000421884, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1272). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78219 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09035|1.04768 DOMAIN: combining multiple-domains took 0.287347 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.13684 sec) DOMAIN: domain decomposition done. (took in total 5.59728 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27755 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 16.9737 sec =961877 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995147 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.4 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 2386.88 sec, total size 352287 MB, corresponds to effective I/O rate of 147.593 MB/sec Sync-Point 1273, Time: 0.499239, Redshift: 1.00305, Systemstep: 0.000422241, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1273). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78609 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09037|1.04768 DOMAIN: combining multiple-domains took 0.285067 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.17942 sec) DOMAIN: domain decomposition done. (took in total 4.63976 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28983 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 16.9797 sec =961934 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995147 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.043 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1274, Time: 0.499662, Redshift: 1.00135, Systemstep: 0.000422598, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1274). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82502 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0904|1.04768 DOMAIN: combining multiple-domains took 0.290241 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.81443 sec) DOMAIN: domain decomposition done. (took in total 5.31896 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29145 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 17.0373 sec =961993 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995148 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 255.173 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28241 sec PM-PERIODIC: done. (took 13.9195 seconds) TIMESTEPS: displacement time constraint: 0.00620197 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27117 sec PM-PERIODIC: done. (took 13.5919 seconds) TIMESTEPS: displacement time constraint: 0.00620196 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1275, Time: 0.500085, Redshift: 0.999662, Systemstep: 0.000422956, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1275). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80474 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09044|1.04768 DOMAIN: combining multiple-domains took 0.2871 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11105 sec) DOMAIN: domain decomposition done. (took in total 4.59188 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29316 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 17.1138 sec =962070 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995148 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 255.076 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1276, Time: 0.500508, Redshift: 0.99797, Systemstep: 0.000423314, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1276). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78182 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09047|1.04768 DOMAIN: combining multiple-domains took 0.288645 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26625 sec) DOMAIN: domain decomposition done. (took in total 5.72589 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26076 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 16.9919 sec =962117 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995148 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 255.421 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1277, Time: 0.500932, Redshift: 0.996281, Systemstep: 0.000423672, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1277). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7851 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09052|1.04768 DOMAIN: combining multiple-domains took 0.287137 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.83338 sec) DOMAIN: domain decomposition done. (took in total 5.29589 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23603 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 16.9944 sec =962166 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995148 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 255.308 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1278, Time: 0.501356, Redshift: 0.994592, Systemstep: 0.000424031, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1278). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78525 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08923|1.01559 DOMAIN: combining multiple-domains took 0.286756 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 14.6503 sec) DOMAIN: domain decomposition done. (took in total 17.1114 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.35256 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 17.0521 sec =962202 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995149 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.202 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21682 sec PM-PERIODIC: done. (took 13.4604 seconds) TIMESTEPS: displacement time constraint: 0.00618076 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33029 sec PM-PERIODIC: done. (took 13.9105 seconds) TIMESTEPS: displacement time constraint: 0.00618076 (0.02) GRAVTREE/FMM: Setting OldAcc! SNAPSHOT: writing snapshot file #0 @ time 0.501356 ... SNAPSHOT: writing snapshot file: './output//snapdir_000/snapshot_000.0' (file 1 of 4) SNAPSHOT: writing snapshot block 0 (Coordinates)... SNAPSHOT: writing snapshot block 1 (Velocities)... SNAPSHOT: writing snapshot block 2 (ParticleIDs)... SNAPSHOT: writing snapshot block 4 (Weights)... SNAPSHOT: writing snapshot block 5 (PhaseSpaceDensities)... SNAPSHOT: writing snapshot block 9 (IntCoordinates)... SNAPSHOT: writing snapshot block 10 (IntVelocities)... SNAPSHOT: writing snapshot block 11 (IntPredictedVelocities)... SNAPSHOT: done with writing snapshot. Took 4782.04 sec, total size 147456 MB, corresponds to effective I/O rate of 30.8353 MB/sec SNAPSHOT: Setting next time for snapshot file to Time_next= 1 (DumpFlag=1) KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 2066.01 sec, total size 352287 MB, corresponds to effective I/O rate of 170.516 MB/sec Sync-Point 1279, Time: 0.50178, Redshift: 0.992905, Systemstep: 0.00042439, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1279). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79587 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08926|1.01559 DOMAIN: combining multiple-domains took 0.289318 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98607 sec) DOMAIN: domain decomposition done. (took in total 5.46271 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31355 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 17.0625 sec =962271 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995149 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.263 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1280, Time: 0.502205, Redshift: 0.99122, Systemstep: 0.000424749, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1280). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82861 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08754|1.01559 DOMAIN: combining multiple-domains took 0.29111 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.32126 sec) DOMAIN: domain decomposition done. (took in total 6.83364 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19077 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.0372 sec =962378 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99515 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.54 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.603 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1281, Time: 0.50263, Redshift: 0.989535, Systemstep: 0.000425109, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1281). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80064 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08749|1.01559 DOMAIN: combining multiple-domains took 0.288005 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10944 sec) DOMAIN: domain decomposition done. (took in total 4.58937 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24748 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.1425 sec =962435 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99515 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.779 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1282, Time: 0.503055, Redshift: 0.987853, Systemstep: 0.000425469, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1282). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7963 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08849|1.01559 DOMAIN: combining multiple-domains took 0.288136 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45434 sec) DOMAIN: domain decomposition done. (took in total 5.93219 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20275 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.0412 sec =962476 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99515 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.488 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30834 sec PM-PERIODIC: done. (took 13.5901 seconds) TIMESTEPS: displacement time constraint: 0.00615673 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33645 sec PM-PERIODIC: done. (took 14.0597 seconds) TIMESTEPS: displacement time constraint: 0.00615673 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1283, Time: 0.503481, Redshift: 0.986172, Systemstep: 0.000425829, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1283). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79008 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08843|1.01559 DOMAIN: combining multiple-domains took 0.288036 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47878 sec) DOMAIN: domain decomposition done. (took in total 5.94868 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24253 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.0409 sec =962569 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99515 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.564 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1284, Time: 0.503907, Redshift: 0.984492, Systemstep: 0.000426189, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1284). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79137 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08837|1.01559 DOMAIN: combining multiple-domains took 0.286291 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.65244 sec) DOMAIN: domain decomposition done. (took in total 6.12242 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24383 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.0352 sec =962608 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995151 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.673 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1285, Time: 0.504334, Redshift: 0.982813, Systemstep: 0.00042655, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1285). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7938 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08837|1.01559 DOMAIN: combining multiple-domains took 0.286886 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45567 sec) DOMAIN: domain decomposition done. (took in total 5.92767 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22495 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.038 sec =962698 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995151 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.721 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1286, Time: 0.504761, Redshift: 0.981136, Systemstep: 0.000426911, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1286). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79425 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08834|1.01559 DOMAIN: combining multiple-domains took 0.287494 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.59182 sec) DOMAIN: domain decomposition done. (took in total 6.06549 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28396 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.0474 sec =962740 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995151 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.066 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34064 sec PM-PERIODIC: done. (took 13.7575 seconds) TIMESTEPS: displacement time constraint: 0.00614619 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3962 sec PM-PERIODIC: done. (took 14.3806 seconds) TIMESTEPS: displacement time constraint: 0.00614619 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1287, Time: 0.505188, Redshift: 0.979461, Systemstep: 0.000427272, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1287). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78901 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.0903|1.01982 DOMAIN: combining multiple-domains took 0.286452 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.6567 sec) DOMAIN: domain decomposition done. (took in total 15.1236 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.15516 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.0625 sec =962790 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995152 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.325 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1288, Time: 0.505616, Redshift: 0.977787, Systemstep: 0.000427634, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1288). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79307 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09024|1.01982 DOMAIN: combining multiple-domains took 0.290481 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.54256 sec) DOMAIN: domain decomposition done. (took in total 6.01856 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23721 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.0373 sec =962848 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995152 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.173 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1289, Time: 0.506044, Redshift: 0.976114, Systemstep: 0.000427996, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1289). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8887 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09368|1.01982 DOMAIN: combining multiple-domains took 0.398913 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.9981 sec) DOMAIN: domain decomposition done. (took in total 6.67778 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.39429 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.0731 sec =962907 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995152 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.54 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.864 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1290, Time: 0.506472, Redshift: 0.974442, Systemstep: 0.000428358, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1290). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82062 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09363|1.01982 DOMAIN: combining multiple-domains took 0.288076 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.8122 sec) DOMAIN: domain decomposition done. (took in total 6.31377 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27582 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.0642 sec =962970 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995152 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.54 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.42 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2757 sec PM-PERIODIC: done. (took 13.7737 seconds) TIMESTEPS: displacement time constraint: 0.00611985 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27548 sec PM-PERIODIC: done. (took 14.1372 seconds) TIMESTEPS: displacement time constraint: 0.00611985 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1291, Time: 0.506901, Redshift: 0.972773, Systemstep: 0.000428721, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1291). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8077 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08812|1.01559 DOMAIN: combining multiple-domains took 0.287981 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3535 sec) DOMAIN: domain decomposition done. (took in total 14.8415 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.10944 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.0489 sec =963050 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995153 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.285 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1292, Time: 0.50733, Redshift: 0.971104, Systemstep: 0.000429084, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1292). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79569 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08807|1.01559 DOMAIN: combining multiple-domains took 0.28858 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18747 sec) DOMAIN: domain decomposition done. (took in total 5.66367 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23586 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.09 MB) GRAVTREE: Tree construction done. took 17.0452 sec =963106 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995153 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.63 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.244 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1293, Time: 0.507759, Redshift: 0.969437, Systemstep: 0.000429447, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1293). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.02315 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08803|1.01559 DOMAIN: combining multiple-domains took 0.28767 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.86023 sec) DOMAIN: domain decomposition done. (took in total 5.62381 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26167 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.09 MB) GRAVTREE: Tree construction done. took 17.0516 sec =963166 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995153 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.526 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1294, Time: 0.508189, Redshift: 0.967771, Systemstep: 0.000429811, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1294). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79399 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08806|1.01559 DOMAIN: combining multiple-domains took 0.28663 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.40198 sec) DOMAIN: domain decomposition done. (took in total 4.87524 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2696 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.09 MB) GRAVTREE: Tree construction done. took 17.1466 sec =963229 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995154 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.63 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.613 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29165 sec PM-PERIODIC: done. (took 13.7446 seconds) TIMESTEPS: displacement time constraint: 0.00610662 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.46474 sec PM-PERIODIC: done. (took 14.3048 seconds) TIMESTEPS: displacement time constraint: 0.00610662 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1295, Time: 0.508619, Redshift: 0.966107, Systemstep: 0.000430174, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1295). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79624 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08815|1.01559 DOMAIN: combining multiple-domains took 0.288442 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.8766 sec) DOMAIN: domain decomposition done. (took in total 6.35261 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26923 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.1125 sec =963289 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995154 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.689 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1296, Time: 0.50905, Redshift: 0.964444, Systemstep: 0.000430539, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1296). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79536 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0868|1.01559 DOMAIN: combining multiple-domains took 0.285391 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.22249 sec) DOMAIN: domain decomposition done. (took in total 6.69437 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19491 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 17.0329 sec =963346 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995154 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.42 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 255.987 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1798.73 sec, total size 352287 MB, corresponds to effective I/O rate of 195.853 MB/sec Sync-Point 1297, Time: 0.509481, Redshift: 0.962783, Systemstep: 0.000430903, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1297). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80078 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08675|1.01559 DOMAIN: combining multiple-domains took 0.286186 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60996 sec) DOMAIN: domain decomposition done. (took in total 6.08836 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23313 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 17.0508 sec =963391 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995155 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 255.588 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1298, Time: 0.509912, Redshift: 0.961123, Systemstep: 0.000431268, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1298). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80396 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08671|1.01559 DOMAIN: combining multiple-domains took 0.28642 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.95604 sec) DOMAIN: domain decomposition done. (took in total 6.43699 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17317 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 17.0459 sec =963448 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995155 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 255.395 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.44929 sec PM-PERIODIC: done. (took 14.0107 seconds) TIMESTEPS: displacement time constraint: 0.00610632 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26454 sec PM-PERIODIC: done. (took 13.9978 seconds) TIMESTEPS: displacement time constraint: 0.00610633 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1299, Time: 0.510344, Redshift: 0.959464, Systemstep: 0.000431633, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1299). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.06975 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09325|1.01982 DOMAIN: combining multiple-domains took 0.288087 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7715 sec) DOMAIN: domain decomposition done. (took in total 15.5846 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30195 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.7 MB) GRAVTREE: Tree construction done. took 17.0568 sec =963485 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995155 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.47 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.653 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1300, Time: 0.510776, Redshift: 0.957807, Systemstep: 0.000431998, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1300). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.98781 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08664|1.01559 DOMAIN: combining multiple-domains took 0.353083 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.4454 sec) DOMAIN: domain decomposition done. (took in total 16.1782 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17686 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.92 MB) GRAVTREE: Tree construction done. took 17.041 sec =963567 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995156 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.39 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.363 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1301, Time: 0.511208, Redshift: 0.956151, Systemstep: 0.000432364, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1301). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79633 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.0932|1.01982 DOMAIN: combining multiple-domains took 0.418133 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2303 sec) DOMAIN: domain decomposition done. (took in total 15.8349 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32806 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.7 MB) GRAVTREE: Tree construction done. took 17.0537 sec =963617 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995156 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.247 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1302, Time: 0.511641, Redshift: 0.954496, Systemstep: 0.00043273, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1302). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80953 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09316|1.01982 DOMAIN: combining multiple-domains took 0.289677 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73131 sec) DOMAIN: domain decomposition done. (took in total 5.22208 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26037 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.0583 sec =963678 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995156 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.323 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29323 sec PM-PERIODIC: done. (took 13.7159 seconds) TIMESTEPS: displacement time constraint: 0.00611232 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28598 sec PM-PERIODIC: done. (took 14.0159 seconds) TIMESTEPS: displacement time constraint: 0.00611232 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1303, Time: 0.512074, Redshift: 0.952843, Systemstep: 0.000433096, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1303). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80169 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09311|1.01982 DOMAIN: combining multiple-domains took 0.288775 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.25738 sec) DOMAIN: domain decomposition done. (took in total 6.73971 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29003 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.0582 sec =963769 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995157 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.425 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1304, Time: 0.512507, Redshift: 0.951192, Systemstep: 0.000433463, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1304). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87935 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09307|1.01982 DOMAIN: combining multiple-domains took 0.288606 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38129 sec) DOMAIN: domain decomposition done. (took in total 5.97983 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25824 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.0585 sec =963831 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995157 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.492 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1305, Time: 0.512941, Redshift: 0.949541, Systemstep: 0.00043383, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1305). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79433 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09302|1.01982 DOMAIN: combining multiple-domains took 0.291103 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12772 sec) DOMAIN: domain decomposition done. (took in total 5.60575 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27072 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.0401 sec =963902 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995157 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.43 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1306, Time: 0.513375, Redshift: 0.947893, Systemstep: 0.000434197, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1306). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79707 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09447|1.01699 DOMAIN: combining multiple-domains took 0.287562 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 14.0743 sec) DOMAIN: domain decomposition done. (took in total 16.5508 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17895 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.85 MB) GRAVTREE: Tree construction done. took 17.1244 sec =963940 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995157 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.67 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.84 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29522 sec PM-PERIODIC: done. (took 13.6462 seconds) TIMESTEPS: displacement time constraint: 0.00609816 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33103 sec PM-PERIODIC: done. (took 14.3719 seconds) TIMESTEPS: displacement time constraint: 0.00609816 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1307, Time: 0.51381, Redshift: 0.946245, Systemstep: 0.000434565, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1307). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79065 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09449|1.01699 DOMAIN: combining multiple-domains took 0.290671 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.00601 sec) DOMAIN: domain decomposition done. (took in total 6.48011 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26506 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.85 MB) GRAVTREE: Tree construction done. took 17.1763 sec =964006 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995158 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.68 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.769 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1308, Time: 0.514245, Redshift: 0.944599, Systemstep: 0.000434932, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1308). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.90597 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09453|1.01699 DOMAIN: combining multiple-domains took 0.400221 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45353 sec) DOMAIN: domain decomposition done. (took in total 6.15251 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32756 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.85 MB) GRAVTREE: Tree construction done. took 17.1554 sec =964076 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995158 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.68 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.733 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1309, Time: 0.51468, Redshift: 0.942954, Systemstep: 0.000435301, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1309). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83192 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09458|1.01699 DOMAIN: combining multiple-domains took 0.293502 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.96332 sec) DOMAIN: domain decomposition done. (took in total 6.48256 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32969 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.86 MB) GRAVTREE: Tree construction done. took 17.3118 sec =964179 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995159 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.69 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.816 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1310, Time: 0.515116, Redshift: 0.941311, Systemstep: 0.000435669, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1310). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80922 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09462|1.01699 DOMAIN: combining multiple-domains took 0.291333 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.39019 sec) DOMAIN: domain decomposition done. (took in total 4.88349 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32572 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.86 MB) GRAVTREE: Tree construction done. took 17.1466 sec =964243 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995159 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.7 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.402 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3268 sec PM-PERIODIC: done. (took 14.039 seconds) TIMESTEPS: displacement time constraint: 0.00608666 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33754 sec PM-PERIODIC: done. (took 13.6237 seconds) TIMESTEPS: displacement time constraint: 0.00608667 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1311, Time: 0.515552, Redshift: 0.939669, Systemstep: 0.000436038, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1311). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.11197 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09467|1.01699 DOMAIN: combining multiple-domains took 0.291086 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.0031 sec) DOMAIN: domain decomposition done. (took in total 6.80617 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28994 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.87 MB) GRAVTREE: Tree construction done. took 17.1617 sec =964303 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995159 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.056 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1312, Time: 0.515988, Redshift: 0.938029, Systemstep: 0.000436407, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1312). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80277 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09296|1.01982 DOMAIN: combining multiple-domains took 0.28987 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.7421 sec) DOMAIN: domain decomposition done. (took in total 16.2285 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.43902 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.0511 sec =964377 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99516 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.912 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1313, Time: 0.516425, Redshift: 0.936389, Systemstep: 0.000436776, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1313). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79743 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09166|1.04768 DOMAIN: combining multiple-domains took 0.290079 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4358 sec) DOMAIN: domain decomposition done. (took in total 14.915 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.16017 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.0457 sec =964411 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99516 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.21 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.167 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1314, Time: 0.516862, Redshift: 0.934752, Systemstep: 0.000437146, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1314). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79429 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09169|1.04768 DOMAIN: combining multiple-domains took 0.285409 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62519 sec) DOMAIN: domain decomposition done. (took in total 5.09597 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30169 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.0487 sec =964467 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99516 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.154 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33959 sec PM-PERIODIC: done. (took 13.9471 seconds) TIMESTEPS: displacement time constraint: 0.00608202 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25509 sec PM-PERIODIC: done. (took 13.8801 seconds) TIMESTEPS: displacement time constraint: 0.00608202 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 2056.81 sec, total size 352287 MB, corresponds to effective I/O rate of 171.278 MB/sec Sync-Point 1315, Time: 0.5173, Redshift: 0.933115, Systemstep: 0.000437516, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1315). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78918 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09171|1.04768 DOMAIN: combining multiple-domains took 0.287401 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.08431 sec) DOMAIN: domain decomposition done. (took in total 5.55236 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29802 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.0717 sec =964532 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99516 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.395 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1316, Time: 0.517738, Redshift: 0.93148, Systemstep: 0.000437886, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1316). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79147 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09174|1.04768 DOMAIN: combining multiple-domains took 0.287231 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41637 sec) DOMAIN: domain decomposition done. (took in total 5.88565 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26352 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.075 sec =964592 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995161 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.23 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.61 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1317, Time: 0.518176, Redshift: 0.929847, Systemstep: 0.000438257, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1317). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79123 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09182|1.04768 DOMAIN: combining multiple-domains took 0.288235 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45731 sec) DOMAIN: domain decomposition done. (took in total 5.92773 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2939 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.0842 sec =964641 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995161 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 259.396 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1318, Time: 0.518614, Redshift: 0.928215, Systemstep: 0.000438628, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1318). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81295 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09185|1.04768 DOMAIN: combining multiple-domains took 0.288995 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.97059 sec) DOMAIN: domain decomposition done. (took in total 5.46342 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23081 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.0524 sec =964707 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995161 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 258.959 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28452 sec PM-PERIODIC: done. (took 13.8055 seconds) TIMESTEPS: displacement time constraint: 0.00607507 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22407 sec PM-PERIODIC: done. (took 14.1788 seconds) TIMESTEPS: displacement time constraint: 0.00607507 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1319, Time: 0.519053, Redshift: 0.926584, Systemstep: 0.000438999, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1319). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78984 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09189|1.04768 DOMAIN: combining multiple-domains took 0.287191 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.6397 sec) DOMAIN: domain decomposition done. (took in total 5.10741 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30973 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.0596 sec =964794 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995162 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 259.067 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1320, Time: 0.519493, Redshift: 0.924954, Systemstep: 0.000439371, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1320). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79022 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08941|1.01418 DOMAIN: combining multiple-domains took 0.287514 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.6826 sec) DOMAIN: domain decomposition done. (took in total 16.1509 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.42662 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.25 MB) GRAVTREE: Tree construction done. took 17.0809 sec =964863 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995162 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.85 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.197 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1321, Time: 0.519933, Redshift: 0.923326, Systemstep: 0.000439743, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1321). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7993 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08936|1.01418 DOMAIN: combining multiple-domains took 0.287368 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.71556 sec) DOMAIN: domain decomposition done. (took in total 5.19329 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20702 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 17.0655 sec =964926 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995162 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.84 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.307 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1322, Time: 0.520373, Redshift: 0.9217, Systemstep: 0.000440115, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1322). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79146 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08929|1.01418 DOMAIN: combining multiple-domains took 0.291777 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17415 sec) DOMAIN: domain decomposition done. (took in total 5.64865 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22764 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 17.1722 sec =964950 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995162 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.83 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 254.574 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.1947 sec PM-PERIODIC: done. (took 13.483 seconds) TIMESTEPS: displacement time constraint: 0.00604768 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.16887 sec PM-PERIODIC: done. (took 13.7993 seconds) TIMESTEPS: displacement time constraint: 0.00604768 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1323, Time: 0.520813, Redshift: 0.920074, Systemstep: 0.000440488, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1323). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80719 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08924|1.01418 DOMAIN: combining multiple-domains took 0.321497 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8357 sec) DOMAIN: domain decomposition done. (took in total 5.35522 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21912 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.23 MB) GRAVTREE: Tree construction done. took 17.0625 sec =964990 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995163 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 253.69 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1324, Time: 0.521254, Redshift: 0.91845, Systemstep: 0.000440861, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1324). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78928 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08728|1.04768 DOMAIN: combining multiple-domains took 0.288401 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.3352 sec) DOMAIN: domain decomposition done. (took in total 15.8031 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.04646 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.1865 sec =965067 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995163 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.697 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1325, Time: 0.521695, Redshift: 0.916828, Systemstep: 0.000441234, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1325). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78303 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08739|1.04768 DOMAIN: combining multiple-domains took 0.285773 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.75479 sec) DOMAIN: domain decomposition done. (took in total 5.21367 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27877 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.0735 sec =965106 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995163 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1326, Time: 0.522137, Redshift: 0.915207, Systemstep: 0.000441607, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1326). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80463 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08748|1.04768 DOMAIN: combining multiple-domains took 0.288961 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.15656 sec) DOMAIN: domain decomposition done. (took in total 6.63988 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29341 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.0499 sec =965155 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995163 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.533 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35216 sec PM-PERIODIC: done. (took 13.8048 seconds) TIMESTEPS: displacement time constraint: 0.00604504 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3512 sec PM-PERIODIC: done. (took 14.2603 seconds) TIMESTEPS: displacement time constraint: 0.00604504 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1327, Time: 0.522579, Redshift: 0.913587, Systemstep: 0.000441981, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1327). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78922 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0876|1.04768 DOMAIN: combining multiple-domains took 0.288797 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.54203 sec) DOMAIN: domain decomposition done. (took in total 6.00954 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23691 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.1035 sec =965205 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995164 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.922 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1328, Time: 0.523021, Redshift: 0.911968, Systemstep: 0.000442355, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1328). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78955 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0877|1.04768 DOMAIN: combining multiple-domains took 0.283895 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16822 sec) DOMAIN: domain decomposition done. (took in total 5.63165 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27172 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.0854 sec =965277 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995164 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.779 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1329, Time: 0.523464, Redshift: 0.910351, Systemstep: 0.00044273, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1329). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79024 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08783|1.04768 DOMAIN: combining multiple-domains took 0.353727 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44463 sec) DOMAIN: domain decomposition done. (took in total 5.98142 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26261 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.1108 sec =965336 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995164 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.678 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1330, Time: 0.523907, Redshift: 0.908735, Systemstep: 0.000443104, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1330). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79281 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08793|1.04768 DOMAIN: combining multiple-domains took 0.285147 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.16825 sec) DOMAIN: domain decomposition done. (took in total 4.63726 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28419 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.2328 sec =965408 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995165 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.957 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26687 sec PM-PERIODIC: done. (took 13.71 seconds) TIMESTEPS: displacement time constraint: 0.0060389 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29052 sec PM-PERIODIC: done. (took 13.9444 seconds) TIMESTEPS: displacement time constraint: 0.0060389 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1331, Time: 0.524351, Redshift: 0.907121, Systemstep: 0.000443479, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1331). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78246 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08801|1.04768 DOMAIN: combining multiple-domains took 0.286629 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28637 sec) DOMAIN: domain decomposition done. (took in total 5.74531 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23346 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.09 MB) GRAVTREE: Tree construction done. took 17.1084 sec =965477 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995165 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.62 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.768 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1332, Time: 0.524794, Redshift: 0.905508, Systemstep: 0.000443855, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1332). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78397 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08811|1.04768 DOMAIN: combining multiple-domains took 0.286752 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22012 sec) DOMAIN: domain decomposition done. (took in total 4.68125 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28742 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.0888 sec =965549 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995165 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.63 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.912 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1489.95 sec, total size 352287 MB, corresponds to effective I/O rate of 236.443 MB/sec Sync-Point 1333, Time: 0.525239, Redshift: 0.903897, Systemstep: 0.000444231, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1333). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79686 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08821|1.04768 DOMAIN: combining multiple-domains took 0.28526 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05001 sec) DOMAIN: domain decomposition done. (took in total 4.52376 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29417 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.11 MB) GRAVTREE: Tree construction done. took 17.0926 sec =965607 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995166 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.65 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.816 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1334, Time: 0.525683, Redshift: 0.902286, Systemstep: 0.000444607, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1334). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78918 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08834|1.04768 DOMAIN: combining multiple-domains took 0.286413 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56996 sec) DOMAIN: domain decomposition done. (took in total 6.0362 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29765 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.0903 sec =965683 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995166 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.913 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34573 sec PM-PERIODIC: done. (took 13.7411 seconds) TIMESTEPS: displacement time constraint: 0.00604176 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2822 sec PM-PERIODIC: done. (took 13.6773 seconds) TIMESTEPS: displacement time constraint: 0.00604176 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1335, Time: 0.526128, Redshift: 0.900677, Systemstep: 0.000444983, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1335). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78556 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08846|1.04768 DOMAIN: combining multiple-domains took 0.284689 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.13932 sec) DOMAIN: domain decomposition done. (took in total 5.59996 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28271 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.1697 sec =965705 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995166 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.951 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1336, Time: 0.526574, Redshift: 0.89907, Systemstep: 0.00044536, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1336). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78304 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08858|1.04768 DOMAIN: combining multiple-domains took 0.285174 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.90863 sec) DOMAIN: domain decomposition done. (took in total 6.36664 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29551 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.0578 sec =965789 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995167 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 260.957 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1337, Time: 0.527019, Redshift: 0.897464, Systemstep: 0.000445737, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1337). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79049 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0903|1.04768 DOMAIN: combining multiple-domains took 0.285456 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.89174 sec) DOMAIN: domain decomposition done. (took in total 6.35811 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.47819 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.1682 sec =965839 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995167 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.613 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1338, Time: 0.527465, Redshift: 0.895859, Systemstep: 0.000446114, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1338). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79296 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09024|1.04768 DOMAIN: combining multiple-domains took 0.286211 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.99256 sec) DOMAIN: domain decomposition done. (took in total 4.46174 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21732 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.0324 sec =965889 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995167 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.858 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.48322 sec PM-PERIODIC: done. (took 13.9476 seconds) TIMESTEPS: displacement time constraint: 0.00604348 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25437 sec PM-PERIODIC: done. (took 13.7023 seconds) TIMESTEPS: displacement time constraint: 0.00604348 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1339, Time: 0.527912, Redshift: 0.894255, Systemstep: 0.000446492, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1339). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78647 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09016|1.01418 DOMAIN: combining multiple-domains took 0.286026 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.0172 sec) DOMAIN: domain decomposition done. (took in total 15.4794 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.05695 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 17.0666 sec =965954 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995167 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.995 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1340, Time: 0.528359, Redshift: 0.892653, Systemstep: 0.00044687, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1340). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.03671 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09007|1.01418 DOMAIN: combining multiple-domains took 0.287706 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12971 sec) DOMAIN: domain decomposition done. (took in total 4.92426 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29881 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 17.0686 sec =966016 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995168 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.664 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1341, Time: 0.528806, Redshift: 0.891053, Systemstep: 0.000447248, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1341). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80356 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08993|1.01418 DOMAIN: combining multiple-domains took 0.287303 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.23387 sec) DOMAIN: domain decomposition done. (took in total 4.71567 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28939 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.31 MB) GRAVTREE: Tree construction done. took 17.0755 sec =966088 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995168 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.93 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.179 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1342, Time: 0.529254, Redshift: 0.889453, Systemstep: 0.000447626, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1342). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79991 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08983|1.01418 DOMAIN: combining multiple-domains took 0.287321 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79014 sec) DOMAIN: domain decomposition done. (took in total 5.26921 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29961 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 17.1349 sec =966111 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995168 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.92 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.625 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20662 sec PM-PERIODIC: done. (took 13.7439 seconds) TIMESTEPS: displacement time constraint: 0.00603855 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2166 sec PM-PERIODIC: done. (took 13.5704 seconds) TIMESTEPS: displacement time constraint: 0.00603856 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1343, Time: 0.529702, Redshift: 0.887855, Systemstep: 0.000448005, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1343). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79849 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08975|1.01418 DOMAIN: combining multiple-domains took 0.286354 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60781 sec) DOMAIN: domain decomposition done. (took in total 6.08416 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25988 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 17.124 sec =966191 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995169 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.9 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 255.034 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1344, Time: 0.53015, Redshift: 0.886258, Systemstep: 0.000448385, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1344). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80095 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08727|1.01418 DOMAIN: combining multiple-domains took 0.286258 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38155 sec) DOMAIN: domain decomposition done. (took in total 5.85968 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21991 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.198 sec =966246 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995169 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 254.564 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1345, Time: 0.530599, Redshift: 0.884663, Systemstep: 0.000448764, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1345). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79272 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08729|1.01418 DOMAIN: combining multiple-domains took 0.286184 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.9833 sec) DOMAIN: domain decomposition done. (took in total 5.45291 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26111 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.087 sec =966307 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995169 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.945 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1346, Time: 0.531048, Redshift: 0.883069, Systemstep: 0.000449144, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1346). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79602 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08732|1.01418 DOMAIN: combining multiple-domains took 0.287737 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11098 sec) DOMAIN: domain decomposition done. (took in total 5.5854 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2649 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.0902 sec =966354 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995169 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.263 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34817 sec PM-PERIODIC: done. (took 13.9653 seconds) TIMESTEPS: displacement time constraint: 0.00603493 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29865 sec PM-PERIODIC: done. (took 13.5801 seconds) TIMESTEPS: displacement time constraint: 0.00603493 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1347, Time: 0.531497, Redshift: 0.881476, Systemstep: 0.000449524, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1347). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.06465 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08735|1.01418 DOMAIN: combining multiple-domains took 0.286904 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.76766 sec) DOMAIN: domain decomposition done. (took in total 5.55935 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25299 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.0966 sec =966408 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99517 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.297 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1348, Time: 0.531947, Redshift: 0.879885, Systemstep: 0.000449905, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1348). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79253 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08541|1.04768 DOMAIN: combining multiple-domains took 0.286521 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.9807 sec) DOMAIN: domain decomposition done. (took in total 15.4492 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.96998 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.78 MB) GRAVTREE: Tree construction done. took 16.969 sec =966489 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99517 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.19 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 257.33 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1349, Time: 0.532398, Redshift: 0.878295, Systemstep: 0.000450285, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1349). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78175 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08537|1.04768 DOMAIN: combining multiple-domains took 0.288478 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18016 sec) DOMAIN: domain decomposition done. (took in total 4.6389 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27537 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.77 MB) GRAVTREE: Tree construction done. took 16.9568 sec =966524 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99517 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.19 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.362 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1350, Time: 0.532848, Redshift: 0.876707, Systemstep: 0.000450667, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1350). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78814 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08531|1.04768 DOMAIN: combining multiple-domains took 0.28869 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.4352 sec) DOMAIN: domain decomposition done. (took in total 4.90025 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27291 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.77 MB) GRAVTREE: Tree construction done. took 16.9703 sec =966599 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995171 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.18 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.484 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24934 sec PM-PERIODIC: done. (took 14.1566 seconds) TIMESTEPS: displacement time constraint: 0.00604476 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19444 sec PM-PERIODIC: done. (took 14.124 seconds) TIMESTEPS: displacement time constraint: 0.00604476 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1351, Time: 0.533299, Redshift: 0.875119, Systemstep: 0.000451048, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1351). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78195 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08136|1.04768 DOMAIN: combining multiple-domains took 0.286887 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.54789 sec) DOMAIN: domain decomposition done. (took in total 6.00532 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18619 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.3 MB) GRAVTREE: Tree construction done. took 16.9763 sec =966675 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995171 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.813 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1352, Time: 0.533751, Redshift: 0.873533, Systemstep: 0.00045143, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1352). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77704 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08139|1.04768 DOMAIN: combining multiple-domains took 0.291069 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.72538 sec) DOMAIN: domain decomposition done. (took in total 6.18209 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20735 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.31 MB) GRAVTREE: Tree construction done. took 16.9623 sec =966722 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995171 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.54 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.635 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1991.86 sec, total size 352287 MB, corresponds to effective I/O rate of 176.863 MB/sec Sync-Point 1353, Time: 0.534203, Redshift: 0.871949, Systemstep: 0.000451812, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1353). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77496 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09562|1.01559 DOMAIN: combining multiple-domains took 0.291633 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7128 sec) DOMAIN: domain decomposition done. (took in total 15.1668 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32487 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.1948 sec =966778 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995172 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.947 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1354, Time: 0.534655, Redshift: 0.870366, Systemstep: 0.000452195, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1354). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7957 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09564|1.01559 DOMAIN: combining multiple-domains took 0.289226 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93771 sec) DOMAIN: domain decomposition done. (took in total 5.41559 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25738 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.2036 sec =966846 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995172 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.358 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26673 sec PM-PERIODIC: done. (took 13.6048 seconds) TIMESTEPS: displacement time constraint: 0.00606353 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26891 sec PM-PERIODIC: done. (took 14.3245 seconds) TIMESTEPS: displacement time constraint: 0.00606353 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1355, Time: 0.535107, Redshift: 0.868784, Systemstep: 0.000452577, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1355). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80394 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09567|1.01559 DOMAIN: combining multiple-domains took 0.28868 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42684 sec) DOMAIN: domain decomposition done. (took in total 5.91468 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30126 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.1944 sec =966900 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995172 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.87 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 257.994 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1356, Time: 0.53556, Redshift: 0.867203, Systemstep: 0.00045296, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1356). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80171 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09568|1.01559 DOMAIN: combining multiple-domains took 0.288843 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.4682 sec) DOMAIN: domain decomposition done. (took in total 5.95131 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30386 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.2038 sec =966950 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995172 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.87 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 257.872 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1357, Time: 0.536014, Redshift: 0.865624, Systemstep: 0.000453344, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1357). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79528 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09571|1.01559 DOMAIN: combining multiple-domains took 0.288289 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.14313 sec) DOMAIN: domain decomposition done. (took in total 5.61945 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30492 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.2021 sec =967010 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995173 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.87 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 257.908 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1358, Time: 0.536467, Redshift: 0.864046, Systemstep: 0.000453728, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1358). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79655 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09579|1.04768 DOMAIN: combining multiple-domains took 0.287708 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.6633 sec) DOMAIN: domain decomposition done. (took in total 16.1401 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.06755 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814 MB) GRAVTREE: Tree construction done. took 17.1601 sec =967034 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995173 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.89 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.706 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29029 sec PM-PERIODIC: done. (took 13.7726 seconds) TIMESTEPS: displacement time constraint: 0.00606071 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3115 sec PM-PERIODIC: done. (took 13.9981 seconds) TIMESTEPS: displacement time constraint: 0.00606072 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1359, Time: 0.536922, Redshift: 0.862469, Systemstep: 0.000454112, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1359). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79239 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08584|1.04768 DOMAIN: combining multiple-domains took 0.287769 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.69424 sec) DOMAIN: domain decomposition done. (took in total 6.16492 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.46022 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.0557 sec =967090 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995173 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.239 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1360, Time: 0.537376, Redshift: 0.860894, Systemstep: 0.000454496, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1360). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79495 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08587|1.04768 DOMAIN: combining multiple-domains took 0.286747 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.0845 sec) DOMAIN: domain decomposition done. (took in total 4.55594 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20664 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.0993 sec =967158 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995173 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.27 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.993 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1361, Time: 0.537831, Redshift: 0.85932, Systemstep: 0.000454881, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1361). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79298 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08589|1.04768 DOMAIN: combining multiple-domains took 0.28648 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.2351 sec) DOMAIN: domain decomposition done. (took in total 6.70496 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33598 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.84 MB) GRAVTREE: Tree construction done. took 17.0424 sec =967229 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995174 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.27 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.691 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1362, Time: 0.538286, Redshift: 0.857748, Systemstep: 0.000455266, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1362). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78234 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08592|1.04768 DOMAIN: combining multiple-domains took 0.286345 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18629 sec) DOMAIN: domain decomposition done. (took in total 4.64486 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29434 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.84 MB) GRAVTREE: Tree construction done. took 17.0677 sec =967278 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995174 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.28 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.373 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.47269 sec PM-PERIODIC: done. (took 14.2515 seconds) TIMESTEPS: displacement time constraint: 0.00606427 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31872 sec PM-PERIODIC: done. (took 13.9878 seconds) TIMESTEPS: displacement time constraint: 0.00606427 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1363, Time: 0.538742, Redshift: 0.856177, Systemstep: 0.000455651, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1363). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78556 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08594|1.04768 DOMAIN: combining multiple-domains took 0.289994 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.20136 sec) DOMAIN: domain decomposition done. (took in total 4.66631 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28387 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.84 MB) GRAVTREE: Tree construction done. took 17.1665 sec =967313 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995174 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.28 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.538 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1364, Time: 0.539198, Redshift: 0.854607, Systemstep: 0.000456037, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1364). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.91648 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08598|1.04768 DOMAIN: combining multiple-domains took 0.286794 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15163 sec) DOMAIN: domain decomposition done. (took in total 5.74498 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30755 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 17.059 sec =967371 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995175 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.29 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.083 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1365, Time: 0.539654, Redshift: 0.853038, Systemstep: 0.000456423, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1365). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83266 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08602|1.04768 DOMAIN: combining multiple-domains took 0.285728 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.81792 sec) DOMAIN: domain decomposition done. (took in total 5.35259 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25551 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 17.0247 sec =967436 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995175 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.29 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 258.293 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1366, Time: 0.540111, Redshift: 0.851471, Systemstep: 0.000456809, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1366). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78414 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08605|1.04768 DOMAIN: combining multiple-domains took 0.286127 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11001 sec) DOMAIN: domain decomposition done. (took in total 4.56934 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27894 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 17.1162 sec =967488 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995175 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.3 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 258.652 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25456 sec PM-PERIODIC: done. (took 14.2587 seconds) TIMESTEPS: displacement time constraint: 0.00608538 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23019 sec PM-PERIODIC: done. (took 13.9692 seconds) TIMESTEPS: displacement time constraint: 0.00608538 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1367, Time: 0.540568, Redshift: 0.849905, Systemstep: 0.000457196, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1367). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.781 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08608|1.04768 DOMAIN: combining multiple-domains took 0.287383 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.2213 sec) DOMAIN: domain decomposition done. (took in total 4.67946 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28018 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.86 MB) GRAVTREE: Tree construction done. took 17.0296 sec =967533 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995175 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.3 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 258.943 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1368, Time: 0.541026, Redshift: 0.84834, Systemstep: 0.000457583, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1368). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7818 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08639|1.01559 DOMAIN: combining multiple-domains took 0.285282 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5617 sec) DOMAIN: domain decomposition done. (took in total 15.0177 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.04824 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 17.1325 sec =967600 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995176 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.35 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.957 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1369, Time: 0.541484, Redshift: 0.846777, Systemstep: 0.00045797, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1369). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79688 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08641|1.01559 DOMAIN: combining multiple-domains took 0.288514 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06524 sec) DOMAIN: domain decomposition done. (took in total 4.54168 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28401 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 17.1252 sec =967660 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995176 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.36 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 255.906 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1370, Time: 0.541942, Redshift: 0.845215, Systemstep: 0.000458358, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1370). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.02153 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08687|1.01559 DOMAIN: combining multiple-domains took 0.349024 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.1723 sec) DOMAIN: domain decomposition done. (took in total 6.93372 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.1405 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.95 MB) GRAVTREE: Tree construction done. took 17.1282 sec =967710 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995176 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.515 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27472 sec PM-PERIODIC: done. (took 14.394 seconds) TIMESTEPS: displacement time constraint: 0.00607591 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26072 sec PM-PERIODIC: done. (took 13.9652 seconds) TIMESTEPS: displacement time constraint: 0.00607591 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1934.5 sec, total size 352287 MB, corresponds to effective I/O rate of 182.107 MB/sec Sync-Point 1371, Time: 0.542401, Redshift: 0.843655, Systemstep: 0.000458746, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1371). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79685 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08681|1.01559 DOMAIN: combining multiple-domains took 0.286809 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21591 sec) DOMAIN: domain decomposition done. (took in total 5.69126 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22657 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 17.1503 sec =967752 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995176 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.42 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.52 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1372, Time: 0.54286, Redshift: 0.842095, Systemstep: 0.000459134, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1372). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79481 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08674|1.01559 DOMAIN: combining multiple-domains took 0.288773 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18224 sec) DOMAIN: domain decomposition done. (took in total 4.65633 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27053 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 17.1396 sec =967823 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995177 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 254.985 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1373, Time: 0.54332, Redshift: 0.840537, Systemstep: 0.000459523, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1373). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80941 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08624|1.04768 DOMAIN: combining multiple-domains took 0.287015 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7362 sec) DOMAIN: domain decomposition done. (took in total 15.2244 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30027 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.88 MB) GRAVTREE: Tree construction done. took 17.151 sec =967917 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995177 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.33 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.077 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1374, Time: 0.54378, Redshift: 0.838981, Systemstep: 0.000459912, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1374). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78448 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08629|1.04768 DOMAIN: combining multiple-domains took 0.285189 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34436 sec) DOMAIN: domain decomposition done. (took in total 5.80316 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25501 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.88 MB) GRAVTREE: Tree construction done. took 17.014 sec =967955 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995177 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.34 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 255.963 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34451 sec PM-PERIODIC: done. (took 14.458 seconds) TIMESTEPS: displacement time constraint: 0.00606502 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33947 sec PM-PERIODIC: done. (took 14.0223 seconds) TIMESTEPS: displacement time constraint: 0.00606502 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1375, Time: 0.54424, Redshift: 0.837425, Systemstep: 0.000460301, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1375). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77848 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08633|1.04768 DOMAIN: combining multiple-domains took 0.284458 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.17252 sec) DOMAIN: domain decomposition done. (took in total 4.6241 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28546 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.89 MB) GRAVTREE: Tree construction done. took 17.0197 sec =968016 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995178 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.34 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 256.035 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1376, Time: 0.544701, Redshift: 0.835871, Systemstep: 0.000460691, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1376). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78038 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08635|1.04768 DOMAIN: combining multiple-domains took 0.285027 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79328 sec) DOMAIN: domain decomposition done. (took in total 5.24776 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2633 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.89 MB) GRAVTREE: Tree construction done. took 17.0247 sec =968065 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995178 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.35 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.006 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1377, Time: 0.545162, Redshift: 0.834318, Systemstep: 0.000461081, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1377). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.07167 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08638|1.04768 DOMAIN: combining multiple-domains took 0.285342 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.5803 sec) DOMAIN: domain decomposition done. (took in total 6.39339 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28485 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.89 MB) GRAVTREE: Tree construction done. took 16.9996 sec =968126 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995178 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.35 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 259.707 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1378, Time: 0.545623, Redshift: 0.832767, Systemstep: 0.000461471, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1378). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.98063 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0864|1.04768 DOMAIN: combining multiple-domains took 0.288216 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98645 sec) DOMAIN: domain decomposition done. (took in total 5.64655 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.42799 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 18.6186 sec =968149 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995178 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.614 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 3.5 sec PM-PERIODIC: done. (took 14.8345 seconds) TIMESTEPS: displacement time constraint: 0.00605537 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24938 sec PM-PERIODIC: done. (took 17.0881 seconds) TIMESTEPS: displacement time constraint: 0.00605537 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1379, Time: 0.546085, Redshift: 0.831217, Systemstep: 0.000461862, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1379). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77866 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08641|1.04768 DOMAIN: combining multiple-domains took 0.288504 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.82229 sec) DOMAIN: domain decomposition done. (took in total 6.27787 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27876 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 18.2925 sec =968210 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995179 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.473 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1380, Time: 0.546547, Redshift: 0.829668, Systemstep: 0.000462253, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1380). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78191 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08642|1.04768 DOMAIN: combining multiple-domains took 0.287218 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29831 sec) DOMAIN: domain decomposition done. (took in total 5.75569 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24857 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 16.9947 sec =968285 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995179 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.36 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.594 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1381, Time: 0.54701, Redshift: 0.828121, Systemstep: 0.000462644, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1381). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78651 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08647|1.04768 DOMAIN: combining multiple-domains took 0.287888 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31964 sec) DOMAIN: domain decomposition done. (took in total 5.7824 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21136 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 17.0139 sec =968344 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995179 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.37 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.719 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1382, Time: 0.547473, Redshift: 0.826575, Systemstep: 0.000463036, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1382). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77862 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07453|1.04768 DOMAIN: combining multiple-domains took 0.287731 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45694 sec) DOMAIN: domain decomposition done. (took in total 5.91157 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27128 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.5 MB) GRAVTREE: Tree construction done. took 16.8789 sec =968422 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99518 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.42 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.25 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27817 sec PM-PERIODIC: done. (took 13.7215 seconds) TIMESTEPS: displacement time constraint: 0.00606055 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28698 sec PM-PERIODIC: done. (took 13.8613 seconds) TIMESTEPS: displacement time constraint: 0.00606055 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1383, Time: 0.547936, Redshift: 0.82503, Systemstep: 0.000463428, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1383). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.76777 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07579|1.04768 DOMAIN: combining multiple-domains took 0.282066 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31775 sec) DOMAIN: domain decomposition done. (took in total 5.75413 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.41548 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.65 MB) GRAVTREE: Tree construction done. took 16.9248 sec =968471 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99518 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.62 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 256.863 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1384, Time: 0.5484, Redshift: 0.823486, Systemstep: 0.00046382, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1384). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77071 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07579|1.04768 DOMAIN: combining multiple-domains took 0.282127 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.72668 sec) DOMAIN: domain decomposition done. (took in total 5.16621 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27764 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.65 MB) GRAVTREE: Tree construction done. took 16.9425 sec =968529 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99518 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.62 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.422 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1385, Time: 0.548864, Redshift: 0.821944, Systemstep: 0.000464212, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1385). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80565 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07583|1.04768 DOMAIN: combining multiple-domains took 0.286061 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21796 sec) DOMAIN: domain decomposition done. (took in total 5.69641 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26091 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.65 MB) GRAVTREE: Tree construction done. took 17.0575 sec =968575 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995181 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.63 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.98 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1386, Time: 0.549329, Redshift: 0.820403, Systemstep: 0.000464605, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1386). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77389 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07584|1.04768 DOMAIN: combining multiple-domains took 0.283743 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26299 sec) DOMAIN: domain decomposition done. (took in total 5.70795 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23007 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.65 MB) GRAVTREE: Tree construction done. took 16.9314 sec =968628 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995181 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.63 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.212 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.47029 sec PM-PERIODIC: done. (took 13.7022 seconds) TIMESTEPS: displacement time constraint: 0.00607034 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27875 sec PM-PERIODIC: done. (took 13.4697 seconds) TIMESTEPS: displacement time constraint: 0.00607034 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1387, Time: 0.549794, Redshift: 0.818863, Systemstep: 0.000464999, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1387). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.0894 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07586|1.04768 DOMAIN: combining multiple-domains took 0.283308 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10657 sec) DOMAIN: domain decomposition done. (took in total 4.86949 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27913 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.66 MB) GRAVTREE: Tree construction done. took 16.9428 sec =968696 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995181 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.64 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.236 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1388, Time: 0.550259, Redshift: 0.817325, Systemstep: 0.000465392, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1388). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77478 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07587|1.04768 DOMAIN: combining multiple-domains took 0.283624 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.23827 sec) DOMAIN: domain decomposition done. (took in total 4.68397 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26919 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.66 MB) GRAVTREE: Tree construction done. took 16.9382 sec =968770 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995182 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.64 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.182 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 2212.57 sec, total size 352287 MB, corresponds to effective I/O rate of 159.221 MB/sec Sync-Point 1389, Time: 0.550725, Redshift: 0.815788, Systemstep: 0.000465786, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1389). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.07671 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07588|1.04768 DOMAIN: combining multiple-domains took 0.283143 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11157 sec) DOMAIN: domain decomposition done. (took in total 4.91406 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27432 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.66 MB) GRAVTREE: Tree construction done. took 16.9392 sec =968837 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995182 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.64 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.518 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1390, Time: 0.551191, Redshift: 0.814252, Systemstep: 0.000466181, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1390). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77083 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07591|1.04768 DOMAIN: combining multiple-domains took 0.284919 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.48314 sec) DOMAIN: domain decomposition done. (took in total 5.92581 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25649 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.66 MB) GRAVTREE: Tree construction done. took 16.9608 sec =968881 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995182 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.64 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.077 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27343 sec PM-PERIODIC: done. (took 13.9049 seconds) TIMESTEPS: displacement time constraint: 0.0060795 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25758 sec PM-PERIODIC: done. (took 14.1426 seconds) TIMESTEPS: displacement time constraint: 0.00607951 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1391, Time: 0.551658, Redshift: 0.812718, Systemstep: 0.000466575, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1391). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77113 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07593|1.04768 DOMAIN: combining multiple-domains took 0.282599 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21278 sec) DOMAIN: domain decomposition done. (took in total 5.65328 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22912 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.66 MB) GRAVTREE: Tree construction done. took 16.9564 sec =968925 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995182 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.65 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 257.966 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1392, Time: 0.552125, Redshift: 0.811185, Systemstep: 0.00046697, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1392). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.92472 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07596|1.04768 DOMAIN: combining multiple-domains took 0.285871 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.6378 sec) DOMAIN: domain decomposition done. (took in total 6.27098 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22422 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1811.67 MB) GRAVTREE: Tree construction done. took 17.0406 sec =968971 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995183 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1860.65 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 257.658 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1393, Time: 0.552592, Redshift: 0.809653, Systemstep: 0.000467365, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1393). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77079 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09511|1.02124 DOMAIN: combining multiple-domains took 0.283105 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.9858 sec) DOMAIN: domain decomposition done. (took in total 16.4264 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17003 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.92 MB) GRAVTREE: Tree construction done. took 17.3961 sec =969048 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995183 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.78 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.196 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1394, Time: 0.55306, Redshift: 0.808122, Systemstep: 0.000467761, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1394). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88489 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09524|1.02124 DOMAIN: combining multiple-domains took 0.41163 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.36725 sec) DOMAIN: domain decomposition done. (took in total 5.05685 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32186 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.94 MB) GRAVTREE: Tree construction done. took 17.278 sec =969091 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995183 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.8 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.957 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30533 sec PM-PERIODIC: done. (took 13.934 seconds) TIMESTEPS: displacement time constraint: 0.00607066 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35646 sec PM-PERIODIC: done. (took 13.6547 seconds) TIMESTEPS: displacement time constraint: 0.00607066 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1395, Time: 0.553528, Redshift: 0.806593, Systemstep: 0.000468157, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1395). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80621 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08718|1.01559 DOMAIN: combining multiple-domains took 0.298559 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 14.7474 sec) DOMAIN: domain decomposition done. (took in total 17.2452 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30823 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.1623 sec =969160 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995183 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.48 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.467 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1396, Time: 0.553997, Redshift: 0.805065, Systemstep: 0.000468553, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1396). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79868 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08722|1.01559 DOMAIN: combining multiple-domains took 0.286499 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.62719 sec) DOMAIN: domain decomposition done. (took in total 6.10361 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27992 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.1543 sec =969194 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995184 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.49 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.314 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1397, Time: 0.554466, Redshift: 0.803538, Systemstep: 0.00046895, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1397). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79589 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08723|1.01559 DOMAIN: combining multiple-domains took 0.287173 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34915 sec) DOMAIN: domain decomposition done. (took in total 5.82306 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21051 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.1576 sec =969254 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995184 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.49 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.706 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1398, Time: 0.554935, Redshift: 0.802013, Systemstep: 0.000469347, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1398). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79057 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08726|1.01559 DOMAIN: combining multiple-domains took 0.286281 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12318 sec) DOMAIN: domain decomposition done. (took in total 4.59078 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28269 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.1614 sec =969302 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995184 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.49 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.467 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2183 sec PM-PERIODIC: done. (took 13.3209 seconds) TIMESTEPS: displacement time constraint: 0.00605946 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36492 sec PM-PERIODIC: done. (took 13.5748 seconds) TIMESTEPS: displacement time constraint: 0.00605946 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1399, Time: 0.555405, Redshift: 0.800489, Systemstep: 0.000469744, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1399). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78878 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08728|1.01559 DOMAIN: combining multiple-domains took 0.286536 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1537 sec) DOMAIN: domain decomposition done. (took in total 5.6203 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22154 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.3144 sec =969359 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995184 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 256.557 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1400, Time: 0.555875, Redshift: 0.798966, Systemstep: 0.000470142, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1400). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78837 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0873|1.01559 DOMAIN: combining multiple-domains took 0.286301 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.89084 sec) DOMAIN: domain decomposition done. (took in total 6.35618 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23862 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.1528 sec =969397 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995185 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.476 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1401, Time: 0.556345, Redshift: 0.797445, Systemstep: 0.00047054, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1401). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78723 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08734|1.01559 DOMAIN: combining multiple-domains took 0.287597 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.0383 sec) DOMAIN: domain decomposition done. (took in total 5.50317 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28758 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.151 sec =969449 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995185 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.138 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1402, Time: 0.556816, Redshift: 0.795924, Systemstep: 0.000470938, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1402). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79059 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08738|1.01559 DOMAIN: combining multiple-domains took 0.28708 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.9731 sec) DOMAIN: domain decomposition done. (took in total 6.44144 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24776 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.1463 sec =969484 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995185 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 257.74 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17345 sec PM-PERIODIC: done. (took 13.535 seconds) TIMESTEPS: displacement time constraint: 0.00607511 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21162 sec PM-PERIODIC: done. (took 13.7891 seconds) TIMESTEPS: displacement time constraint: 0.00607511 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1403, Time: 0.557288, Redshift: 0.794405, Systemstep: 0.000471337, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1403). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78983 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0874|1.01559 DOMAIN: combining multiple-domains took 0.285725 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98473 sec) DOMAIN: domain decomposition done. (took in total 5.45124 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26056 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.1574 sec =969533 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995185 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.674 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1404, Time: 0.557759, Redshift: 0.792888, Systemstep: 0.000471736, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1404). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7965 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08743|1.01559 DOMAIN: combining multiple-domains took 0.286625 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.94387 sec) DOMAIN: domain decomposition done. (took in total 5.41728 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27301 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.159 sec =969592 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995186 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.727 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1405, Time: 0.558232, Redshift: 0.791371, Systemstep: 0.000472135, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1405). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79313 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08746|1.01559 DOMAIN: combining multiple-domains took 0.286172 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43637 sec) DOMAIN: domain decomposition done. (took in total 5.90685 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28755 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.1648 sec =969635 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995186 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.992 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1713.19 sec, total size 352287 MB, corresponds to effective I/O rate of 205.632 MB/sec Sync-Point 1406, Time: 0.558704, Redshift: 0.789856, Systemstep: 0.000472535, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1406). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79588 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08748|1.01559 DOMAIN: combining multiple-domains took 0.297951 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20433 sec) DOMAIN: domain decomposition done. (took in total 7.99071 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26368 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.9299 sec =969686 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995186 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 256.649 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.49839 sec PM-PERIODIC: done. (took 13.6028 seconds) TIMESTEPS: displacement time constraint: 0.00606746 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2243 sec PM-PERIODIC: done. (took 13.3428 seconds) TIMESTEPS: displacement time constraint: 0.00606747 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1407, Time: 0.559177, Redshift: 0.788342, Systemstep: 0.000472935, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1407). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79497 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08751|1.01559 DOMAIN: combining multiple-domains took 0.286305 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.80874 sec) DOMAIN: domain decomposition done. (took in total 6.29934 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25756 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.1554 sec =969745 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995186 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.54 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 257.388 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1408, Time: 0.55965, Redshift: 0.78683, Systemstep: 0.000473335, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1408). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79638 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07955|1.04768 DOMAIN: combining multiple-domains took 0.286232 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.0552 sec) DOMAIN: domain decomposition done. (took in total 14.5295 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.05032 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.09 MB) GRAVTREE: Tree construction done. took 17.0231 sec =969824 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995187 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.24 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.923 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1409, Time: 0.560124, Redshift: 0.785319, Systemstep: 0.000473736, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1409). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7762 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.07951|1.04768 DOMAIN: combining multiple-domains took 0.287442 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.78872 sec) DOMAIN: domain decomposition done. (took in total 5.24077 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23981 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.09 MB) GRAVTREE: Tree construction done. took 17.1084 sec =969882 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995187 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.23 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.687 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1410, Time: 0.560598, Redshift: 0.783809, Systemstep: 0.000474137, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1410). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77413 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08231|1.04768 DOMAIN: combining multiple-domains took 0.288502 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.75955 sec) DOMAIN: domain decomposition done. (took in total 6.20987 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.45675 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.41 MB) GRAVTREE: Tree construction done. took 17.0557 sec =969925 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995187 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.69 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.628 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2158 sec PM-PERIODIC: done. (took 13.2229 seconds) TIMESTEPS: displacement time constraint: 0.00607531 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25184 sec PM-PERIODIC: done. (took 13.8963 seconds) TIMESTEPS: displacement time constraint: 0.00607532 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1411, Time: 0.561073, Redshift: 0.7823, Systemstep: 0.000474538, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1411). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77807 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08232|1.04768 DOMAIN: combining multiple-domains took 0.284274 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.67634 sec) DOMAIN: domain decomposition done. (took in total 5.12686 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26138 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.42 MB) GRAVTREE: Tree construction done. took 17.0803 sec =969981 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995188 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.69 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 259.318 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1412, Time: 0.561548, Redshift: 0.780793, Systemstep: 0.00047494, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1412). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77725 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08232|1.04768 DOMAIN: combining multiple-domains took 0.30654 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.6574 sec) DOMAIN: domain decomposition done. (took in total 6.13082 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21021 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.42 MB) GRAVTREE: Tree construction done. took 17.0873 sec =970039 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995188 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.69 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.279 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1413, Time: 0.562023, Redshift: 0.779286, Systemstep: 0.000475342, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1413). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78418 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08233|1.04768 DOMAIN: combining multiple-domains took 0.28486 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07298 sec) DOMAIN: domain decomposition done. (took in total 4.53037 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26539 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.42 MB) GRAVTREE: Tree construction done. took 17.0809 sec =970082 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995188 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.69 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.867 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1414, Time: 0.562499, Redshift: 0.777782, Systemstep: 0.000475744, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1414). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86786 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08237|1.04768 DOMAIN: combining multiple-domains took 2.82077 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.2985 sec) DOMAIN: domain decomposition done. (took in total 7.42891 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26956 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.42 MB) GRAVTREE: Tree construction done. took 18.477 sec =970125 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995188 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.948 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22194 sec PM-PERIODIC: done. (took 13.2595 seconds) TIMESTEPS: displacement time constraint: 0.00609448 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19866 sec PM-PERIODIC: done. (took 13.8131 seconds) TIMESTEPS: displacement time constraint: 0.00609448 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1415, Time: 0.562975, Redshift: 0.776278, Systemstep: 0.000476147, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1415). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78123 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0824|1.04768 DOMAIN: combining multiple-domains took 0.286388 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.3037 sec) DOMAIN: domain decomposition done. (took in total 5.75992 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17007 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.43 MB) GRAVTREE: Tree construction done. took 17.0799 sec =970181 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995189 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.37 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1416, Time: 0.563451, Redshift: 0.774776, Systemstep: 0.00047655, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1416). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77701 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08782|1.01559 DOMAIN: combining multiple-domains took 0.285862 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1618 sec) DOMAIN: domain decomposition done. (took in total 14.6134 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.99414 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.1534 sec =970218 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995189 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.94 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1417, Time: 0.563928, Redshift: 0.773275, Systemstep: 0.000476953, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1417). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 3.50079 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08787|1.01559 DOMAIN: combining multiple-domains took 0.28884 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90746 sec) DOMAIN: domain decomposition done. (took in total 7.08804 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21505 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.1566 sec =970278 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995189 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.671 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1418, Time: 0.564406, Redshift: 0.771775, Systemstep: 0.000477357, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1418). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78923 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08789|1.01559 DOMAIN: combining multiple-domains took 0.309863 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.5682 sec) DOMAIN: domain decomposition done. (took in total 6.05831 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26789 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.149 sec =970351 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995189 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 257.99 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17313 sec PM-PERIODIC: done. (took 15.5324 seconds) TIMESTEPS: displacement time constraint: 0.00609921 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18124 sec PM-PERIODIC: done. (took 13.3035 seconds) TIMESTEPS: displacement time constraint: 0.00609921 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1419, Time: 0.564884, Redshift: 0.770276, Systemstep: 0.000477761, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1419). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78613 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08791|1.01559 DOMAIN: combining multiple-domains took 0.416432 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21161 sec) DOMAIN: domain decomposition done. (took in total 5.80488 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28124 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.1524 sec =970422 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99519 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.784 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1420, Time: 0.565362, Redshift: 0.768779, Systemstep: 0.000478165, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1420). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79359 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08796|1.01559 DOMAIN: combining multiple-domains took 0.286475 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35824 sec) DOMAIN: domain decomposition done. (took in total 5.82956 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26117 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.1384 sec =970466 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99519 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.61 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 258.129 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1421, Time: 0.56584, Redshift: 0.767283, Systemstep: 0.00047857, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1421). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78812 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08799|1.01559 DOMAIN: combining multiple-domains took 0.285908 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11256 sec) DOMAIN: domain decomposition done. (took in total 5.57733 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24583 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.1339 sec =970540 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99519 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.61 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 257.881 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1422, Time: 0.566319, Redshift: 0.765788, Systemstep: 0.000478975, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1422). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82708 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.088|1.04768 DOMAIN: combining multiple-domains took 0.286368 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.8523 sec) DOMAIN: domain decomposition done. (took in total 15.3884 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.08421 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.07 sec =970571 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99519 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.162 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26605 sec PM-PERIODIC: done. (took 13.3656 seconds) TIMESTEPS: displacement time constraint: 0.00613094 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28284 sec PM-PERIODIC: done. (took 13.7579 seconds) TIMESTEPS: displacement time constraint: 0.00613094 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1423, Time: 0.566799, Redshift: 0.764295, Systemstep: 0.000479381, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1423). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78566 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08796|1.04768 DOMAIN: combining multiple-domains took 0.286405 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47323 sec) DOMAIN: domain decomposition done. (took in total 5.93418 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25823 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.1476 sec =970656 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995191 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.61 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.805 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1424, Time: 0.567278, Redshift: 0.762803, Systemstep: 0.000479787, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1424). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83304 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08793|1.04768 DOMAIN: combining multiple-domains took 0.303134 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.70094 sec) DOMAIN: domain decomposition done. (took in total 5.22585 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24239 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.0419 sec =970713 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995191 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.103 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1567.61 sec, total size 352287 MB, corresponds to effective I/O rate of 224.728 MB/sec Sync-Point 1425, Time: 0.567759, Redshift: 0.761312, Systemstep: 0.000480193, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1425). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87377 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08788|1.04768 DOMAIN: combining multiple-domains took 0.286374 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.82162 sec) DOMAIN: domain decomposition done. (took in total 6.37359 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19103 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.0465 sec =970773 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995191 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.782 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1426, Time: 0.568239, Redshift: 0.759822, Systemstep: 0.000480599, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1426). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80964 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08784|1.04768 DOMAIN: combining multiple-domains took 0.297571 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11656 sec) DOMAIN: domain decomposition done. (took in total 5.61433 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25505 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.2083 sec =970808 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995192 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.7 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24699 sec PM-PERIODIC: done. (took 13.5442 seconds) TIMESTEPS: displacement time constraint: 0.00615267 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.1669 sec PM-PERIODIC: done. (took 13.647 seconds) TIMESTEPS: displacement time constraint: 0.00615267 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1427, Time: 0.56872, Redshift: 0.758334, Systemstep: 0.000481006, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1427). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7799 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08783|1.04768 DOMAIN: combining multiple-domains took 0.290833 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73569 sec) DOMAIN: domain decomposition done. (took in total 5.19624 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25011 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.0631 sec =970861 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995192 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.771 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1428, Time: 0.569202, Redshift: 0.756847, Systemstep: 0.000481413, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1428). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78303 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08779|1.04768 DOMAIN: combining multiple-domains took 0.289298 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38241 sec) DOMAIN: domain decomposition done. (took in total 5.84441 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2587 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.0784 sec =970911 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995192 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.161 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1429, Time: 0.569683, Redshift: 0.755361, Systemstep: 0.000481821, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1429). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78767 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08774|1.04768 DOMAIN: combining multiple-domains took 0.288846 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.86498 sec) DOMAIN: domain decomposition done. (took in total 6.33199 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23139 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.0984 sec =970933 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995192 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.663 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1430, Time: 0.570166, Redshift: 0.753876, Systemstep: 0.000482229, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1430). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.09271 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0877|1.04768 DOMAIN: combining multiple-domains took 0.291217 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21495 sec) DOMAIN: domain decomposition done. (took in total 6.02743 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26458 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.1033 sec =970975 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995192 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.602 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18635 sec PM-PERIODIC: done. (took 13.7168 seconds) TIMESTEPS: displacement time constraint: 0.00618587 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19681 sec PM-PERIODIC: done. (took 13.5487 seconds) TIMESTEPS: displacement time constraint: 0.00618587 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1431, Time: 0.570648, Redshift: 0.752393, Systemstep: 0.000482637, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1431). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79172 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08712|1.04768 DOMAIN: combining multiple-domains took 0.29126 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22091 sec) DOMAIN: domain decomposition done. (took in total 5.69365 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3012 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.98 MB) GRAVTREE: Tree construction done. took 17.1154 sec =971041 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995193 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.47 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.955 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1432, Time: 0.571131, Redshift: 0.750911, Systemstep: 0.000483045, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1432). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78435 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08716|1.04768 DOMAIN: combining multiple-domains took 0.286258 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26716 sec) DOMAIN: domain decomposition done. (took in total 5.72726 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25386 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.1093 sec =971102 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995193 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.48 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.681 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1433, Time: 0.571615, Redshift: 0.74943, Systemstep: 0.000483454, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1433). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79505 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0872|1.04768 DOMAIN: combining multiple-domains took 0.287932 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.85761 sec) DOMAIN: domain decomposition done. (took in total 6.33031 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27221 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.1048 sec =971172 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995193 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.49 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.603 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1434, Time: 0.572099, Redshift: 0.74795, Systemstep: 0.000483863, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1434). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78934 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08725|1.04768 DOMAIN: combining multiple-domains took 0.288578 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.13673 sec) DOMAIN: domain decomposition done. (took in total 6.60544 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25102 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.0974 sec =971232 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995194 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.49 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.726 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21791 sec PM-PERIODIC: done. (took 13.804 seconds) TIMESTEPS: displacement time constraint: 0.00622111 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23584 sec PM-PERIODIC: done. (took 13.6432 seconds) TIMESTEPS: displacement time constraint: 0.00622111 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1435, Time: 0.572583, Redshift: 0.746472, Systemstep: 0.000484273, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1435). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87151 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08728|1.04768 DOMAIN: combining multiple-domains took 0.396841 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.53015 sec) DOMAIN: domain decomposition done. (took in total 6.18885 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25115 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.1109 sec =971273 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995194 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.408 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1436, Time: 0.573068, Redshift: 0.744995, Systemstep: 0.000484683, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1436). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7901 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08732|1.04768 DOMAIN: combining multiple-domains took 0.287329 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31177 sec) DOMAIN: domain decomposition done. (took in total 5.77874 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32071 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.1221 sec =971328 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995194 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.34 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1437, Time: 0.573553, Redshift: 0.743519, Systemstep: 0.000485093, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1437). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78894 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08736|1.04768 DOMAIN: combining multiple-domains took 0.287593 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18679 sec) DOMAIN: domain decomposition done. (took in total 5.65294 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24342 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.1362 sec =971392 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995195 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.819 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1438, Time: 0.574038, Redshift: 0.742044, Systemstep: 0.000485504, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1438). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7862 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08739|1.04768 DOMAIN: combining multiple-domains took 0.285946 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.37567 sec) DOMAIN: domain decomposition done. (took in total 5.84241 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22622 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.1184 sec =971449 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995195 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.946 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21116 sec PM-PERIODIC: done. (took 13.4217 seconds) TIMESTEPS: displacement time constraint: 0.00624492 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2487 sec PM-PERIODIC: done. (took 13.9821 seconds) TIMESTEPS: displacement time constraint: 0.00624492 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1439, Time: 0.574524, Redshift: 0.740571, Systemstep: 0.000485915, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1439). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78141 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08741|1.04768 DOMAIN: combining multiple-domains took 0.286185 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37067 sec) DOMAIN: domain decomposition done. (took in total 4.82774 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29031 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.1193 sec =971485 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995195 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.598 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1440, Time: 0.57501, Redshift: 0.739099, Systemstep: 0.000486326, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1440). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78455 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08745|1.04768 DOMAIN: combining multiple-domains took 0.285731 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.57071 sec) DOMAIN: domain decomposition done. (took in total 5.03067 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30668 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.1234 sec =971524 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995195 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.166 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1441, Time: 0.575497, Redshift: 0.737628, Systemstep: 0.000486738, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1441). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78076 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08747|1.04768 DOMAIN: combining multiple-domains took 0.286837 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.76318 sec) DOMAIN: domain decomposition done. (took in total 5.22012 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28386 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.1139 sec =971572 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995195 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.084 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1442, Time: 0.575984, Redshift: 0.736158, Systemstep: 0.00048715, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1442). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78218 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08752|1.04768 DOMAIN: combining multiple-domains took 0.286438 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21861 sec) DOMAIN: domain decomposition done. (took in total 4.67706 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31355 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.1129 sec =971650 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995196 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.54 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.708 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20461 sec PM-PERIODIC: done. (took 13.3982 seconds) TIMESTEPS: displacement time constraint: 0.0062731 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21532 sec PM-PERIODIC: done. (took 13.9986 seconds) TIMESTEPS: displacement time constraint: 0.0062731 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1443, Time: 0.576472, Redshift: 0.73469, Systemstep: 0.000487562, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1443). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77992 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08756|1.04768 DOMAIN: combining multiple-domains took 0.288046 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31665 sec) DOMAIN: domain decomposition done. (took in total 5.77393 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27091 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.1277 sec =971676 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995196 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.54 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.497 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 2067.3 sec, total size 352287 MB, corresponds to effective I/O rate of 170.409 MB/sec Sync-Point 1444, Time: 0.57696, Redshift: 0.733223, Systemstep: 0.000487975, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1444). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78426 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08758|1.04768 DOMAIN: combining multiple-domains took 0.287201 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.54038 sec) DOMAIN: domain decomposition done. (took in total 5.00354 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28586 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.1377 sec =971718 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995196 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.048 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1445, Time: 0.577448, Redshift: 0.731757, Systemstep: 0.000488388, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1445). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7784 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08761|1.04768 DOMAIN: combining multiple-domains took 0.287395 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21278 sec) DOMAIN: domain decomposition done. (took in total 4.6691 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2983 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.1546 sec =971776 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995196 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.842 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1446, Time: 0.577937, Redshift: 0.730292, Systemstep: 0.000488801, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1446). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77981 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08761|1.04768 DOMAIN: combining multiple-domains took 0.284951 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45655 sec) DOMAIN: domain decomposition done. (took in total 5.91107 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28734 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.1311 sec =971833 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995197 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.637 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.12237 sec PM-PERIODIC: done. (took 13.3579 seconds) TIMESTEPS: displacement time constraint: 0.00630977 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18505 sec PM-PERIODIC: done. (took 14.1664 seconds) TIMESTEPS: displacement time constraint: 0.00630977 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1447, Time: 0.578426, Redshift: 0.728829, Systemstep: 0.000489215, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1447). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77877 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08764|1.04768 DOMAIN: combining multiple-domains took 0.284598 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.51784 sec) DOMAIN: domain decomposition done. (took in total 5.97115 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30414 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.1267 sec =971903 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995197 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.56 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.011 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1448, Time: 0.578916, Redshift: 0.727367, Systemstep: 0.000489629, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1448). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77874 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08766|1.04768 DOMAIN: combining multiple-domains took 0.285824 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37147 sec) DOMAIN: domain decomposition done. (took in total 4.82589 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3022 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.2129 sec =971961 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995197 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.56 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.715 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1449, Time: 0.579406, Redshift: 0.725906, Systemstep: 0.000490044, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1449). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78103 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0877|1.04768 DOMAIN: combining multiple-domains took 0.28736 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.30444 sec) DOMAIN: domain decomposition done. (took in total 4.76256 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32548 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.1406 sec =971997 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995198 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.67 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1450, Time: 0.579896, Redshift: 0.724446, Systemstep: 0.000490458, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1450). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77971 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08773|1.04768 DOMAIN: combining multiple-domains took 0.285604 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29386 sec) DOMAIN: domain decomposition done. (took in total 5.74838 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29097 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.1247 sec =972035 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995198 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.541 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29028 sec PM-PERIODIC: done. (took 13.2329 seconds) TIMESTEPS: displacement time constraint: 0.00633348 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20455 sec PM-PERIODIC: done. (took 13.5827 seconds) TIMESTEPS: displacement time constraint: 0.00633348 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1451, Time: 0.580387, Redshift: 0.722987, Systemstep: 0.000490874, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1451). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78309 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08776|1.04768 DOMAIN: combining multiple-domains took 0.292553 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.54698 sec) DOMAIN: domain decomposition done. (took in total 7.01235 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22732 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.64 sec =972091 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995198 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.938 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1452, Time: 0.580879, Redshift: 0.72153, Systemstep: 0.000491289, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1452). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7842 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08779|1.04768 DOMAIN: combining multiple-domains took 2.3572 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.3662 sec) DOMAIN: domain decomposition done. (took in total 9.06737 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30484 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.1556 sec =972138 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995198 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.995 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1453, Time: 0.58137, Redshift: 0.720074, Systemstep: 0.000491705, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1453). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 3.87895 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08779|1.04768 DOMAIN: combining multiple-domains took 0.28626 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.24673 sec) DOMAIN: domain decomposition done. (took in total 10.9794 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29598 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 18.4023 sec =972196 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995199 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.936 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1454, Time: 0.581862, Redshift: 0.718619, Systemstep: 0.000492121, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1454). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78242 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0882|1.04768 DOMAIN: combining multiple-domains took 0.285938 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.44169 sec) DOMAIN: domain decomposition done. (took in total 6.89999 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.44338 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.11 MB) GRAVTREE: Tree construction done. took 17.1897 sec =972254 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995199 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.65 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.682 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17625 sec PM-PERIODIC: done. (took 13.0967 seconds) TIMESTEPS: displacement time constraint: 0.00637727 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25731 sec PM-PERIODIC: done. (took 13.5939 seconds) TIMESTEPS: displacement time constraint: 0.00637726 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1455, Time: 0.582355, Redshift: 0.717166, Systemstep: 0.000492538, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1455). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79381 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08822|1.04768 DOMAIN: combining multiple-domains took 0.289996 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31179 sec) DOMAIN: domain decomposition done. (took in total 5.78654 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24136 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.11 MB) GRAVTREE: Tree construction done. took 17.2002 sec =972277 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995199 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.65 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.604 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1456, Time: 0.582848, Redshift: 0.715713, Systemstep: 0.000492955, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1456). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79534 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08825|1.04768 DOMAIN: combining multiple-domains took 0.292832 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.00489 sec) DOMAIN: domain decomposition done. (took in total 4.48404 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29288 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.11 MB) GRAVTREE: Tree construction done. took 17.1896 sec =972340 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995199 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.66 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.386 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1457, Time: 0.583341, Redshift: 0.714262, Systemstep: 0.000493372, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1457). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86595 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08829|1.04768 DOMAIN: combining multiple-domains took 0.411493 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49067 sec) DOMAIN: domain decomposition done. (took in total 6.15948 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23543 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.1986 sec =972399 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9952 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.66 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.52 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1458, Time: 0.583835, Redshift: 0.712812, Systemstep: 0.00049379, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1458). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79963 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09079|1.02124 DOMAIN: combining multiple-domains took 0.289833 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7524 sec) DOMAIN: domain decomposition done. (took in total 15.2336 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.37055 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.41 MB) GRAVTREE: Tree construction done. took 17.2583 sec =972448 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9952 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.07 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.837 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26004 sec PM-PERIODIC: done. (took 13.7642 seconds) TIMESTEPS: displacement time constraint: 0.00640309 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24346 sec PM-PERIODIC: done. (took 13.3434 seconds) TIMESTEPS: displacement time constraint: 0.00640309 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1459, Time: 0.584329, Redshift: 0.711364, Systemstep: 0.000494208, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1459). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80856 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09483|1.01982 DOMAIN: combining multiple-domains took 0.289289 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1696 sec) DOMAIN: domain decomposition done. (took in total 14.6605 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.06041 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.89 MB) GRAVTREE: Tree construction done. took 17.21 sec =972497 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9952 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.73 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.519 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1460, Time: 0.584824, Redshift: 0.709916, Systemstep: 0.000494626, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1460). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.07695 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.09233|1.02408 DOMAIN: combining multiple-domains took 0.291387 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4312 sec) DOMAIN: domain decomposition done. (took in total 15.1909 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33419 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.59 MB) GRAVTREE: Tree construction done. took 17.278 sec =972575 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9952 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.32 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 261.193 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1860.56 sec, total size 352287 MB, corresponds to effective I/O rate of 189.344 MB/sec Sync-Point 1461, Time: 0.585319, Redshift: 0.70847, Systemstep: 0.000495045, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1461). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7948 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.09236|1.02408 DOMAIN: combining multiple-domains took 0.290192 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.40113 sec) DOMAIN: domain decomposition done. (took in total 5.87899 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30664 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.6 MB) GRAVTREE: Tree construction done. took 17.397 sec =972613 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995201 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.33 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 261.808 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1462, Time: 0.585814, Redshift: 0.707025, Systemstep: 0.000495464, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1462). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79642 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09245|1.04768 DOMAIN: combining multiple-domains took 0.287185 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.775 sec) DOMAIN: domain decomposition done. (took in total 15.2515 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.37948 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.61 MB) GRAVTREE: Tree construction done. took 17.2011 sec =972641 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995201 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.964 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.72548 sec PM-PERIODIC: done. (took 13.6479 seconds) TIMESTEPS: displacement time constraint: 0.00642433 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19392 sec PM-PERIODIC: done. (took 13.0624 seconds) TIMESTEPS: displacement time constraint: 0.00642433 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1463, Time: 0.58631, Redshift: 0.705581, Systemstep: 0.000495883, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1463). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.97019 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09246|1.04768 DOMAIN: combining multiple-domains took 0.292223 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31709 sec) DOMAIN: domain decomposition done. (took in total 6.02018 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23938 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.61 MB) GRAVTREE: Tree construction done. took 17.2152 sec =972675 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995201 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.403 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1464, Time: 0.586807, Redshift: 0.704139, Systemstep: 0.000496303, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1464). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79239 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08814|1.04768 DOMAIN: combining multiple-domains took 0.290982 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43782 sec) DOMAIN: domain decomposition done. (took in total 5.9131 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29261 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.1597 sec =972734 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995201 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.615 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1465, Time: 0.587303, Redshift: 0.702698, Systemstep: 0.000496723, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1465). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77996 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08813|1.04768 DOMAIN: combining multiple-domains took 0.288388 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90387 sec) DOMAIN: domain decomposition done. (took in total 5.36238 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28594 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.1608 sec =972783 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995201 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.09 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1466, Time: 0.5878, Redshift: 0.701258, Systemstep: 0.000497143, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1466). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78182 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08817|1.04768 DOMAIN: combining multiple-domains took 0.292984 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.00012 sec) DOMAIN: domain decomposition done. (took in total 5.46596 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30587 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.1602 sec =972841 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995202 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.036 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.14255 sec PM-PERIODIC: done. (took 13.1579 seconds) TIMESTEPS: displacement time constraint: 0.00643735 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19937 sec PM-PERIODIC: done. (took 13.713 seconds) TIMESTEPS: displacement time constraint: 0.00643735 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1467, Time: 0.588298, Redshift: 0.699819, Systemstep: 0.000497564, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1467). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78397 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08835|1.04768 DOMAIN: combining multiple-domains took 0.288113 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.5739 sec) DOMAIN: domain decomposition done. (took in total 6.0361 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.4458 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.2219 sec =972873 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995202 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.598 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1468, Time: 0.588796, Redshift: 0.698381, Systemstep: 0.000497985, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1468). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 3.4354 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08843|1.04768 DOMAIN: combining multiple-domains took 0.290488 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.09547 sec) DOMAIN: domain decomposition done. (took in total 7.21567 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30135 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.2321 sec =972928 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995202 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.96 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1469, Time: 0.589294, Redshift: 0.696945, Systemstep: 0.000498407, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1469). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77659 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08852|1.04768 DOMAIN: combining multiple-domains took 0.290511 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45211 sec) DOMAIN: domain decomposition done. (took in total 5.90953 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28952 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.1833 sec =972973 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995202 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.883 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1470, Time: 0.589793, Redshift: 0.695509, Systemstep: 0.000498829, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1470). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79874 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08861|1.04768 DOMAIN: combining multiple-domains took 0.293136 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26245 sec) DOMAIN: domain decomposition done. (took in total 4.74684 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27264 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2131 sec =973029 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995203 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.263 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.48776 sec PM-PERIODIC: done. (took 13.6629 seconds) TIMESTEPS: displacement time constraint: 0.00646309 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24715 sec PM-PERIODIC: done. (took 13.208 seconds) TIMESTEPS: displacement time constraint: 0.00646309 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1471, Time: 0.590293, Redshift: 0.694075, Systemstep: 0.000499251, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1471). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.10597 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08869|1.04768 DOMAIN: combining multiple-domains took 0.291338 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.70847 sec) DOMAIN: domain decomposition done. (took in total 6.54118 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27087 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.17 MB) GRAVTREE: Tree construction done. took 17.2306 sec =973089 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995203 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.73 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.221 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1472, Time: 0.590792, Redshift: 0.692643, Systemstep: 0.000499674, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1472). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79474 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08878|1.04768 DOMAIN: combining multiple-domains took 0.290232 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.15168 sec) DOMAIN: domain decomposition done. (took in total 4.62759 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28952 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.18 MB) GRAVTREE: Tree construction done. took 17.2293 sec =973111 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995203 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.74 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.516 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1473, Time: 0.591292, Redshift: 0.691211, Systemstep: 0.000500097, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1473). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79894 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08886|1.04768 DOMAIN: combining multiple-domains took 0.293346 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.25169 sec) DOMAIN: domain decomposition done. (took in total 4.73582 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28082 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.19 MB) GRAVTREE: Tree construction done. took 17.3256 sec =973150 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995203 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.76 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.576 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1474, Time: 0.591793, Redshift: 0.689781, Systemstep: 0.00050052, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1474). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78772 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08896|1.04768 DOMAIN: combining multiple-domains took 0.292548 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41408 sec) DOMAIN: domain decomposition done. (took in total 5.88542 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25587 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.3754 sec =973199 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995203 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.77 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.689 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18405 sec PM-PERIODIC: done. (took 13.1474 seconds) TIMESTEPS: displacement time constraint: 0.00647585 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.58429 sec PM-PERIODIC: done. (took 13.5332 seconds) TIMESTEPS: displacement time constraint: 0.00647585 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1475, Time: 0.592294, Redshift: 0.688351, Systemstep: 0.000500944, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1475). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79257 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08903|1.04768 DOMAIN: combining multiple-domains took 0.291026 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.32725 sec) DOMAIN: domain decomposition done. (took in total 6.80196 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28858 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.2425 sec =973250 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995204 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.938 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1476, Time: 0.592795, Redshift: 0.686923, Systemstep: 0.000501368, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1476). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79422 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08948|1.01559 DOMAIN: combining multiple-domains took 0.291358 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1377 sec) DOMAIN: domain decomposition done. (took in total 14.6137 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.98033 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 17.2259 sec =973306 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995204 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.918 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1477, Time: 0.593297, Redshift: 0.685497, Systemstep: 0.000501792, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1477). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78971 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08951|1.01559 DOMAIN: combining multiple-domains took 0.285844 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22176 sec) DOMAIN: domain decomposition done. (took in total 4.68786 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28904 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.26 MB) GRAVTREE: Tree construction done. took 17.2191 sec =973346 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995204 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.172 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1478, Time: 0.593799, Redshift: 0.684071, Systemstep: 0.000502217, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1478). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79451 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08957|1.01559 DOMAIN: combining multiple-domains took 0.286824 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89354 sec) DOMAIN: domain decomposition done. (took in total 5.36629 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22314 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 17.2284 sec =973406 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995204 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.87 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.962 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32752 sec PM-PERIODIC: done. (took 16.6331 seconds) TIMESTEPS: displacement time constraint: 0.0065284 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24175 sec PM-PERIODIC: done. (took 13.2564 seconds) TIMESTEPS: displacement time constraint: 0.0065284 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1129.42 sec, total size 352287 MB, corresponds to effective I/O rate of 311.919 MB/sec Sync-Point 1479, Time: 0.594302, Redshift: 0.682647, Systemstep: 0.000502642, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1479). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79593 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0896|1.01559 DOMAIN: combining multiple-domains took 0.285228 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.27999 sec) DOMAIN: domain decomposition done. (took in total 5.7526 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25731 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.27 MB) GRAVTREE: Tree construction done. took 17.3267 sec =973438 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995205 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.71 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1480, Time: 0.594805, Redshift: 0.681224, Systemstep: 0.000503068, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1480). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79621 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08964|1.01559 DOMAIN: combining multiple-domains took 0.287493 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.28013 sec) DOMAIN: domain decomposition done. (took in total 4.75586 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28805 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 17.2297 sec =973495 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995205 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.88 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.81 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1481, Time: 0.595308, Redshift: 0.679802, Systemstep: 0.000503493, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1481). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.23986 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08967|1.01559 DOMAIN: combining multiple-domains took 0.296719 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15349 sec) DOMAIN: domain decomposition done. (took in total 6.08452 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25376 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.28 MB) GRAVTREE: Tree construction done. took 17.227 sec =973551 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995205 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.89 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.644 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1482, Time: 0.595812, Redshift: 0.678381, Systemstep: 0.00050392, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1482). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78951 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08972|1.01559 DOMAIN: combining multiple-domains took 0.29786 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.3128 sec) DOMAIN: domain decomposition done. (took in total 5.7914 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28139 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 17.2287 sec =973608 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995205 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.9 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.469 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30173 sec PM-PERIODIC: done. (took 14.6495 seconds) TIMESTEPS: displacement time constraint: 0.00652706 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17077 sec PM-PERIODIC: done. (took 13.373 seconds) TIMESTEPS: displacement time constraint: 0.00652705 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1483, Time: 0.596317, Redshift: 0.676962, Systemstep: 0.000504346, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1483). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79616 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08974|1.01559 DOMAIN: combining multiple-domains took 0.288493 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.38211 sec) DOMAIN: domain decomposition done. (took in total 4.85827 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27209 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 17.3385 sec =973662 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995206 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.9 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.567 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1484, Time: 0.596821, Redshift: 0.675543, Systemstep: 0.000504773, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1484). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78734 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0898|1.01559 DOMAIN: combining multiple-domains took 0.287256 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05191 sec) DOMAIN: domain decomposition done. (took in total 4.51831 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29089 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 17.2341 sec =973715 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995206 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 260.327 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1485, Time: 0.597327, Redshift: 0.674126, Systemstep: 0.0005052, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1485). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79298 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08981|1.01559 DOMAIN: combining multiple-domains took 0.287937 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20744 sec) DOMAIN: domain decomposition done. (took in total 5.68003 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2651 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 17.2403 sec =973749 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995206 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.747 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1486, Time: 0.597832, Redshift: 0.67271, Systemstep: 0.000505628, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1486). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.90366 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09018|1.04768 DOMAIN: combining multiple-domains took 0.297178 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4367 sec) DOMAIN: domain decomposition done. (took in total 15.0288 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.07171 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 17.3187 sec =973813 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995206 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.085 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.5823 sec PM-PERIODIC: done. (took 13.42 seconds) TIMESTEPS: displacement time constraint: 0.00654665 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19673 sec PM-PERIODIC: done. (took 13.1505 seconds) TIMESTEPS: displacement time constraint: 0.00654665 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1487, Time: 0.598338, Redshift: 0.671295, Systemstep: 0.000506056, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1487). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.05237 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09019|1.04768 DOMAIN: combining multiple-domains took 0.290239 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.84345 sec) DOMAIN: domain decomposition done. (took in total 6.62658 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25747 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 17.2439 sec =973853 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995207 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.393 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1488, Time: 0.598845, Redshift: 0.669882, Systemstep: 0.000506484, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1488). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.89067 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09021|1.04768 DOMAIN: combining multiple-domains took 0.398214 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.23793 sec) DOMAIN: domain decomposition done. (took in total 5.91837 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29135 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 17.2291 sec =973899 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995207 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.596 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1489, Time: 0.599352, Redshift: 0.66847, Systemstep: 0.000506913, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1489). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80852 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09023|1.04768 DOMAIN: combining multiple-domains took 0.292662 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.70699 sec) DOMAIN: domain decomposition done. (took in total 5.19923 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23857 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.2439 sec =973938 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995207 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.375 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1490, Time: 0.599859, Redshift: 0.667058, Systemstep: 0.000507342, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1490). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79534 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09026|1.04768 DOMAIN: combining multiple-domains took 0.290599 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.65253 sec) DOMAIN: domain decomposition done. (took in total 6.13267 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26824 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.2878 sec =973985 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995207 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.563 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.15334 sec PM-PERIODIC: done. (took 13.2731 seconds) TIMESTEPS: displacement time constraint: 0.00657524 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29688 sec PM-PERIODIC: done. (took 13.3805 seconds) TIMESTEPS: displacement time constraint: 0.00657524 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1491, Time: 0.600367, Redshift: 0.665649, Systemstep: 0.000507772, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1491). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79709 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09028|1.04768 DOMAIN: combining multiple-domains took 0.291694 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8054 sec) DOMAIN: domain decomposition done. (took in total 5.28479 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29942 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.2531 sec =974051 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995208 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.558 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1492, Time: 0.600875, Redshift: 0.66424, Systemstep: 0.000508201, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1492). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81177 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0903|1.04768 DOMAIN: combining multiple-domains took 0.285967 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.08258 sec) DOMAIN: domain decomposition done. (took in total 6.5721 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27798 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.247 sec =974129 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995208 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.686 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 reaching time-limit. stopping. RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1079.63 sec, total size 352287 MB, corresponds to effective I/O rate of 326.302 MB/sec endrun called, calling MPI_Finalize() bye!