srun: Warning: can't honor --ntasks-per-node set to 16 which doesn't match the requested tasks 24 with the number of requested nodes 24. Ignoring --ntasks-per-node. Shared memory islands host a minimum of 16 and a maximum of 16 MPI ranks. We shall use 24 MPI ranks in total for assisting one-sided communication (1 per shared memory node). ___ __ ____ ___ ____ ____ __ / __) /__\ ( _ \ / __)( ___)(_ _)___ /. | ( (_-. /(__)\ )(_) )( (_-. )__) )( (___)(_ _) \___/(__)(__)(____/ \___/(____) (__) (_) This is Gadget, version 4.0. Git commit 2ed5308cb4e4c756612897b0d764685b32645ece, Sat Nov 5 20:24:26 2022 +0000 Code was compiled with the following compiler and flags: mpicxx -std=c++11 -ggdb -O3 -march=native -Wall -Wno-format-security -Wno-unknown-pragmas -I/cosma/home/dp004/dc-spri1/Libs/include -I../binaries/forward_PM2048_O3_io//build -Isrc Code was compiled with the following settings: ASMTH=1.5 DEBUG_MD5 DISABLE_GRAVCOST DOUBLEPRECISION=1 FORCE_EQUAL_TIMESTEPS IDS_48BIT MULTIPOLE_ORDER=3 NEUTRINOS NEUTRINOS_DELTAF NEUTRINOS_MOVE_WITH_RELATISTIC_VELOCITIES NSOFTCLASSES=1 NTYPES=6 PERIODIC PMGRID=2048 POSITIONS_IN_32BIT PRESERVE_SHMEM_BINARY_INVARIANCE SELFGRAVITY TIMESTEP_FILE_WRITE VELOCITIES_IN_32BIT Running on 360 MPI tasks. BEGRUN: Size of particle structure 160 [bytes] BEGRUN: Size of sph particle structure 192 [bytes] BEGRUN: Size of gravity tree node 120 [bytes] BEGRUN: Size of neighbour tree node 152 [bytes] BEGRUN: Size of subfind auxiliary data 36 [bytes] ------------------------------------------------------------------------------------------------------------------------- AvailMem: Largest = 127766.36 Mb (on task= 255), Smallest = 127523.38 Mb (on task= 0), Average = 127671.43 Mb Total Mem: Largest = 128910.93 Mb (on task= 0), Smallest = 128910.84 Mb (on task= 45), Average = 128910.92 Mb Committed_AS: Largest = 1387.54 Mb (on task= 0), Smallest = 1144.57 Mb (on task= 255), Average = 1239.49 Mb SwapTotal: Largest = 0.00 Mb (on task= 0), Smallest = 0.00 Mb (on task= 0), Average = 0.00 Mb SwapFree: Largest = 0.00 Mb (on task= 0), Smallest = 0.00 Mb (on task= 0), Average = 0.00 Mb AllocMem: Largest = 1387.54 Mb (on task= 0), Smallest = 1144.57 Mb (on task= 255), Average = 1239.49 Mb avail /dev/shm: Largest = 64446.43 Mb (on task= 0), Smallest = 64446.36 Mb (on task= 45), Average = 64446.42 Mb ------------------------------------------------------------------------------------------------------------------------- Task=0 has the maximum commited memory and is host: m5142.pri.cosma7.alces.network ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Obtaining parameters from file 'param.txt': InitCondFile /cosma5/data/durham/dc-elbe1/nubg_new/ICs/NUBG_M060_N1024_6044/ics OutputDir ./output SnapshotFileBase snapshot OutputListFilename ./outputs.txt ICFormat 3 SnapFormat 3 TimeLimitCPU 259200 CpuTimeBetRestartFile 7200 MaxMemSize 4000 TimeBegin 0.03125 TimeMax 1 ComovingIntegrationOn 1 Omega0 0.309693 OmegaLambda 0.688821 OmegaBaryon 0.0489747 HubbleParam 0.6766 BoxSize 676.6 Hubble 100 OmegaCurvature 0 Neutrino_SummedPartMass_in_eV 0.06 NeutrinoNumDegenerateMassiveSpecies 1 NeutrinoNumMasslessSpecies 2.0308 NeutrinoTemperature 1.95176 CMBTemperature 2.7255 ArtBulkViscConst 1 InitGasTemp 1 MinEgySpec 1 OutputListOn 1 TimeBetSnapshot 0 TimeOfFirstSnapshot 0 TimeBetStatistics 0.01 NumFilesPerSnapshot 4 MaxFilesWithConcurrentIO 4 ErrTolIntAccuracy 0.05 CourantFac 0.3 MaxSizeTimestep 0.02 MinSizeTimestep 0 TypeOfOpeningCriterion 0 ErrTolTheta 0.75 ErrTolThetaMax 1 ErrTolForceAcc 0.005 TopNodeFactor 4 ActivePartFracForNewDomainDecomp 0 DesNumNgb 64 MaxNumNgbDeviation 1 UnitLength_in_cm 3.08568e+24 UnitMass_in_g 1.98843e+43 UnitVelocity_in_cm_per_s 100000 GravityConstantInternal 43.0096 SofteningComovingClass0 0.0264297 SofteningMaxPhysClass0 0.0264297 SofteningClassOfPartType0 0 SofteningClassOfPartType1 0 SofteningClassOfPartType2 0 SofteningClassOfPartType3 0 SofteningClassOfPartType4 0 SofteningClassOfPartType5 0 MALLOC: Allocation of shared memory took 0.000562906 sec found 2 times in output-list. BEGRUN: Omega0 = 0.30969270 BEGRUN: OmegaLambda = 0.68882116 BEGRUN: OmegaCurvature = 0.00000000 BEGRUN: OmegaNeutrino = 0.00140720 BEGRUN: OmegaRelNeutrino = 0.00002491 BEGRUN: OmegaRad = 0.00005402 BEGRUN: NeutrinoMatterFraction = 0.00452332 BEGRUN: NeutrinoVelScale = 840.366 BEGRUN: h = 0.6766 BEGRUN: G (internal units) = 43.0096 BEGRUN: G (code units) = 6.67428e-08 BEGRUN: UnitMass_in_g = 1.98843e+43 BEGRUN: UnitLenth_in_cm = 3.08568e+24 BEGRUN: UnitTime_in_s = 3.08568e+19 BEGRUN: UnitVelocity_in_cm_per_s = 100000 BEGRUN: UnitDensity_in_cgs = 6.76799e-31 BEGRUN: UnitEnergy_in_cgs = 1.98844e+53 BEGRUN: OmegaTot - 1 = -0.00000000 RESTART: Loading restart files... RESTART: Loading restart files group #1 out of 90... RESTART: Loading restart files group #2 out of 90... RESTART: Loading restart files group #3 out of 90... RESTART: Loading restart files group #4 out of 90... RESTART: Loading restart files group #5 out of 90... RESTART: Loading restart files group #6 out of 90... RESTART: Loading restart files group #7 out of 90... RESTART: Loading restart files group #8 out of 90... RESTART: Loading restart files group #9 out of 90... RESTART: Loading restart files group #10 out of 90... RESTART: Loading restart files group #11 out of 90... RESTART: Loading restart files group #12 out of 90... RESTART: Loading restart files group #13 out of 90... RESTART: Loading restart files group #14 out of 90... RESTART: Loading restart files group #15 out of 90... RESTART: Loading restart files group #16 out of 90... RESTART: Loading restart files group #17 out of 90... RESTART: Loading restart files group #18 out of 90... RESTART: Loading restart files group #19 out of 90... RESTART: Loading restart files group #20 out of 90... RESTART: Loading restart files group #21 out of 90... RESTART: Loading restart files group #22 out of 90... RESTART: Loading restart files group #23 out of 90... RESTART: Loading restart files group #24 out of 90... RESTART: Loading restart files group #25 out of 90... RESTART: Loading restart files group #26 out of 90... RESTART: Loading restart files group #27 out of 90... RESTART: Loading restart files group #28 out of 90... RESTART: Loading restart files group #29 out of 90... RESTART: Loading restart files group #30 out of 90... RESTART: Loading restart files group #31 out of 90... RESTART: Loading restart files group #32 out of 90... RESTART: Loading restart files group #33 out of 90... RESTART: Loading restart files group #34 out of 90... RESTART: Loading restart files group #35 out of 90... RESTART: Loading restart files group #36 out of 90... RESTART: Loading restart files group #37 out of 90... RESTART: Loading restart files group #38 out of 90... RESTART: Loading restart files group #39 out of 90... RESTART: Loading restart files group #40 out of 90... RESTART: Loading restart files group #41 out of 90... RESTART: Loading restart files group #42 out of 90... RESTART: Loading restart files group #43 out of 90... RESTART: Loading restart files group #44 out of 90... RESTART: Loading restart files group #45 out of 90... RESTART: Loading restart files group #46 out of 90... RESTART: Loading restart files group #47 out of 90... RESTART: Loading restart files group #48 out of 90... RESTART: Loading restart files group #49 out of 90... RESTART: Loading restart files group #50 out of 90... RESTART: Loading restart files group #51 out of 90... RESTART: Loading restart files group #52 out of 90... RESTART: Loading restart files group #53 out of 90... RESTART: Loading restart files group #54 out of 90... RESTART: Loading restart files group #55 out of 90... RESTART: Loading restart files group #56 out of 90... RESTART: Loading restart files group #57 out of 90... RESTART: Loading restart files group #58 out of 90... RESTART: Loading restart files group #59 out of 90... RESTART: Loading restart files group #60 out of 90... RESTART: Loading restart files group #61 out of 90... RESTART: Loading restart files group #62 out of 90... RESTART: Loading restart files group #63 out of 90... RESTART: Loading restart files group #64 out of 90... RESTART: Loading restart files group #65 out of 90... RESTART: Loading restart files group #66 out of 90... RESTART: Loading restart files group #67 out of 90... RESTART: Loading restart files group #68 out of 90... RESTART: Loading restart files group #69 out of 90... RESTART: Loading restart files group #70 out of 90... RESTART: Loading restart files group #71 out of 90... RESTART: Loading restart files group #72 out of 90... RESTART: Loading restart files group #73 out of 90... RESTART: Loading restart files group #74 out of 90... RESTART: Loading restart files group #75 out of 90... RESTART: Loading restart files group #76 out of 90... RESTART: Loading restart files group #77 out of 90... RESTART: Loading restart files group #78 out of 90... RESTART: Loading restart files group #79 out of 90... RESTART: Loading restart files group #80 out of 90... RESTART: Loading restart files group #81 out of 90... RESTART: Loading restart files group #82 out of 90... RESTART: Loading restart files group #83 out of 90... RESTART: Loading restart files group #84 out of 90... RESTART: Loading restart files group #85 out of 90... RESTART: Loading restart files group #86 out of 90... RESTART: Loading restart files group #87 out of 90... RESTART: Loading restart files group #88 out of 90... RESTART: Loading restart files group #89 out of 90... RESTART: Loading restart files group #90 out of 90... RESTART: done. load/save took 335.378 sec, total size 352287 MB, corresponds to effective I/O rate of 1050.42 MB/sec SNAPSHOT: Setting next time for snapshot file to Time_next= 1 (DumpFlag=1) Sync-Point 1493, Time: 0.601384, Redshift: 0.662832, Systemstep: 0.000508632, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1493). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 28.224 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09032|1.04768 DOMAIN: combining multiple-domains took 0.289147 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 6.72783 sec) DOMAIN: domain decomposition done. (took in total 35.6366 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27007 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.2693 sec =974159 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995208 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.993 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1494, Time: 0.601893, Redshift: 0.661426, Systemstep: 0.000509062, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1494). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78568 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09034|1.04768 DOMAIN: combining multiple-domains took 0.288134 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17584 sec) DOMAIN: domain decomposition done. (took in total 5.64076 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26537 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.2513 sec =974192 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995208 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.959 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.16444 sec PM-PERIODIC: done. (took 13.2128 seconds) TIMESTEPS: displacement time constraint: 0.00658012 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.1626 sec PM-PERIODIC: done. (took 13.2355 seconds) TIMESTEPS: displacement time constraint: 0.00658012 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1495, Time: 0.602402, Redshift: 0.660021, Systemstep: 0.000509493, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1495). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78685 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09037|1.04768 DOMAIN: combining multiple-domains took 0.285405 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.35745 sec) DOMAIN: domain decomposition done. (took in total 6.82136 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28438 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.2654 sec =974247 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995209 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.979 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1496, Time: 0.602912, Redshift: 0.658617, Systemstep: 0.000509924, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1496). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79123 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0937|1.01699 DOMAIN: combining multiple-domains took 0.287314 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.1668 sec) DOMAIN: domain decomposition done. (took in total 13.6371 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.44169 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.76 MB) GRAVTREE: Tree construction done. took 17.2277 sec =974287 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995209 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.55 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.184 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1497, Time: 0.603422, Redshift: 0.657214, Systemstep: 0.000510356, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1497). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79213 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09365|1.01699 DOMAIN: combining multiple-domains took 0.286135 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35296 sec) DOMAIN: domain decomposition done. (took in total 5.82224 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23744 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.2175 sec =974373 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995209 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.54 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.238 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1498, Time: 0.603933, Redshift: 0.655812, Systemstep: 0.000510788, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1498). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78967 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09362|1.01699 DOMAIN: combining multiple-domains took 0.287982 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 5.04185 sec) DOMAIN: domain decomposition done. (took in total 7.51209 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27112 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.2455 sec =974423 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995209 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.833 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27945 sec PM-PERIODIC: done. (took 13.3481 seconds) TIMESTEPS: displacement time constraint: 0.00659576 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25254 sec PM-PERIODIC: done. (took 13.2241 seconds) TIMESTEPS: displacement time constraint: 0.00659575 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1499, Time: 0.604444, Redshift: 0.654412, Systemstep: 0.00051122, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1499). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85798 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09359|1.01699 DOMAIN: combining multiple-domains took 0.286535 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.88361 sec) DOMAIN: domain decomposition done. (took in total 6.41972 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27444 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.2266 sec =974469 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99521 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.389 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1500, Time: 0.604956, Redshift: 0.653013, Systemstep: 0.000511653, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1500). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79368 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09358|1.01699 DOMAIN: combining multiple-domains took 0.286329 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.14477 sec) DOMAIN: domain decomposition done. (took in total 5.61702 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26116 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.217 sec =974521 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99521 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.515 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1501, Time: 0.605468, Redshift: 0.651614, Systemstep: 0.000512086, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1501). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78819 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09355|1.01699 DOMAIN: combining multiple-domains took 0.286265 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.71264 sec) DOMAIN: domain decomposition done. (took in total 5.17877 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26863 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.2229 sec =974563 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99521 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.52 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.18 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1502, Time: 0.605981, Redshift: 0.650218, Systemstep: 0.00051252, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1502). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80838 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09354|1.01699 DOMAIN: combining multiple-domains took 0.298105 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.31147 sec) DOMAIN: domain decomposition done. (took in total 4.80977 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28204 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.2275 sec =974568 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99521 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.52 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.253 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26682 sec PM-PERIODIC: done. (took 13.3087 seconds) TIMESTEPS: displacement time constraint: 0.00661378 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30081 sec PM-PERIODIC: done. (took 13.5457 seconds) TIMESTEPS: displacement time constraint: 0.00661378 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1503, Time: 0.606494, Redshift: 0.648822, Systemstep: 0.000512954, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1503). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79028 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0935|1.01699 DOMAIN: combining multiple-domains took 0.286812 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10946 sec) DOMAIN: domain decomposition done. (took in total 4.57797 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25423 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.2261 sec =974595 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99521 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.51 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.268 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1504, Time: 0.607007, Redshift: 0.647427, Systemstep: 0.000513388, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1504). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79096 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09347|1.01699 DOMAIN: combining multiple-domains took 0.287613 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.25368 sec) DOMAIN: domain decomposition done. (took in total 5.72384 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24933 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.2371 sec =974646 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995211 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.51 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.88 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1505, Time: 0.607521, Redshift: 0.646034, Systemstep: 0.000513822, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1505). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83778 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09341|1.01699 DOMAIN: combining multiple-domains took 0.290977 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.35529 sec) DOMAIN: domain decomposition done. (took in total 4.87654 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2517 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.72 MB) GRAVTREE: Tree construction done. took 17.4065 sec =974704 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995211 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.601 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1506, Time: 0.608035, Redshift: 0.644642, Systemstep: 0.000514257, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1506). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.57913 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09339|1.01699 DOMAIN: combining multiple-domains took 0.333793 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.30883 sec) DOMAIN: domain decomposition done. (took in total 5.6749 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2706 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.72 MB) GRAVTREE: Tree construction done. took 17.2398 sec =974742 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995211 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.397 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34472 sec PM-PERIODIC: done. (took 13.5259 seconds) TIMESTEPS: displacement time constraint: 0.0066164 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27516 sec PM-PERIODIC: done. (took 13.5229 seconds) TIMESTEPS: displacement time constraint: 0.0066164 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1507, Time: 0.60855, Redshift: 0.643251, Systemstep: 0.000514693, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1507). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79031 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09334|1.01699 DOMAIN: combining multiple-domains took 0.287592 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.41115 sec) DOMAIN: domain decomposition done. (took in total 4.87985 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26844 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.2264 sec =974810 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995211 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.49 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.472 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1508, Time: 0.609065, Redshift: 0.641861, Systemstep: 0.000515128, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1508). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78849 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09329|1.01699 DOMAIN: combining multiple-domains took 0.287099 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.82987 sec) DOMAIN: domain decomposition done. (took in total 5.29664 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27437 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.253 sec =974864 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995212 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.541 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1509, Time: 0.609581, Redshift: 0.640472, Systemstep: 0.000515564, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1509). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81824 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09326|1.01699 DOMAIN: combining multiple-domains took 0.402833 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.02613 sec) DOMAIN: domain decomposition done. (took in total 4.63829 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27577 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.7 MB) GRAVTREE: Tree construction done. took 17.243 sec =974923 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995212 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.47 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.666 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1510, Time: 0.610097, Redshift: 0.639085, Systemstep: 0.000516001, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1510). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79081 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09322|1.01699 DOMAIN: combining multiple-domains took 0.28615 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35815 sec) DOMAIN: domain decomposition done. (took in total 5.82668 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23786 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.7 MB) GRAVTREE: Tree construction done. took 17.254 sec =974972 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995212 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.47 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.911 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33947 sec PM-PERIODIC: done. (took 13.4036 seconds) TIMESTEPS: displacement time constraint: 0.00661553 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36475 sec PM-PERIODIC: done. (took 13.7284 seconds) TIMESTEPS: displacement time constraint: 0.00661553 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1511, Time: 0.610613, Redshift: 0.637699, Systemstep: 0.000516438, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1511). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79158 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09319|1.01699 DOMAIN: combining multiple-domains took 0.286327 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.55609 sec) DOMAIN: domain decomposition done. (took in total 5.02527 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28264 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.7 MB) GRAVTREE: Tree construction done. took 17.2435 sec =975009 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995212 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.92 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1512, Time: 0.61113, Redshift: 0.636314, Systemstep: 0.000516875, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1512). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78553 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09315|1.01699 DOMAIN: combining multiple-domains took 0.286402 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1907 sec) DOMAIN: domain decomposition done. (took in total 5.65355 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22626 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.2486 sec =975057 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995213 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 263.998 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1513, Time: 0.611647, Redshift: 0.63493, Systemstep: 0.000517312, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1513). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78579 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09311|1.01699 DOMAIN: combining multiple-domains took 0.287827 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18578 sec) DOMAIN: domain decomposition done. (took in total 5.65124 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27199 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.2225 sec =975102 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995213 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 261.511 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1514, Time: 0.612165, Redshift: 0.633547, Systemstep: 0.00051775, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1514). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78678 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09306|1.01699 DOMAIN: combining multiple-domains took 0.29004 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.92601 sec) DOMAIN: domain decomposition done. (took in total 6.39653 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25225 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.2231 sec =975178 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995213 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.975 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32879 sec PM-PERIODIC: done. (took 13.5703 seconds) TIMESTEPS: displacement time constraint: 0.00663704 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33266 sec PM-PERIODIC: done. (took 13.2986 seconds) TIMESTEPS: displacement time constraint: 0.00663704 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1515, Time: 0.612683, Redshift: 0.632165, Systemstep: 0.000518188, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1515). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.789 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09304|1.01699 DOMAIN: combining multiple-domains took 0.290844 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.07629 sec) DOMAIN: domain decomposition done. (took in total 5.5477 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27972 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.2376 sec =975201 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995213 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.268 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1089.08 sec, total size 352287 MB, corresponds to effective I/O rate of 323.473 MB/sec Sync-Point 1516, Time: 0.613202, Redshift: 0.630785, Systemstep: 0.000518627, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1516). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78529 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09299|1.01699 DOMAIN: combining multiple-domains took 0.290258 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.99068 sec) DOMAIN: domain decomposition done. (took in total 6.45756 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.1999 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.2363 sec =975232 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995213 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 261.231 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1517, Time: 0.613721, Redshift: 0.629406, Systemstep: 0.000519066, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1517). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78945 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09297|1.01699 DOMAIN: combining multiple-domains took 0.291413 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29294 sec) DOMAIN: domain decomposition done. (took in total 5.76486 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2352 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.2158 sec =975288 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995214 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 262.756 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1518, Time: 0.61424, Redshift: 0.628027, Systemstep: 0.000519505, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1518). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78468 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09293|1.01699 DOMAIN: combining multiple-domains took 0.291759 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49145 sec) DOMAIN: domain decomposition done. (took in total 5.95972 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25525 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.1804 sec =975339 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995214 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.42 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 262.346 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3559 sec PM-PERIODIC: done. (took 13.7469 seconds) TIMESTEPS: displacement time constraint: 0.0066585 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35868 sec PM-PERIODIC: done. (took 13.7517 seconds) TIMESTEPS: displacement time constraint: 0.0066585 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1519, Time: 0.61476, Redshift: 0.62665, Systemstep: 0.000519945, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1519). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79188 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09291|1.01699 DOMAIN: combining multiple-domains took 0.286146 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.28013 sec) DOMAIN: domain decomposition done. (took in total 4.75024 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28544 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.66 MB) GRAVTREE: Tree construction done. took 17.1906 sec =975385 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995214 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.42 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 263.006 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1520, Time: 0.615281, Redshift: 0.625275, Systemstep: 0.000520385, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1520). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78388 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09288|1.01699 DOMAIN: combining multiple-domains took 0.28686 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79817 sec) DOMAIN: domain decomposition done. (took in total 5.26048 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27813 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.66 MB) GRAVTREE: Tree construction done. took 17.1827 sec =975420 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995214 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.41 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.892 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1521, Time: 0.615801, Redshift: 0.6239, Systemstep: 0.000520826, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1521). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.90681 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09086|1.01559 DOMAIN: combining multiple-domains took 0.286072 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.8976 sec) DOMAIN: domain decomposition done. (took in total 14.4802 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.13931 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.42 MB) GRAVTREE: Tree construction done. took 17.2393 sec =975469 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995215 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.08 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.735 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1522, Time: 0.616323, Redshift: 0.622527, Systemstep: 0.000521267, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1522). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.95494 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09089|1.01559 DOMAIN: combining multiple-domains took 0.288228 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16022 sec) DOMAIN: domain decomposition done. (took in total 5.79733 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28657 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.42 MB) GRAVTREE: Tree construction done. took 17.2568 sec =975534 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995215 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.09 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 259.701 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25437 sec PM-PERIODIC: done. (took 13.4304 seconds) TIMESTEPS: displacement time constraint: 0.00666873 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27193 sec PM-PERIODIC: done. (took 13.2415 seconds) TIMESTEPS: displacement time constraint: 0.00666873 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1523, Time: 0.616844, Redshift: 0.621154, Systemstep: 0.000521708, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1523). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79116 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09093|1.01559 DOMAIN: combining multiple-domains took 0.286403 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.57273 sec) DOMAIN: domain decomposition done. (took in total 6.0408 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28075 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.43 MB) GRAVTREE: Tree construction done. took 17.2737 sec =975570 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995215 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.09 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.413 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1524, Time: 0.617367, Redshift: 0.619783, Systemstep: 0.00052215, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1524). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79538 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09097|1.01559 DOMAIN: combining multiple-domains took 0.287012 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.82591 sec) DOMAIN: domain decomposition done. (took in total 6.29982 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25556 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.43 MB) GRAVTREE: Tree construction done. took 17.2757 sec =975606 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995215 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.1 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 259.643 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1525, Time: 0.617889, Redshift: 0.618413, Systemstep: 0.000522592, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1525). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79226 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0954|1.01559 DOMAIN: combining multiple-domains took 0.287157 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.93574 sec) DOMAIN: domain decomposition done. (took in total 6.407 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.54313 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.96 MB) GRAVTREE: Tree construction done. took 17.2988 sec =975653 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995216 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.087 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1526, Time: 0.618412, Redshift: 0.617044, Systemstep: 0.000523034, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1526). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88784 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09537|1.01559 DOMAIN: combining multiple-domains took 0.335833 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21776 sec) DOMAIN: domain decomposition done. (took in total 4.8357 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31525 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.95 MB) GRAVTREE: Tree construction done. took 17.293 sec =975682 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995216 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.82 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.104 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.40691 sec PM-PERIODIC: done. (took 13.8403 seconds) TIMESTEPS: displacement time constraint: 0.00666463 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30248 sec PM-PERIODIC: done. (took 13.4609 seconds) TIMESTEPS: displacement time constraint: 0.00666462 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1527, Time: 0.618936, Redshift: 0.615677, Systemstep: 0.000523477, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1527). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8049 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09251|1.04768 DOMAIN: combining multiple-domains took 0.318697 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3507 sec) DOMAIN: domain decomposition done. (took in total 14.8669 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.07517 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.62 MB) GRAVTREE: Tree construction done. took 17.2266 sec =975737 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995216 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.558 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1528, Time: 0.61946, Redshift: 0.61431, Systemstep: 0.00052392, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1528). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78032 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09261|1.04768 DOMAIN: combining multiple-domains took 0.286801 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.08893 sec) DOMAIN: domain decomposition done. (took in total 6.54582 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28184 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.63 MB) GRAVTREE: Tree construction done. took 17.2624 sec =975800 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995216 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.37 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.568 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1529, Time: 0.619984, Redshift: 0.612945, Systemstep: 0.000524363, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1529). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81447 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09272|1.04768 DOMAIN: combining multiple-domains took 0.288338 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.32424 sec) DOMAIN: domain decomposition done. (took in total 5.81755 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27612 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.64 MB) GRAVTREE: Tree construction done. took 17.2205 sec =975840 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995216 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.39 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.552 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1530, Time: 0.620509, Redshift: 0.611581, Systemstep: 0.000524807, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1530). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78205 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09279|1.04768 DOMAIN: combining multiple-domains took 0.286657 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.6269 sec) DOMAIN: domain decomposition done. (took in total 6.08723 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31525 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.65 MB) GRAVTREE: Tree construction done. took 17.2397 sec =975880 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995217 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.4 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.601 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20038 sec PM-PERIODIC: done. (took 13.4053 seconds) TIMESTEPS: displacement time constraint: 0.00668516 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21419 sec PM-PERIODIC: done. (took 13.3342 seconds) TIMESTEPS: displacement time constraint: 0.00668515 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1531, Time: 0.621034, Redshift: 0.610218, Systemstep: 0.000525251, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1531). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78617 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09289|1.04768 DOMAIN: combining multiple-domains took 0.28808 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22796 sec) DOMAIN: domain decomposition done. (took in total 5.69344 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32032 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.66 MB) GRAVTREE: Tree construction done. took 17.4117 sec =975942 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995217 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.42 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.689 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1532, Time: 0.62156, Redshift: 0.608856, Systemstep: 0.000525696, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1532). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7841 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08761|1.04768 DOMAIN: combining multiple-domains took 0.287405 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15235 sec) DOMAIN: domain decomposition done. (took in total 5.61463 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27911 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.2079 sec =975990 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995217 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.504 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1533, Time: 0.622086, Redshift: 0.607495, Systemstep: 0.000526141, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1533). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77712 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08769|1.04768 DOMAIN: combining multiple-domains took 0.284965 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.51983 sec) DOMAIN: domain decomposition done. (took in total 4.97096 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27077 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.2166 sec =976049 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995217 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.168 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1534, Time: 0.622612, Redshift: 0.606136, Systemstep: 0.000526586, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1534). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7908 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08776|1.04768 DOMAIN: combining multiple-domains took 0.285178 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.79528 sec) DOMAIN: domain decomposition done. (took in total 6.2617 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25469 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.2256 sec =976077 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995218 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.58 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.29 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3159 sec PM-PERIODIC: done. (took 13.3108 seconds) TIMESTEPS: displacement time constraint: 0.00668673 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19909 sec PM-PERIODIC: done. (took 13.254 seconds) TIMESTEPS: displacement time constraint: 0.00668672 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1535, Time: 0.623139, Redshift: 0.604777, Systemstep: 0.000527032, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1535). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.9151 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08784|1.04768 DOMAIN: combining multiple-domains took 0.284787 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.80156 sec) DOMAIN: domain decomposition done. (took in total 5.43319 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28168 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.2131 sec =976145 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995218 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.418 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1536, Time: 0.623667, Redshift: 0.60342, Systemstep: 0.000527478, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1536). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78683 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0879|1.04768 DOMAIN: combining multiple-domains took 0.285224 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26712 sec) DOMAIN: domain decomposition done. (took in total 4.72976 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2729 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.2308 sec =976181 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995218 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.274 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1145.62 sec, total size 352287 MB, corresponds to effective I/O rate of 307.508 MB/sec Sync-Point 1537, Time: 0.624195, Redshift: 0.602064, Systemstep: 0.000527925, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1537). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78741 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08799|1.04768 DOMAIN: combining multiple-domains took 0.286511 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93485 sec) DOMAIN: domain decomposition done. (took in total 5.3984 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26245 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.2197 sec =976225 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995218 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.417 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1538, Time: 0.624723, Redshift: 0.600709, Systemstep: 0.000528372, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1538). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7861 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08807|1.04768 DOMAIN: combining multiple-domains took 0.284902 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.01499 sec) DOMAIN: domain decomposition done. (took in total 4.47626 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29089 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.09 MB) GRAVTREE: Tree construction done. took 17.2118 sec =976262 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995218 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.63 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.446 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20501 sec PM-PERIODIC: done. (took 13.2579 seconds) TIMESTEPS: displacement time constraint: 0.00667809 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23054 sec PM-PERIODIC: done. (took 13.3109 seconds) TIMESTEPS: displacement time constraint: 0.00667809 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1539, Time: 0.625252, Redshift: 0.599355, Systemstep: 0.000528819, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1539). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78109 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08815|1.04768 DOMAIN: combining multiple-domains took 0.28447 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.10604 sec) DOMAIN: domain decomposition done. (took in total 5.56148 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24297 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.2076 sec =976290 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995219 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.274 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1540, Time: 0.625781, Redshift: 0.598002, Systemstep: 0.000529266, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1540). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78664 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08823|1.04768 DOMAIN: combining multiple-domains took 0.286149 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43752 sec) DOMAIN: domain decomposition done. (took in total 5.90076 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27472 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.11 MB) GRAVTREE: Tree construction done. took 17.2001 sec =976339 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995219 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.65 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.76 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1541, Time: 0.626311, Redshift: 0.596651, Systemstep: 0.000529714, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1541). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.91456 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08833|1.04768 DOMAIN: combining multiple-domains took 0.286895 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.97848 sec) DOMAIN: domain decomposition done. (took in total 5.57002 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22478 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.209 sec =976402 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995219 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.339 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1542, Time: 0.626841, Redshift: 0.5953, Systemstep: 0.000530163, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1542). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78325 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0884|1.04768 DOMAIN: combining multiple-domains took 0.283972 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35368 sec) DOMAIN: domain decomposition done. (took in total 5.8121 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40516 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.2234 sec =976446 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995219 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.518 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20222 sec PM-PERIODIC: done. (took 13.291 seconds) TIMESTEPS: displacement time constraint: 0.00666438 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18724 sec PM-PERIODIC: done. (took 13.3274 seconds) TIMESTEPS: displacement time constraint: 0.00666437 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1543, Time: 0.627372, Redshift: 0.593951, Systemstep: 0.000530612, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1543). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78725 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0885|1.04768 DOMAIN: combining multiple-domains took 0.28584 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56891 sec) DOMAIN: domain decomposition done. (took in total 6.03274 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2846 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.3746 sec =976493 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99522 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.712 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1544, Time: 0.627903, Redshift: 0.592603, Systemstep: 0.000531061, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1544). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77864 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0886|1.04768 DOMAIN: combining multiple-domains took 0.28565 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.05136 sec) DOMAIN: domain decomposition done. (took in total 6.50627 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23252 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2245 sec =976530 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99522 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.739 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1545, Time: 0.628434, Redshift: 0.591256, Systemstep: 0.00053151, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1545). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78772 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08869|1.04768 DOMAIN: combining multiple-domains took 0.286068 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06774 sec) DOMAIN: domain decomposition done. (took in total 4.53232 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28919 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.17 MB) GRAVTREE: Tree construction done. took 17.2364 sec =976571 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99522 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.73 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.803 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1546, Time: 0.628966, Redshift: 0.58991, Systemstep: 0.00053196, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1546). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83163 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08629|1.01418 DOMAIN: combining multiple-domains took 0.291204 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5337 sec) DOMAIN: domain decomposition done. (took in total 15.0467 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33446 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.88 MB) GRAVTREE: Tree construction done. took 17.1967 sec =976640 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99522 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.198 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28017 sec PM-PERIODIC: done. (took 13.3166 seconds) TIMESTEPS: displacement time constraint: 0.00666845 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27911 sec PM-PERIODIC: done. (took 13.4549 seconds) TIMESTEPS: displacement time constraint: 0.00666845 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1547, Time: 0.629499, Redshift: 0.588566, Systemstep: 0.000532411, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1547). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78372 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08625|1.01418 DOMAIN: combining multiple-domains took 0.284925 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22604 sec) DOMAIN: domain decomposition done. (took in total 4.68471 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23258 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.88 MB) GRAVTREE: Tree construction done. took 17.1893 sec =976683 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995221 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.33 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.886 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1548, Time: 0.630032, Redshift: 0.587222, Systemstep: 0.000532861, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1548). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78341 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08621|1.01418 DOMAIN: combining multiple-domains took 0.286132 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22511 sec) DOMAIN: domain decomposition done. (took in total 5.68614 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24361 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.87 MB) GRAVTREE: Tree construction done. took 17.1971 sec =976732 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995221 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.32 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.917 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1549, Time: 0.630565, Redshift: 0.58588, Systemstep: 0.000533312, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1549). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.01175 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08618|1.01418 DOMAIN: combining multiple-domains took 0.291577 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06622 sec) DOMAIN: domain decomposition done. (took in total 4.80324 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29627 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.87 MB) GRAVTREE: Tree construction done. took 17.1983 sec =976782 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995221 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.32 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.064 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1550, Time: 0.631099, Redshift: 0.584538, Systemstep: 0.000533764, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1550). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78908 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08612|1.01418 DOMAIN: combining multiple-domains took 0.285244 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43138 sec) DOMAIN: domain decomposition done. (took in total 5.89826 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17139 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.86 MB) GRAVTREE: Tree construction done. took 17.2017 sec =976819 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995221 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.31 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.973 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30582 sec PM-PERIODIC: done. (took 13.4802 seconds) TIMESTEPS: displacement time constraint: 0.00665512 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24587 sec PM-PERIODIC: done. (took 13.2924 seconds) TIMESTEPS: displacement time constraint: 0.00665512 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1551, Time: 0.631633, Redshift: 0.583198, Systemstep: 0.000534216, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1551). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77962 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08607|1.01418 DOMAIN: combining multiple-domains took 0.284771 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.74156 sec) DOMAIN: domain decomposition done. (took in total 5.19587 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19688 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.86 MB) GRAVTREE: Tree construction done. took 17.2268 sec =976889 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995222 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.041 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1552, Time: 0.632168, Redshift: 0.581859, Systemstep: 0.000534668, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1552). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78458 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.086|1.01418 DOMAIN: combining multiple-domains took 0.293984 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73414 sec) DOMAIN: domain decomposition done. (took in total 5.20251 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23085 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 17.1992 sec =976917 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995222 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.834 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1553, Time: 0.632703, Redshift: 0.580521, Systemstep: 0.00053512, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1553). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78637 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08652|1.04768 DOMAIN: combining multiple-domains took 0.285614 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4206 sec) DOMAIN: domain decomposition done. (took in total 14.8827 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.99371 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.91 MB) GRAVTREE: Tree construction done. took 17.1864 sec =976977 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995222 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.37 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.958 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1554, Time: 0.633238, Redshift: 0.579184, Systemstep: 0.000535573, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1554). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78975 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08653|1.04768 DOMAIN: combining multiple-domains took 0.284357 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.52046 sec) DOMAIN: domain decomposition done. (took in total 4.98335 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23587 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.91 MB) GRAVTREE: Tree construction done. took 17.3472 sec =977001 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995222 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.774 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19887 sec PM-PERIODIC: done. (took 13.501 seconds) TIMESTEPS: displacement time constraint: 0.00665589 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27377 sec PM-PERIODIC: done. (took 13.6516 seconds) TIMESTEPS: displacement time constraint: 0.00665588 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1555, Time: 0.633774, Redshift: 0.577849, Systemstep: 0.000536027, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1555). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78923 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08654|1.04768 DOMAIN: combining multiple-domains took 0.286149 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.07443 sec) DOMAIN: domain decomposition done. (took in total 5.53855 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2437 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.91 MB) GRAVTREE: Tree construction done. took 17.1907 sec =977063 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995222 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.985 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1556, Time: 0.634311, Redshift: 0.576514, Systemstep: 0.00053648, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1556). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78165 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08655|1.04768 DOMAIN: combining multiple-domains took 0.28519 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30021 sec) DOMAIN: domain decomposition done. (took in total 5.75667 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26042 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.91 MB) GRAVTREE: Tree construction done. took 17.1976 sec =977092 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995223 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.282 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 1088.9 sec, total size 352287 MB, corresponds to effective I/O rate of 323.526 MB/sec Sync-Point 1557, Time: 0.634848, Redshift: 0.575181, Systemstep: 0.000536935, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1557). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78405 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08665|1.04768 DOMAIN: combining multiple-domains took 0.285593 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.33744 sec) DOMAIN: domain decomposition done. (took in total 5.79605 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27335 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 17.2046 sec =977110 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995223 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.4 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.669 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1558, Time: 0.635385, Redshift: 0.573849, Systemstep: 0.000537389, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1558). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79854 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08674|1.04768 DOMAIN: combining multiple-domains took 0.285125 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71398 sec) DOMAIN: domain decomposition done. (took in total 6.18667 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30685 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 17.2134 sec =977174 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995223 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.41 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.324 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21302 sec PM-PERIODIC: done. (took 13.4667 seconds) TIMESTEPS: displacement time constraint: 0.00664916 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20174 sec PM-PERIODIC: done. (took 13.5463 seconds) TIMESTEPS: displacement time constraint: 0.00664915 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1559, Time: 0.635923, Redshift: 0.572518, Systemstep: 0.000537844, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1559). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77993 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08681|1.04768 DOMAIN: combining multiple-domains took 0.285339 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.59173 sec) DOMAIN: domain decomposition done. (took in total 6.04727 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21322 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.95 MB) GRAVTREE: Tree construction done. took 17.2187 sec =977209 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995223 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.42 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.089 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1560, Time: 0.636461, Redshift: 0.571188, Systemstep: 0.000538299, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1560). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78304 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08692|1.04768 DOMAIN: combining multiple-domains took 0.284848 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.88323 sec) DOMAIN: domain decomposition done. (took in total 5.33989 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29492 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.96 MB) GRAVTREE: Tree construction done. took 17.2213 sec =977230 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995223 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.44 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.19 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1561, Time: 0.637, Redshift: 0.569859, Systemstep: 0.000538755, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1561). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77805 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.087|1.04768 DOMAIN: combining multiple-domains took 0.284922 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19435 sec) DOMAIN: domain decomposition done. (took in total 5.64625 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2423 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.97 MB) GRAVTREE: Tree construction done. took 17.2136 sec =977297 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995224 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.237 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1562, Time: 0.637539, Redshift: 0.568531, Systemstep: 0.000539211, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1562). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87323 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08709|1.04768 DOMAIN: combining multiple-domains took 0.285537 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.2592 sec) DOMAIN: domain decomposition done. (took in total 4.85839 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30672 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.98 MB) GRAVTREE: Tree construction done. took 17.2238 sec =977344 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995224 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.47 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.431 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21662 sec PM-PERIODIC: done. (took 14.0912 seconds) TIMESTEPS: displacement time constraint: 0.00663815 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20434 sec PM-PERIODIC: done. (took 13.5695 seconds) TIMESTEPS: displacement time constraint: 0.00663815 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1563, Time: 0.638079, Redshift: 0.567204, Systemstep: 0.000539667, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1563). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77619 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08717|1.04768 DOMAIN: combining multiple-domains took 0.284536 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31531 sec) DOMAIN: domain decomposition done. (took in total 5.76511 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26843 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.2244 sec =977374 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995224 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.48 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.5 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1564, Time: 0.638619, Redshift: 0.565879, Systemstep: 0.000540124, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1564). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78019 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08725|1.04768 DOMAIN: combining multiple-domains took 0.288413 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79922 sec) DOMAIN: domain decomposition done. (took in total 5.25709 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2909 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.2317 sec =977446 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995224 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.49 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.53 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1565, Time: 0.63916, Redshift: 0.564555, Systemstep: 0.000540581, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1565). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78154 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08733|1.04768 DOMAIN: combining multiple-domains took 0.284792 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.35861 sec) DOMAIN: domain decomposition done. (took in total 4.81409 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29951 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.2269 sec =977470 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995224 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.573 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1566, Time: 0.639701, Redshift: 0.563231, Systemstep: 0.000541039, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1566). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78029 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08741|1.04768 DOMAIN: combining multiple-domains took 0.284764 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.57019 sec) DOMAIN: domain decomposition done. (took in total 6.02397 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24979 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.2642 sec =977501 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995225 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.48 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25306 sec PM-PERIODIC: done. (took 13.5354 seconds) TIMESTEPS: displacement time constraint: 0.00663924 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.1968 sec PM-PERIODIC: done. (took 13.5528 seconds) TIMESTEPS: displacement time constraint: 0.00663924 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1567, Time: 0.640242, Redshift: 0.561909, Systemstep: 0.000541497, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1567). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81062 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0875|1.04768 DOMAIN: combining multiple-domains took 0.331161 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26475 sec) DOMAIN: domain decomposition done. (took in total 5.79718 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27445 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.2729 sec =977535 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995225 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.53 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.493 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1568, Time: 0.640784, Redshift: 0.560588, Systemstep: 0.000541955, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1568). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78729 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08757|1.04768 DOMAIN: combining multiple-domains took 0.28713 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.23769 sec) DOMAIN: domain decomposition done. (took in total 4.70272 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29609 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.2675 sec =977574 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995225 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.589 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1569, Time: 0.641326, Redshift: 0.559268, Systemstep: 0.000542414, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1569). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84325 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08762|1.04768 DOMAIN: combining multiple-domains took 0.285263 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2168 sec) DOMAIN: domain decomposition done. (took in total 5.73448 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28573 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.04 MB) GRAVTREE: Tree construction done. took 17.2557 sec =977618 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995225 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.55 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 264.687 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1570, Time: 0.641869, Redshift: 0.557949, Systemstep: 0.000542873, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1570). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77992 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08773|1.04768 DOMAIN: combining multiple-domains took 0.295392 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.98879 sec) DOMAIN: domain decomposition done. (took in total 6.45819 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27365 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.05 MB) GRAVTREE: Tree construction done. took 17.2803 sec =977674 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995225 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.57 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 264.618 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.16922 sec PM-PERIODIC: done. (took 13.7517 seconds) TIMESTEPS: displacement time constraint: 0.00663061 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18258 sec PM-PERIODIC: done. (took 13.583 seconds) TIMESTEPS: displacement time constraint: 0.00663061 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1571, Time: 0.642413, Redshift: 0.556632, Systemstep: 0.000543333, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1571). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.02844 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08782|1.04768 DOMAIN: combining multiple-domains took 0.285215 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 5.2577 sec) DOMAIN: domain decomposition done. (took in total 7.96225 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25887 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.06 MB) GRAVTREE: Tree construction done. took 17.2467 sec =977720 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995226 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.59 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 264.799 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1572, Time: 0.642956, Redshift: 0.555315, Systemstep: 0.000543793, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1572). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86148 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08791|1.04768 DOMAIN: combining multiple-domains took 0.369604 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.45407 sec) DOMAIN: domain decomposition done. (took in total 5.07485 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25747 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.2494 sec =977786 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995226 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 264.757 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1573, Time: 0.643501, Redshift: 0.554, Systemstep: 0.000544253, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1573). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81199 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08798|1.04768 DOMAIN: combining multiple-domains took 0.28677 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.91546 sec) DOMAIN: domain decomposition done. (took in total 5.40348 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27032 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.2591 sec =977840 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995226 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.61 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 264.882 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1574, Time: 0.644045, Redshift: 0.552685, Systemstep: 0.000544714, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1574). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77989 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08805|1.04768 DOMAIN: combining multiple-domains took 0.286122 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28651 sec) DOMAIN: domain decomposition done. (took in total 5.74194 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25074 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.09 MB) GRAVTREE: Tree construction done. took 17.2477 sec =977894 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995226 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.692 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20154 sec PM-PERIODIC: done. (took 13.3044 seconds) TIMESTEPS: displacement time constraint: 0.00662314 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20738 sec PM-PERIODIC: done. (took 13.5884 seconds) TIMESTEPS: displacement time constraint: 0.00662314 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1575, Time: 0.644591, Redshift: 0.551372, Systemstep: 0.000545175, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1575). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78646 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08814|1.04768 DOMAIN: combining multiple-domains took 0.286434 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.3026 sec) DOMAIN: domain decomposition done. (took in total 4.76495 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30753 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.2704 sec =977948 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995227 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.962 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1576, Time: 0.645136, Redshift: 0.55006, Systemstep: 0.000545636, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1576). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78251 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08842|1.01418 DOMAIN: combining multiple-domains took 0.287753 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.8603 sec) DOMAIN: domain decomposition done. (took in total 14.3199 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.91524 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.2238 sec =977976 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995227 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.999 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1577, Time: 0.645682, Redshift: 0.548749, Systemstep: 0.000546098, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1577). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78914 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08832|1.04768 DOMAIN: combining multiple-domains took 0.285195 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2805 sec) DOMAIN: domain decomposition done. (took in total 15.7453 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.35526 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.2654 sec =978048 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995227 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.082 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 211.662 sec, total size 352287 MB, corresponds to effective I/O rate of 1664.39 MB/sec Sync-Point 1578, Time: 0.646229, Redshift: 0.547439, Systemstep: 0.00054656, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1578). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85466 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08842|1.04768 DOMAIN: combining multiple-domains took 0.385052 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.75652 sec) DOMAIN: domain decomposition done. (took in total 5.38597 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28316 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.2825 sec =978113 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995228 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.115 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20349 sec PM-PERIODIC: done. (took 13.4098 seconds) TIMESTEPS: displacement time constraint: 0.00662236 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21884 sec PM-PERIODIC: done. (took 13.3664 seconds) TIMESTEPS: displacement time constraint: 0.00662237 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1579, Time: 0.646776, Redshift: 0.546131, Systemstep: 0.000547023, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1579). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78512 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0885|1.04768 DOMAIN: combining multiple-domains took 0.285418 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.07587 sec) DOMAIN: domain decomposition done. (took in total 5.53577 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24903 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.2867 sec =978147 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995228 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.02 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1580, Time: 0.647323, Redshift: 0.544823, Systemstep: 0.000547486, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1580). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78416 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08853|1.01418 DOMAIN: combining multiple-domains took 0.285488 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5331 sec) DOMAIN: domain decomposition done. (took in total 14.9924 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.90504 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2339 sec =978203 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995228 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.254 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1581, Time: 0.647871, Redshift: 0.543516, Systemstep: 0.00054795, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1581). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8208 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08855|1.01418 DOMAIN: combining multiple-domains took 0.355273 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36541 sec) DOMAIN: domain decomposition done. (took in total 5.9319 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26617 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2391 sec =978271 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995228 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.337 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1582, Time: 0.64842, Redshift: 0.542211, Systemstep: 0.000548413, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1582). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81754 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08855|1.01418 DOMAIN: combining multiple-domains took 0.291889 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.25263 sec) DOMAIN: domain decomposition done. (took in total 5.75269 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29861 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2388 sec =978294 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995228 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.329 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3253 sec PM-PERIODIC: done. (took 13.3938 seconds) TIMESTEPS: displacement time constraint: 0.00662097 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22291 sec PM-PERIODIC: done. (took 13.2142 seconds) TIMESTEPS: displacement time constraint: 0.00662097 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1583, Time: 0.648969, Redshift: 0.540906, Systemstep: 0.000548878, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1583). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78915 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08853|1.01418 DOMAIN: combining multiple-domains took 0.286473 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.08498 sec) DOMAIN: domain decomposition done. (took in total 5.55198 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21193 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2309 sec =978331 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995229 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.022 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1584, Time: 0.649518, Redshift: 0.539603, Systemstep: 0.000549342, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1584). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78906 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08853|1.01418 DOMAIN: combining multiple-domains took 0.286848 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.24527 sec) DOMAIN: domain decomposition done. (took in total 4.71281 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28961 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2975 sec =978362 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995229 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.173 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1585, Time: 0.650068, Redshift: 0.538301, Systemstep: 0.000549807, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1585). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7872 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08854|1.01418 DOMAIN: combining multiple-domains took 0.286669 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.39685 sec) DOMAIN: domain decomposition done. (took in total 4.86099 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32939 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2297 sec =978411 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995229 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.17 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1586, Time: 0.650618, Redshift: 0.537, Systemstep: 0.000550273, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1586). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78526 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08855|1.01418 DOMAIN: combining multiple-domains took 0.286811 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15983 sec) DOMAIN: domain decomposition done. (took in total 5.62208 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27594 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2309 sec =978458 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995229 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.178 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23654 sec PM-PERIODIC: done. (took 13.1796 seconds) TIMESTEPS: displacement time constraint: 0.00661443 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22806 sec PM-PERIODIC: done. (took 13.2951 seconds) TIMESTEPS: displacement time constraint: 0.00661443 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1587, Time: 0.651169, Redshift: 0.5357, Systemstep: 0.000550738, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1587). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8219 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08857|1.01418 DOMAIN: combining multiple-domains took 0.293777 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26608 sec) DOMAIN: domain decomposition done. (took in total 5.77209 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19736 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2313 sec =978486 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995229 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.281 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1588, Time: 0.65172, Redshift: 0.534401, Systemstep: 0.000551205, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1588). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78517 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08859|1.01418 DOMAIN: combining multiple-domains took 0.28607 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34363 sec) DOMAIN: domain decomposition done. (took in total 5.80508 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2662 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.2297 sec =978519 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99523 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.312 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1589, Time: 0.652272, Redshift: 0.533103, Systemstep: 0.000551671, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1589). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79137 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0886|1.01418 DOMAIN: combining multiple-domains took 0.286736 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.69564 sec) DOMAIN: domain decomposition done. (took in total 5.16387 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2524 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2266 sec =978555 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99523 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.012 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1590, Time: 0.652824, Redshift: 0.531807, Systemstep: 0.000552138, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1590). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79166 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0886|1.01418 DOMAIN: combining multiple-domains took 0.285764 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.32078 sec) DOMAIN: domain decomposition done. (took in total 4.78795 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27036 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2238 sec =978604 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99523 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.71 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.543 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22514 sec PM-PERIODIC: done. (took 13.307 seconds) TIMESTEPS: displacement time constraint: 0.0066058 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21544 sec PM-PERIODIC: done. (took 13.3638 seconds) TIMESTEPS: displacement time constraint: 0.00660579 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1591, Time: 0.653376, Redshift: 0.530511, Systemstep: 0.000552606, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1591). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78733 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08861|1.01418 DOMAIN: combining multiple-domains took 0.286775 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.0846 sec) DOMAIN: domain decomposition done. (took in total 5.87669 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27768 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.371 sec =978615 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99523 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.582 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1592, Time: 0.65393, Redshift: 0.529217, Systemstep: 0.000553073, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1592). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78853 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08863|1.01418 DOMAIN: combining multiple-domains took 0.285662 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18528 sec) DOMAIN: domain decomposition done. (took in total 5.65065 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22411 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2397 sec =978663 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99523 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.664 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1593, Time: 0.654483, Redshift: 0.527923, Systemstep: 0.000553542, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1593). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78689 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08861|1.01418 DOMAIN: combining multiple-domains took 0.285776 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21349 sec) DOMAIN: domain decomposition done. (took in total 4.67606 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30419 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2398 sec =978712 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99523 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.587 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1594, Time: 0.655037, Redshift: 0.526631, Systemstep: 0.00055401, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1594). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79235 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08863|1.01418 DOMAIN: combining multiple-domains took 0.287484 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41321 sec) DOMAIN: domain decomposition done. (took in total 5.88374 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19478 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2079 sec =978739 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995231 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.02 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27206 sec PM-PERIODIC: done. (took 13.2987 seconds) TIMESTEPS: displacement time constraint: 0.00659356 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27732 sec PM-PERIODIC: done. (took 13.6638 seconds) TIMESTEPS: displacement time constraint: 0.00659356 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1595, Time: 0.655592, Redshift: 0.52534, Systemstep: 0.000554479, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1595). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78868 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08863|1.01418 DOMAIN: combining multiple-domains took 0.285522 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22048 sec) DOMAIN: domain decomposition done. (took in total 4.68628 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29977 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.227 sec =978782 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995231 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.311 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1596, Time: 0.656146, Redshift: 0.52405, Systemstep: 0.000554948, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1596). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7949 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08865|1.01418 DOMAIN: combining multiple-domains took 0.286395 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.10485 sec) DOMAIN: domain decomposition done. (took in total 6.57616 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24046 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.16 MB) GRAVTREE: Tree construction done. took 17.2053 sec =978805 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995231 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.72 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 260.475 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1597, Time: 0.656702, Redshift: 0.522761, Systemstep: 0.000555418, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1597). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78455 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08996|1.04768 DOMAIN: combining multiple-domains took 0.285296 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.6314 sec) DOMAIN: domain decomposition done. (took in total 15.0905 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.39352 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 17.2797 sec =978835 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995231 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.94 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.941 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1598, Time: 0.657258, Redshift: 0.521473, Systemstep: 0.000555888, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1598). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78022 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09003|1.04768 DOMAIN: combining multiple-domains took 0.286662 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.94525 sec) DOMAIN: domain decomposition done. (took in total 5.40159 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25807 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 17.2678 sec =978900 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995231 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.833 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22789 sec PM-PERIODIC: done. (took 13.4324 seconds) TIMESTEPS: displacement time constraint: 0.00658931 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21387 sec PM-PERIODIC: done. (took 13.4196 seconds) TIMESTEPS: displacement time constraint: 0.0065893 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1599, Time: 0.657814, Redshift: 0.520186, Systemstep: 0.000556359, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1599). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77792 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09013|1.04768 DOMAIN: combining multiple-domains took 0.286115 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29754 sec) DOMAIN: domain decomposition done. (took in total 5.75138 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29812 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 17.2691 sec =978969 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995232 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.96 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.048 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1600, Time: 0.658371, Redshift: 0.5189, Systemstep: 0.00055683, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1600). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78278 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09022|1.04768 DOMAIN: combining multiple-domains took 0.285081 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.70744 sec) DOMAIN: domain decomposition done. (took in total 6.16441 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25141 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.2638 sec =979032 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995232 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.028 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 299.448 sec, total size 352287 MB, corresponds to effective I/O rate of 1176.45 MB/sec Sync-Point 1601, Time: 0.658928, Redshift: 0.517616, Systemstep: 0.000557301, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1601). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80951 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0903|1.04768 DOMAIN: combining multiple-domains took 0.285747 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.33145 sec) DOMAIN: domain decomposition done. (took in total 5.81627 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26313 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.374 sec =979070 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995232 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.279 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1602, Time: 0.659486, Redshift: 0.516332, Systemstep: 0.000557773, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1602). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78463 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09038|1.04768 DOMAIN: combining multiple-domains took 0.285808 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93196 sec) DOMAIN: domain decomposition done. (took in total 5.39209 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24295 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.2774 sec =979115 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995232 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.212 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3547 sec PM-PERIODIC: done. (took 13.9623 seconds) TIMESTEPS: displacement time constraint: 0.0065734 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.40379 sec PM-PERIODIC: done. (took 13.4327 seconds) TIMESTEPS: displacement time constraint: 0.0065734 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1603, Time: 0.660044, Redshift: 0.51505, Systemstep: 0.000558245, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1603). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.40252 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0817|1.01418 DOMAIN: combining multiple-domains took 0.32957 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.4145 sec) DOMAIN: domain decomposition done. (took in total 16.5354 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.16132 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.34 MB) GRAVTREE: Tree construction done. took 17.2719 sec =979126 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995232 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.59 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.145 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1604, Time: 0.660603, Redshift: 0.513768, Systemstep: 0.000558718, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1604). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77955 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08178|1.01418 DOMAIN: combining multiple-domains took 0.28438 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06737 sec) DOMAIN: domain decomposition done. (took in total 4.52041 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27689 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.35 MB) GRAVTREE: Tree construction done. took 17.2988 sec =979187 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995233 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.6 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.052 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1605, Time: 0.661162, Redshift: 0.512488, Systemstep: 0.000559191, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1605). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79027 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08186|1.01418 DOMAIN: combining multiple-domains took 0.28349 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93485 sec) DOMAIN: domain decomposition done. (took in total 5.39679 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28498 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.36 MB) GRAVTREE: Tree construction done. took 17.2434 sec =979224 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995233 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.61 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.983 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1606, Time: 0.661722, Redshift: 0.511209, Systemstep: 0.000559664, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1606). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78121 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08193|1.01418 DOMAIN: combining multiple-domains took 0.283881 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.19461 sec) DOMAIN: domain decomposition done. (took in total 4.64854 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26808 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.37 MB) GRAVTREE: Tree construction done. took 17.2492 sec =979287 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995233 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.63 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.904 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36784 sec PM-PERIODIC: done. (took 13.3731 seconds) TIMESTEPS: displacement time constraint: 0.00656167 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29074 sec PM-PERIODIC: done. (took 13.2571 seconds) TIMESTEPS: displacement time constraint: 0.00656166 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1607, Time: 0.662282, Redshift: 0.509931, Systemstep: 0.000560138, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1607). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7824 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08201|1.01418 DOMAIN: combining multiple-domains took 0.284035 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.16258 sec) DOMAIN: domain decomposition done. (took in total 4.6173 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25621 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.38 MB) GRAVTREE: Tree construction done. took 17.2346 sec =979342 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995234 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.64 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.946 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1608, Time: 0.662843, Redshift: 0.508654, Systemstep: 0.000560612, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1608). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78437 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08562|1.01418 DOMAIN: combining multiple-domains took 0.284086 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28439 sec) DOMAIN: domain decomposition done. (took in total 5.74142 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.47454 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.8 MB) GRAVTREE: Tree construction done. took 17.2288 sec =979372 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995234 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.166 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1609, Time: 0.663404, Redshift: 0.507378, Systemstep: 0.000561086, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1609). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7788 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08563|1.01418 DOMAIN: combining multiple-domains took 0.28528 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.61862 sec) DOMAIN: domain decomposition done. (took in total 5.07263 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19611 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 17.2279 sec =979388 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995234 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.314 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1610, Time: 0.663965, Redshift: 0.506103, Systemstep: 0.000561561, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1610). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78148 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08565|1.01418 DOMAIN: combining multiple-domains took 0.284467 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.89186 sec) DOMAIN: domain decomposition done. (took in total 6.34795 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22072 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 17.2323 sec =979414 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995234 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.237 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28091 sec PM-PERIODIC: done. (took 13.3103 seconds) TIMESTEPS: displacement time constraint: 0.0065562 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27036 sec PM-PERIODIC: done. (took 13.706 seconds) TIMESTEPS: displacement time constraint: 0.00655619 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1611, Time: 0.664527, Redshift: 0.504829, Systemstep: 0.000562037, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1611). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78784 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08568|1.01418 DOMAIN: combining multiple-domains took 0.285059 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19702 sec) DOMAIN: domain decomposition done. (took in total 5.65958 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23111 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.81 MB) GRAVTREE: Tree construction done. took 17.2405 sec =979452 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995234 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.18 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1612, Time: 0.66509, Redshift: 0.503556, Systemstep: 0.000562512, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1612). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.787 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08572|1.01418 DOMAIN: combining multiple-domains took 0.285183 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.48845 sec) DOMAIN: domain decomposition done. (took in total 5.94981 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23501 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 17.2352 sec =979508 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995234 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.24 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.115 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1613, Time: 0.665653, Redshift: 0.502285, Systemstep: 0.000562989, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1613). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.9158 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08576|1.01418 DOMAIN: combining multiple-domains took 0.318233 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16831 sec) DOMAIN: domain decomposition done. (took in total 5.86066 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22116 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 17.2843 sec =979567 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995235 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.39 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1614, Time: 0.666216, Redshift: 0.501014, Systemstep: 0.000563465, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1614). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78446 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08579|1.01418 DOMAIN: combining multiple-domains took 0.289918 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.09782 sec) DOMAIN: domain decomposition done. (took in total 5.56122 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23867 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 17.2431 sec =979629 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995235 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.31 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21743 sec PM-PERIODIC: done. (took 13.4168 seconds) TIMESTEPS: displacement time constraint: 0.00653633 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21563 sec PM-PERIODIC: done. (took 13.2493 seconds) TIMESTEPS: displacement time constraint: 0.00653632 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1615, Time: 0.66678, Redshift: 0.499745, Systemstep: 0.000563942, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1615). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77822 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08582|1.01418 DOMAIN: combining multiple-domains took 0.285643 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90016 sec) DOMAIN: domain decomposition done. (took in total 5.3537 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21289 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.3568 sec =979670 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995235 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 263.296 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1616, Time: 0.667345, Redshift: 0.498476, Systemstep: 0.000564419, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1616). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77807 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08584|1.01418 DOMAIN: combining multiple-domains took 0.285799 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35397 sec) DOMAIN: domain decomposition done. (took in total 5.80759 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2114 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.2553 sec =979692 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995235 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 262.688 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1617, Time: 0.66791, Redshift: 0.497209, Systemstep: 0.000564897, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1617). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78455 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08586|1.01418 DOMAIN: combining multiple-domains took 0.28493 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62674 sec) DOMAIN: domain decomposition done. (took in total 5.08588 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24402 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.274 sec =979742 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995235 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.27 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 261.539 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1618, Time: 0.668475, Redshift: 0.495942, Systemstep: 0.000565375, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1618). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78474 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08586|1.01418 DOMAIN: combining multiple-domains took 0.285009 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34285 sec) DOMAIN: domain decomposition done. (took in total 5.80179 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22268 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.2928 sec =979803 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995236 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.27 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.653 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22841 sec PM-PERIODIC: done. (took 13.1805 seconds) TIMESTEPS: displacement time constraint: 0.00652432 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23151 sec PM-PERIODIC: done. (took 13.2166 seconds) TIMESTEPS: displacement time constraint: 0.00652431 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1619, Time: 0.669041, Redshift: 0.494677, Systemstep: 0.000565854, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1619). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78636 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09303|1.01559 DOMAIN: combining multiple-domains took 0.286229 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.283 sec) DOMAIN: domain decomposition done. (took in total 15.7453 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.01816 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.3805 sec =979827 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995236 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.258 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1620, Time: 0.669607, Redshift: 0.493413, Systemstep: 0.000566333, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1620). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78953 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09314|1.01559 DOMAIN: combining multiple-domains took 0.288153 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95158 sec) DOMAIN: domain decomposition done. (took in total 5.42241 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2117 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.3747 sec =979866 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995236 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.534 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1621, Time: 0.670174, Redshift: 0.49215, Systemstep: 0.000566812, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1621). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7845 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09295|1.01699 DOMAIN: combining multiple-domains took 0.28788 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.8413 sec) DOMAIN: domain decomposition done. (took in total 14.3052 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.45577 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.4231 sec =979906 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995236 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.302 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1622, Time: 0.670741, Redshift: 0.490888, Systemstep: 0.000567292, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1622). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79976 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09298|1.01699 DOMAIN: combining multiple-domains took 0.286987 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16044 sec) DOMAIN: domain decomposition done. (took in total 5.64118 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28287 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.4092 sec =979939 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995236 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.512 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18547 sec PM-PERIODIC: done. (took 13.1912 seconds) TIMESTEPS: displacement time constraint: 0.00653246 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18755 sec PM-PERIODIC: done. (took 13.3297 seconds) TIMESTEPS: displacement time constraint: 0.00653246 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1623, Time: 0.671309, Redshift: 0.489627, Systemstep: 0.000567772, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1623). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7948 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09342|1.01559 DOMAIN: combining multiple-domains took 0.28865 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.6561 sec) DOMAIN: domain decomposition done. (took in total 15.1332 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3617 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.72 MB) GRAVTREE: Tree construction done. took 17.37 sec =979979 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995237 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 254.18 sec, total size 352287 MB, corresponds to effective I/O rate of 1385.97 MB/sec Sync-Point 1624, Time: 0.671877, Redshift: 0.488367, Systemstep: 0.000568253, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1624). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78739 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09351|1.01559 DOMAIN: combining multiple-domains took 0.28922 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15428 sec) DOMAIN: domain decomposition done. (took in total 5.62216 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31251 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.4059 sec =980033 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995237 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.52 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.052 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1625, Time: 0.672446, Redshift: 0.487108, Systemstep: 0.000568734, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1625). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.9674 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09362|1.01559 DOMAIN: combining multiple-domains took 0.287204 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38487 sec) DOMAIN: domain decomposition done. (took in total 6.03104 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21375 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.3955 sec =980082 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995237 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.219 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1626, Time: 0.673015, Redshift: 0.485851, Systemstep: 0.000569215, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1626). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81733 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0937|1.01559 DOMAIN: combining multiple-domains took 0.411095 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.61807 sec) DOMAIN: domain decomposition done. (took in total 5.23865 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25895 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.76 MB) GRAVTREE: Tree construction done. took 17.4028 sec =980120 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995237 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.55 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.47 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23663 sec PM-PERIODIC: done. (took 13.5835 seconds) TIMESTEPS: displacement time constraint: 0.00650339 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2207 sec PM-PERIODIC: done. (took 13.2886 seconds) TIMESTEPS: displacement time constraint: 0.00650338 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1627, Time: 0.673585, Redshift: 0.484594, Systemstep: 0.000569697, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1627). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78509 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0938|1.01559 DOMAIN: combining multiple-domains took 0.287725 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16026 sec) DOMAIN: domain decomposition done. (took in total 5.62583 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23418 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.77 MB) GRAVTREE: Tree construction done. took 17.395 sec =980135 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995237 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.56 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.622 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1628, Time: 0.674155, Redshift: 0.483338, Systemstep: 0.000570179, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1628). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7864 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0845|1.01418 DOMAIN: combining multiple-domains took 0.28665 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4447 sec) DOMAIN: domain decomposition done. (took in total 14.9098 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38416 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.67 MB) GRAVTREE: Tree construction done. took 17.2559 sec =980197 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995238 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.821 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1629, Time: 0.674726, Redshift: 0.482084, Systemstep: 0.000570662, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1629). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78343 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08453|1.01418 DOMAIN: combining multiple-domains took 0.284522 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.50229 sec) DOMAIN: domain decomposition done. (took in total 5.95979 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23594 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 17.2513 sec =980231 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995238 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.276 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1630, Time: 0.675297, Redshift: 0.48083, Systemstep: 0.000571145, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1630). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77971 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08455|1.01418 DOMAIN: combining multiple-domains took 0.284422 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.86416 sec) DOMAIN: domain decomposition done. (took in total 5.31697 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28429 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 17.2609 sec =980280 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995238 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.459 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22244 sec PM-PERIODIC: done. (took 13.2889 seconds) TIMESTEPS: displacement time constraint: 0.00647205 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.238 sec PM-PERIODIC: done. (took 13.3779 seconds) TIMESTEPS: displacement time constraint: 0.00647204 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1631, Time: 0.675868, Redshift: 0.479578, Systemstep: 0.000571629, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1631). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77819 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08457|1.01418 DOMAIN: combining multiple-domains took 0.285164 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95113 sec) DOMAIN: domain decomposition done. (took in total 5.4029 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26185 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 17.2555 sec =980313 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995238 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.289 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1632, Time: 0.676441, Redshift: 0.478326, Systemstep: 0.000572113, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1632). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77819 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08459|1.01418 DOMAIN: combining multiple-domains took 0.285491 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.89667 sec) DOMAIN: domain decomposition done. (took in total 4.34943 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27574 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.68 MB) GRAVTREE: Tree construction done. took 17.2578 sec =980307 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995238 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 261.22 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1633, Time: 0.677013, Redshift: 0.477076, Systemstep: 0.000572597, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1633). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78094 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08462|1.01418 DOMAIN: combining multiple-domains took 0.285487 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.59208 sec) DOMAIN: domain decomposition done. (took in total 6.048 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2711 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 17.2656 sec =980347 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995238 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.06 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.462 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1634, Time: 0.677586, Redshift: 0.475827, Systemstep: 0.000573082, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1634). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78057 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08465|1.01418 DOMAIN: combining multiple-domains took 0.28675 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.17859 sec) DOMAIN: domain decomposition done. (took in total 6.63473 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25152 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.69 MB) GRAVTREE: Tree construction done. took 17.2361 sec =980417 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995239 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.07 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 260.529 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2225 sec PM-PERIODIC: done. (took 13.1736 seconds) TIMESTEPS: displacement time constraint: 0.00646671 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22498 sec PM-PERIODIC: done. (took 13.5018 seconds) TIMESTEPS: displacement time constraint: 0.0064667 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1635, Time: 0.67816, Redshift: 0.474579, Systemstep: 0.000573567, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1635). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77837 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0907|1.01418 DOMAIN: combining multiple-domains took 0.284409 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49429 sec) DOMAIN: domain decomposition done. (took in total 5.94551 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.51957 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 17.2878 sec =980438 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995239 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.06 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.564 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1636, Time: 0.678734, Redshift: 0.473331, Systemstep: 0.000574052, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1636). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78669 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09075|1.01418 DOMAIN: combining multiple-domains took 0.286689 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1577 sec) DOMAIN: domain decomposition done. (took in total 5.62224 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22509 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.41 MB) GRAVTREE: Tree construction done. took 17.2948 sec =980479 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995239 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.07 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.741 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1637, Time: 0.679308, Redshift: 0.472085, Systemstep: 0.000574538, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1637). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.01825 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08472|1.01418 DOMAIN: combining multiple-domains took 0.289087 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.01261 sec) DOMAIN: domain decomposition done. (took in total 5.77733 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22857 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 17.2526 sec =980535 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995239 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.08 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 260.583 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1638, Time: 0.679883, Redshift: 0.47084, Systemstep: 0.000575024, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1638). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79074 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08472|1.01418 DOMAIN: combining multiple-domains took 0.284866 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.14394 sec) DOMAIN: domain decomposition done. (took in total 5.60838 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24996 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 17.2574 sec =980564 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995239 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.08 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 260.772 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22152 sec PM-PERIODIC: done. (took 13.2763 seconds) TIMESTEPS: displacement time constraint: 0.0064361 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31408 sec PM-PERIODIC: done. (took 13.3659 seconds) TIMESTEPS: displacement time constraint: 0.00643609 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1639, Time: 0.680459, Redshift: 0.469596, Systemstep: 0.000575511, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1639). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78104 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08474|1.01418 DOMAIN: combining multiple-domains took 0.287361 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.69624 sec) DOMAIN: domain decomposition done. (took in total 5.1536 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27927 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.7 MB) GRAVTREE: Tree construction done. took 17.2505 sec =980608 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99524 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.08 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 260.997 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1640, Time: 0.681035, Redshift: 0.468353, Systemstep: 0.000575998, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1640). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78289 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08912|1.01418 DOMAIN: combining multiple-domains took 0.301935 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47988 sec) DOMAIN: domain decomposition done. (took in total 5.95334 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.08668 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.22 MB) GRAVTREE: Tree construction done. took 17.2464 sec =980671 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99524 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.8 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 262.06 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1641, Time: 0.681611, Redshift: 0.467111, Systemstep: 0.000576486, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1641). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79026 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08906|1.01418 DOMAIN: combining multiple-domains took 0.288068 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.9938 sec) DOMAIN: domain decomposition done. (took in total 5.46221 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.227 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.2493 sec =980710 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99524 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 262.002 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1642, Time: 0.682188, Redshift: 0.465871, Systemstep: 0.000576974, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1642). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78709 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08902|1.01418 DOMAIN: combining multiple-domains took 0.286416 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.15037 sec) DOMAIN: domain decomposition done. (took in total 4.61378 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28603 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.2535 sec =980767 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99524 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 261.969 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21981 sec PM-PERIODIC: done. (took 13.8657 seconds) TIMESTEPS: displacement time constraint: 0.00642385 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2321 sec PM-PERIODIC: done. (took 13.2955 seconds) TIMESTEPS: displacement time constraint: 0.00642384 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1643, Time: 0.682766, Redshift: 0.464631, Systemstep: 0.000577462, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1643). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79363 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08895|1.01418 DOMAIN: combining multiple-domains took 0.287196 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.83488 sec) DOMAIN: domain decomposition done. (took in total 5.30579 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19472 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.2664 sec =980820 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995241 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.77 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 262.024 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1644, Time: 0.683344, Redshift: 0.463392, Systemstep: 0.000577951, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1644). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79107 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08889|1.01418 DOMAIN: combining multiple-domains took 0.287217 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15067 sec) DOMAIN: domain decomposition done. (took in total 5.61931 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25953 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.19 MB) GRAVTREE: Tree construction done. took 17.2673 sec =980871 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995241 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.76 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 262.244 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1645, Time: 0.683922, Redshift: 0.462154, Systemstep: 0.00057844, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1645). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7829 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08885|1.01418 DOMAIN: combining multiple-domains took 0.285856 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.92905 sec) DOMAIN: domain decomposition done. (took in total 5.3901 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24657 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.18 MB) GRAVTREE: Tree construction done. took 17.2664 sec =980899 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995241 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.76 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 262.047 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1646, Time: 0.684501, Redshift: 0.460918, Systemstep: 0.00057893, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1646). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83625 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09278|1.01982 DOMAIN: combining multiple-domains took 0.286624 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5006 sec) DOMAIN: domain decomposition done. (took in total 15.0266 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.11737 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.65 MB) GRAVTREE: Tree construction done. took 17.4029 sec =980932 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995241 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.4 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.556 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3284 sec PM-PERIODIC: done. (took 13.5905 seconds) TIMESTEPS: displacement time constraint: 0.00641992 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31342 sec PM-PERIODIC: done. (took 13.6624 seconds) TIMESTEPS: displacement time constraint: 0.00641991 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 229.955 sec, total size 352287 MB, corresponds to effective I/O rate of 1531.98 MB/sec Sync-Point 1647, Time: 0.685081, Redshift: 0.459682, Systemstep: 0.00057942, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1647). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7928 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.0927|1.01982 DOMAIN: combining multiple-domains took 0.288864 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56205 sec) DOMAIN: domain decomposition done. (took in total 6.03842 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24406 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.64 MB) GRAVTREE: Tree construction done. took 17.5024 sec =980980 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995241 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.38 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.894 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1648, Time: 0.685661, Redshift: 0.458448, Systemstep: 0.00057991, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1648). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79349 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09264|1.01982 DOMAIN: combining multiple-domains took 0.288647 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.21159 sec) DOMAIN: domain decomposition done. (took in total 4.68662 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26485 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.63 MB) GRAVTREE: Tree construction done. took 17.3979 sec =981030 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995242 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.37 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.682 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1649, Time: 0.686241, Redshift: 0.457214, Systemstep: 0.000580401, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1649). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79151 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09486|1.04768 DOMAIN: combining multiple-domains took 0.288302 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.908 sec) DOMAIN: domain decomposition done. (took in total 14.3809 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.39828 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.89 MB) GRAVTREE: Tree construction done. took 17.3761 sec =981069 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995242 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.74 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.285 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1650, Time: 0.686822, Redshift: 0.455982, Systemstep: 0.000580893, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1650). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79583 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09484|1.04768 DOMAIN: combining multiple-domains took 0.286822 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39974 sec) DOMAIN: domain decomposition done. (took in total 5.87433 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20752 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.89 MB) GRAVTREE: Tree construction done. took 17.3731 sec =981092 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995242 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.73 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.123 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30141 sec PM-PERIODIC: done. (took 13.6776 seconds) TIMESTEPS: displacement time constraint: 0.00640719 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.41755 sec PM-PERIODIC: done. (took 14.1176 seconds) TIMESTEPS: displacement time constraint: 0.00640718 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1651, Time: 0.687403, Redshift: 0.45475, Systemstep: 0.000581384, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1651). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79886 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09479|1.04768 DOMAIN: combining multiple-domains took 0.287172 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11354 sec) DOMAIN: domain decomposition done. (took in total 4.59183 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2822 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.88 MB) GRAVTREE: Tree construction done. took 17.3796 sec =981114 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995242 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.73 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.22 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1652, Time: 0.687985, Redshift: 0.45352, Systemstep: 0.000581877, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1652). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.799 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09474|1.03815 DOMAIN: combining multiple-domains took 0.28634 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.1732 sec) DOMAIN: domain decomposition done. (took in total 4.65217 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29785 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.88 MB) GRAVTREE: Tree construction done. took 17.3846 sec =981165 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995242 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.72 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.311 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1653, Time: 0.688567, Redshift: 0.452291, Systemstep: 0.000582369, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1653). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79558 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09469|1.03815 DOMAIN: combining multiple-domains took 0.287951 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37526 sec) DOMAIN: domain decomposition done. (took in total 4.85058 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27765 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.87 MB) GRAVTREE: Tree construction done. took 17.3782 sec =981198 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995243 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.71 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.456 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1654, Time: 0.68915, Redshift: 0.451062, Systemstep: 0.000582862, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1654). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79276 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09467|1.03815 DOMAIN: combining multiple-domains took 0.286584 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.09785 sec) DOMAIN: domain decomposition done. (took in total 5.56895 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20565 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.87 MB) GRAVTREE: Tree construction done. took 17.4151 sec =981263 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995243 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.71 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.39 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32013 sec PM-PERIODIC: done. (took 13.8159 seconds) TIMESTEPS: displacement time constraint: 0.00639946 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.47444 sec PM-PERIODIC: done. (took 14.0587 seconds) TIMESTEPS: displacement time constraint: 0.00639945 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1655, Time: 0.689734, Redshift: 0.449835, Systemstep: 0.000583355, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1655). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80328 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09464|1.03815 DOMAIN: combining multiple-domains took 0.286471 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.30636 sec) DOMAIN: domain decomposition done. (took in total 6.78767 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26187 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.87 MB) GRAVTREE: Tree construction done. took 17.3956 sec =981303 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995243 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.175 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1656, Time: 0.690318, Redshift: 0.448609, Systemstep: 0.000583849, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1656). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79758 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09462|1.03815 DOMAIN: combining multiple-domains took 0.289808 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90317 sec) DOMAIN: domain decomposition done. (took in total 5.38307 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26163 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.86 MB) GRAVTREE: Tree construction done. took 17.3791 sec =981336 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995243 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.71 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1657, Time: 0.690902, Redshift: 0.447384, Systemstep: 0.000584343, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1657). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79168 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09464|1.03815 DOMAIN: combining multiple-domains took 0.287916 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62555 sec) DOMAIN: domain decomposition done. (took in total 5.0974 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30909 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.87 MB) GRAVTREE: Tree construction done. took 17.4311 sec =981370 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995243 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.594 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1658, Time: 0.691487, Redshift: 0.446159, Systemstep: 0.000584838, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1658). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79517 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09471|1.03815 DOMAIN: combining multiple-domains took 0.290935 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14003 sec) DOMAIN: domain decomposition done. (took in total 4.61873 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31177 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.87 MB) GRAVTREE: Tree construction done. took 17.4355 sec =981399 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995244 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.71 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.586 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27236 sec PM-PERIODIC: done. (took 13.7677 seconds) TIMESTEPS: displacement time constraint: 0.00640885 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28098 sec PM-PERIODIC: done. (took 13.6652 seconds) TIMESTEPS: displacement time constraint: 0.00640884 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1659, Time: 0.692072, Redshift: 0.444936, Systemstep: 0.000585333, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1659). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79849 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09479|1.03815 DOMAIN: combining multiple-domains took 0.2908 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18501 sec) DOMAIN: domain decomposition done. (took in total 4.66647 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3059 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.88 MB) GRAVTREE: Tree construction done. took 17.4497 sec =981459 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995244 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.72 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.244 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1660, Time: 0.692658, Redshift: 0.443714, Systemstep: 0.000585829, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1660). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79899 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09486|1.03815 DOMAIN: combining multiple-domains took 0.296651 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.45563 sec) DOMAIN: domain decomposition done. (took in total 4.94634 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29809 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.89 MB) GRAVTREE: Tree construction done. took 17.3914 sec =981470 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995244 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.74 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 268.029 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1661, Time: 0.693244, Redshift: 0.442493, Systemstep: 0.000586324, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1661). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78959 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09493|1.03815 DOMAIN: combining multiple-domains took 0.290796 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26531 sec) DOMAIN: domain decomposition done. (took in total 5.73793 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30797 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.9 MB) GRAVTREE: Tree construction done. took 17.4569 sec =981495 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995244 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.75 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.609 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1662, Time: 0.693831, Redshift: 0.441273, Systemstep: 0.000586821, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1662). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79736 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08845|1.01418 DOMAIN: combining multiple-domains took 0.289793 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.0125 sec) DOMAIN: domain decomposition done. (took in total 15.4919 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.04018 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.3693 sec =981567 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995244 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.40358 sec PM-PERIODIC: done. (took 13.8587 seconds) TIMESTEPS: displacement time constraint: 0.00640913 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22269 sec PM-PERIODIC: done. (took 13.5865 seconds) TIMESTEPS: displacement time constraint: 0.00640912 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1663, Time: 0.694418, Redshift: 0.440054, Systemstep: 0.000587318, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1663). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78519 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08846|1.01418 DOMAIN: combining multiple-domains took 0.287683 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.155 sec) DOMAIN: domain decomposition done. (took in total 5.62417 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27038 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.3673 sec =981601 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995245 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.772 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1664, Time: 0.695006, Redshift: 0.438836, Systemstep: 0.000587815, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1664). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78864 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08847|1.01418 DOMAIN: combining multiple-domains took 0.287763 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.83314 sec) DOMAIN: domain decomposition done. (took in total 5.30037 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27936 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.3589 sec =981663 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995245 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 263.324 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1665, Time: 0.695594, Redshift: 0.437619, Systemstep: 0.000588312, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1665). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79384 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08849|1.01418 DOMAIN: combining multiple-domains took 0.289288 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.59633 sec) DOMAIN: domain decomposition done. (took in total 6.07051 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26134 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.373 sec =981706 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995245 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 262.769 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1666, Time: 0.696183, Redshift: 0.436403, Systemstep: 0.00058881, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1666). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78435 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08851|1.01418 DOMAIN: combining multiple-domains took 0.287034 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.97495 sec) DOMAIN: domain decomposition done. (took in total 5.43785 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19574 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.3626 sec =981750 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995245 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 265.138 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25046 sec PM-PERIODIC: done. (took 13.6598 seconds) TIMESTEPS: displacement time constraint: 0.00640051 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24346 sec PM-PERIODIC: done. (took 14.1313 seconds) TIMESTEPS: displacement time constraint: 0.00640051 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1667, Time: 0.696773, Redshift: 0.435188, Systemstep: 0.000589309, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1667). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7913 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.0954|1.03815 DOMAIN: combining multiple-domains took 0.2877 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5306 sec) DOMAIN: domain decomposition done. (took in total 14.9995 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.39055 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.96 MB) GRAVTREE: Tree construction done. took 17.4472 sec =981802 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995245 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.82 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.13 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1668, Time: 0.697362, Redshift: 0.433975, Systemstep: 0.000589808, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1668). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79544 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09548|1.03815 DOMAIN: combining multiple-domains took 0.290594 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.70632 sec) DOMAIN: domain decomposition done. (took in total 6.18459 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31372 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.97 MB) GRAVTREE: Tree construction done. took 17.4254 sec =981841 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995246 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.84 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.983 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1669, Time: 0.697953, Redshift: 0.432762, Systemstep: 0.000590307, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1669). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7888 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.09557|1.03815 DOMAIN: combining multiple-domains took 0.29073 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.13145 sec) DOMAIN: domain decomposition done. (took in total 5.60289 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29826 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.4193 sec =981851 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995246 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.85 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.114 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 197.656 sec, total size 352287 MB, corresponds to effective I/O rate of 1782.32 MB/sec Sync-Point 1670, Time: 0.698544, Redshift: 0.43155, Systemstep: 0.000590806, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1670). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79184 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09564|1.04768 DOMAIN: combining multiple-domains took 0.289834 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.70881 sec) DOMAIN: domain decomposition done. (took in total 6.18419 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30788 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.4214 sec =981868 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995246 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.86 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.407 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27002 sec PM-PERIODIC: done. (took 13.691 seconds) TIMESTEPS: displacement time constraint: 0.00638709 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23966 sec PM-PERIODIC: done. (took 13.8337 seconds) TIMESTEPS: displacement time constraint: 0.00638708 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1671, Time: 0.699135, Redshift: 0.430339, Systemstep: 0.000591307, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1671). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79121 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09572|1.04768 DOMAIN: combining multiple-domains took 0.28745 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21164 sec) DOMAIN: domain decomposition done. (took in total 5.68233 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29605 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.4109 sec =981910 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995246 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.88 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.446 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1672, Time: 0.699727, Redshift: 0.42913, Systemstep: 0.000591807, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1672). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78867 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09579|1.04768 DOMAIN: combining multiple-domains took 0.28821 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.33768 sec) DOMAIN: domain decomposition done. (took in total 4.80986 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3091 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814 MB) GRAVTREE: Tree construction done. took 17.4108 sec =981957 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995246 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.89 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.467 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1673, Time: 0.700319, Redshift: 0.427921, Systemstep: 0.000592308, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1673). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79737 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09586|1.04768 DOMAIN: combining multiple-domains took 0.287291 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36126 sec) DOMAIN: domain decomposition done. (took in total 5.83859 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30406 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.01 MB) GRAVTREE: Tree construction done. took 17.4931 sec =981996 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995246 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.9 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.454 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1674, Time: 0.700912, Redshift: 0.426713, Systemstep: 0.000592809, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1674). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79325 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09595|1.04768 DOMAIN: combining multiple-domains took 0.288027 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.96082 sec) DOMAIN: domain decomposition done. (took in total 6.43295 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27425 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.02 MB) GRAVTREE: Tree construction done. took 17.3782 sec =982029 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995247 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.91 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 271.206 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2185 sec PM-PERIODIC: done. (took 13.8175 seconds) TIMESTEPS: displacement time constraint: 0.00637339 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22995 sec PM-PERIODIC: done. (took 13.9031 seconds) TIMESTEPS: displacement time constraint: 0.00637338 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1675, Time: 0.701505, Redshift: 0.425506, Systemstep: 0.000593311, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1675). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78424 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09602|1.04768 DOMAIN: combining multiple-domains took 0.287806 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.76918 sec) DOMAIN: domain decomposition done. (took in total 6.23266 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32561 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.03 MB) GRAVTREE: Tree construction done. took 17.4037 sec =982070 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995247 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.93 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 270.079 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1676, Time: 0.702099, Redshift: 0.424301, Systemstep: 0.000593813, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1676). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.05593 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09609|1.04768 DOMAIN: combining multiple-domains took 0.287426 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17186 sec) DOMAIN: domain decomposition done. (took in total 5.97431 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24142 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.04 MB) GRAVTREE: Tree construction done. took 17.4076 sec =982109 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995247 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.94 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.941 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1677, Time: 0.702693, Redshift: 0.423096, Systemstep: 0.000594316, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1677). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79371 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09617|1.04768 DOMAIN: combining multiple-domains took 0.286999 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.82543 sec) DOMAIN: domain decomposition done. (took in total 5.29808 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26797 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.05 MB) GRAVTREE: Tree construction done. took 17.4601 sec =982163 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995247 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.073 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1678, Time: 0.703288, Redshift: 0.421893, Systemstep: 0.000594819, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1678). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78865 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09625|1.04768 DOMAIN: combining multiple-domains took 0.28832 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37929 sec) DOMAIN: domain decomposition done. (took in total 4.84826 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30331 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.06 MB) GRAVTREE: Tree construction done. took 17.4005 sec =982200 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995247 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.96 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.13 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24647 sec PM-PERIODIC: done. (took 13.5789 seconds) TIMESTEPS: displacement time constraint: 0.00637675 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20734 sec PM-PERIODIC: done. (took 13.7693 seconds) TIMESTEPS: displacement time constraint: 0.00637674 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1679, Time: 0.703883, Redshift: 0.42069, Systemstep: 0.000595323, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1679). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79047 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09633|1.04768 DOMAIN: combining multiple-domains took 0.287367 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.56122 sec) DOMAIN: domain decomposition done. (took in total 5.03083 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31757 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.06 MB) GRAVTREE: Tree construction done. took 17.4163 sec =982251 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995248 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.222 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1680, Time: 0.704479, Redshift: 0.419488, Systemstep: 0.000595827, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1680). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80004 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0964|1.04768 DOMAIN: combining multiple-domains took 0.287531 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56586 sec) DOMAIN: domain decomposition done. (took in total 6.04576 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28432 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.07 MB) GRAVTREE: Tree construction done. took 17.4097 sec =982298 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995248 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.99 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 271.265 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1681, Time: 0.705075, Redshift: 0.418288, Systemstep: 0.000596331, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1681). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79357 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09645|1.04768 DOMAIN: combining multiple-domains took 0.287206 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16859 sec) DOMAIN: domain decomposition done. (took in total 5.64066 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25989 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.08 MB) GRAVTREE: Tree construction done. took 17.4482 sec =982331 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995248 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.498 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1682, Time: 0.705672, Redshift: 0.417088, Systemstep: 0.000596836, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1682). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79098 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09653|1.04768 DOMAIN: combining multiple-domains took 0.28834 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41639 sec) DOMAIN: domain decomposition done. (took in total 5.88812 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31196 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.09 MB) GRAVTREE: Tree construction done. took 17.4401 sec =982379 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995248 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.01 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.747 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28334 sec PM-PERIODIC: done. (took 13.8373 seconds) TIMESTEPS: displacement time constraint: 0.00634298 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25305 sec PM-PERIODIC: done. (took 13.9478 seconds) TIMESTEPS: displacement time constraint: 0.00634297 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1683, Time: 0.70627, Redshift: 0.41589, Systemstep: 0.000597341, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1683). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79208 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09661|1.04768 DOMAIN: combining multiple-domains took 0.289149 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.39819 sec) DOMAIN: domain decomposition done. (took in total 4.87231 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27954 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.1 MB) GRAVTREE: Tree construction done. took 17.421 sec =982419 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995248 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.02 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.555 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1684, Time: 0.706868, Redshift: 0.414692, Systemstep: 0.000597847, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1684). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79271 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09668|1.04768 DOMAIN: combining multiple-domains took 0.288559 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.20778 sec) DOMAIN: domain decomposition done. (took in total 4.6816 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31959 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.5814 sec =982454 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995249 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.03 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.689 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1685, Time: 0.707466, Redshift: 0.413496, Systemstep: 0.000598353, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1685). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78907 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09674|1.04768 DOMAIN: combining multiple-domains took 0.288001 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.17673 sec) DOMAIN: domain decomposition done. (took in total 6.64615 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22137 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.4528 sec =982497 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995249 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 270.817 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1686, Time: 0.708065, Redshift: 0.4123, Systemstep: 0.000598859, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1686). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79828 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09678|1.04768 DOMAIN: combining multiple-domains took 0.291005 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.5027 sec) DOMAIN: domain decomposition done. (took in total 5.98516 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29754 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.12 MB) GRAVTREE: Tree construction done. took 17.4466 sec =982524 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995249 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 270.794 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.42323 sec PM-PERIODIC: done. (took 13.9035 seconds) TIMESTEPS: displacement time constraint: 0.00635233 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27911 sec PM-PERIODIC: done. (took 13.8426 seconds) TIMESTEPS: displacement time constraint: 0.00635232 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1687, Time: 0.708664, Redshift: 0.411106, Systemstep: 0.000599366, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1687). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79594 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09686|1.04768 DOMAIN: combining multiple-domains took 0.290195 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.30251 sec) DOMAIN: domain decomposition done. (took in total 6.78328 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27577 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.13 MB) GRAVTREE: Tree construction done. took 17.5854 sec =982556 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995249 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.06 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 270.631 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1688, Time: 0.709264, Redshift: 0.409912, Systemstep: 0.000599874, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1688). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7981 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09694|1.04768 DOMAIN: combining multiple-domains took 0.287682 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09313 sec) DOMAIN: domain decomposition done. (took in total 4.57231 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31992 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.14 MB) GRAVTREE: Tree construction done. took 17.4828 sec =982620 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995249 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.07 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.653 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1689, Time: 0.709864, Redshift: 0.40872, Systemstep: 0.000600381, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1689). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80513 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09698|1.04768 DOMAIN: combining multiple-domains took 0.29054 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2396 sec) DOMAIN: domain decomposition done. (took in total 5.7286 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27766 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.14 MB) GRAVTREE: Tree construction done. took 17.4802 sec =982669 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99525 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.08 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.885 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1690, Time: 0.710465, Redshift: 0.407528, Systemstep: 0.00060089, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1690). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7955 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09705|1.04768 DOMAIN: combining multiple-domains took 0.288406 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.15088 sec) DOMAIN: domain decomposition done. (took in total 4.6284 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32228 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.15 MB) GRAVTREE: Tree construction done. took 17.4684 sec =982692 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99525 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.09 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.77 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22892 sec PM-PERIODIC: done. (took 13.6449 seconds) TIMESTEPS: displacement time constraint: 0.00635687 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24827 sec PM-PERIODIC: done. (took 13.6586 seconds) TIMESTEPS: displacement time constraint: 0.00635687 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1691, Time: 0.711067, Redshift: 0.406338, Systemstep: 0.000601398, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1691). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80002 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09714|1.04768 DOMAIN: combining multiple-domains took 0.28846 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.84556 sec) DOMAIN: domain decomposition done. (took in total 5.32709 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28376 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.16 MB) GRAVTREE: Tree construction done. took 17.4899 sec =982725 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99525 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.11 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.938 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1692, Time: 0.711669, Redshift: 0.405149, Systemstep: 0.000601907, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1692). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79477 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09633|1.01559 DOMAIN: combining multiple-domains took 0.28836 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.3289 sec) DOMAIN: domain decomposition done. (took in total 14.8053 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3646 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.06 MB) GRAVTREE: Tree construction done. took 17.3987 sec =982763 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99525 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.712 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 342.018 sec, total size 352287 MB, corresponds to effective I/O rate of 1030.02 MB/sec Sync-Point 1693, Time: 0.712271, Redshift: 0.40396, Systemstep: 0.000602417, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1693). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79123 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09636|1.01559 DOMAIN: combining multiple-domains took 0.289289 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12004 sec) DOMAIN: domain decomposition done. (took in total 4.59362 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32422 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.07 MB) GRAVTREE: Tree construction done. took 17.3959 sec =982795 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99525 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.98 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.917 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1694, Time: 0.712874, Redshift: 0.402773, Systemstep: 0.000602927, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1694). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79091 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0964|1.01559 DOMAIN: combining multiple-domains took 0.288097 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07726 sec) DOMAIN: domain decomposition done. (took in total 4.54823 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32959 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.07 MB) GRAVTREE: Tree construction done. took 17.3922 sec =982835 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99525 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.99 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.421 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.54636 sec PM-PERIODIC: done. (took 13.9815 seconds) TIMESTEPS: displacement time constraint: 0.0063445 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28232 sec PM-PERIODIC: done. (took 13.793 seconds) TIMESTEPS: displacement time constraint: 0.0063445 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1695, Time: 0.713477, Redshift: 0.401586, Systemstep: 0.000603437, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1695). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.70708 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09005|1.01559 DOMAIN: combining multiple-domains took 0.489442 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.33864 sec) DOMAIN: domain decomposition done. (took in total 6.92763 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22071 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 17.3765 sec =982884 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995251 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.284 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1696, Time: 0.714081, Redshift: 0.400401, Systemstep: 0.000603948, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1696). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78247 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09601|1.01559 DOMAIN: combining multiple-domains took 0.288857 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.65011 sec) DOMAIN: domain decomposition done. (took in total 6.11292 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.51548 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.03 MB) GRAVTREE: Tree construction done. took 17.436 sec =982920 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995251 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.92 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.233 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1697, Time: 0.714686, Redshift: 0.399216, Systemstep: 0.000604459, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1697). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78696 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09609|1.01559 DOMAIN: combining multiple-domains took 0.287238 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.23097 sec) DOMAIN: domain decomposition done. (took in total 4.69796 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29791 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.04 MB) GRAVTREE: Tree construction done. took 17.4702 sec =982956 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995251 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.94 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.225 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1698, Time: 0.715291, Redshift: 0.398033, Systemstep: 0.000604971, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1698). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78969 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09617|1.01559 DOMAIN: combining multiple-domains took 0.287188 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.86525 sec) DOMAIN: domain decomposition done. (took in total 5.33429 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26898 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.05 MB) GRAVTREE: Tree construction done. took 17.454 sec =983018 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995251 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.95 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.852 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.51284 sec PM-PERIODIC: done. (took 14.1869 seconds) TIMESTEPS: displacement time constraint: 0.00635189 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29773 sec PM-PERIODIC: done. (took 13.8873 seconds) TIMESTEPS: displacement time constraint: 0.00635188 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1699, Time: 0.715896, Redshift: 0.396851, Systemstep: 0.000605483, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1699). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86235 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09624|1.01559 DOMAIN: combining multiple-domains took 0.287094 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93784 sec) DOMAIN: domain decomposition done. (took in total 5.47911 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2753 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.05 MB) GRAVTREE: Tree construction done. took 17.4232 sec =983026 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995251 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.96 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.699 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1700, Time: 0.716502, Redshift: 0.395669, Systemstep: 0.000605995, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1700). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78567 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09781|1.04768 DOMAIN: combining multiple-domains took 0.287129 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.644 sec) DOMAIN: domain decomposition done. (took in total 15.1091 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.5105 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.24 MB) GRAVTREE: Tree construction done. took 17.4437 sec =983055 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995252 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.773 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1701, Time: 0.717109, Redshift: 0.394489, Systemstep: 0.000606508, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1701). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79167 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09791|1.04768 DOMAIN: combining multiple-domains took 0.288189 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.38133 sec) DOMAIN: domain decomposition done. (took in total 4.8526 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30351 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.25 MB) GRAVTREE: Tree construction done. took 17.5493 sec =983100 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995252 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.543 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1702, Time: 0.717716, Redshift: 0.393309, Systemstep: 0.000607022, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1702). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79784 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09798|1.04768 DOMAIN: combining multiple-domains took 0.288071 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07634 sec) DOMAIN: domain decomposition done. (took in total 4.55565 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30366 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.26 MB) GRAVTREE: Tree construction done. took 17.4425 sec =983092 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995252 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.24 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.918 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2302 sec PM-PERIODIC: done. (took 13.734 seconds) TIMESTEPS: displacement time constraint: 0.00634767 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30993 sec PM-PERIODIC: done. (took 14.1139 seconds) TIMESTEPS: displacement time constraint: 0.00634767 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1703, Time: 0.718323, Redshift: 0.392131, Systemstep: 0.000607536, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1703). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79801 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09806|1.04768 DOMAIN: combining multiple-domains took 0.288675 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.34713 sec) DOMAIN: domain decomposition done. (took in total 4.8262 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31001 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.27 MB) GRAVTREE: Tree construction done. took 17.5445 sec =983167 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995252 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.26 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 273.814 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1704, Time: 0.718931, Redshift: 0.390954, Systemstep: 0.00060805, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1704). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78894 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09816|1.04768 DOMAIN: combining multiple-domains took 0.286918 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26266 sec) DOMAIN: domain decomposition done. (took in total 4.73288 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26901 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.28 MB) GRAVTREE: Tree construction done. took 17.4052 sec =983199 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995252 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.27 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.134 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1705, Time: 0.71954, Redshift: 0.389777, Systemstep: 0.000608565, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1705). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.11516 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09823|1.04768 DOMAIN: combining multiple-domains took 0.516996 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19868 sec) DOMAIN: domain decomposition done. (took in total 6.6254 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28022 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.29 MB) GRAVTREE: Tree construction done. took 18.2139 sec =983229 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995252 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.93 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1706, Time: 0.720149, Redshift: 0.388602, Systemstep: 0.00060908, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1706). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78812 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0983|1.04768 DOMAIN: combining multiple-domains took 0.289234 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44026 sec) DOMAIN: domain decomposition done. (took in total 5.91125 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29266 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.3 MB) GRAVTREE: Tree construction done. took 17.4472 sec =983273 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995253 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.3 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 273.273 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26084 sec PM-PERIODIC: done. (took 14.0218 seconds) TIMESTEPS: displacement time constraint: 0.00636501 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2814 sec PM-PERIODIC: done. (took 13.8295 seconds) TIMESTEPS: displacement time constraint: 0.006365 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1707, Time: 0.720759, Redshift: 0.387427, Systemstep: 0.000609595, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1707). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.05034 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09838|1.04768 DOMAIN: combining multiple-domains took 0.288041 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2546 sec) DOMAIN: domain decomposition done. (took in total 6.00737 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24382 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.31 MB) GRAVTREE: Tree construction done. took 17.4559 sec =983316 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995253 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.31 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.442 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1708, Time: 0.721369, Redshift: 0.386254, Systemstep: 0.000610111, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1708). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78476 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09846|1.04768 DOMAIN: combining multiple-domains took 0.289678 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44578 sec) DOMAIN: domain decomposition done. (took in total 5.9133 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26763 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.32 MB) GRAVTREE: Tree construction done. took 17.4559 sec =983369 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995253 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.32 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.114 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1709, Time: 0.721979, Redshift: 0.385081, Systemstep: 0.000610628, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1709). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78875 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09855|1.04768 DOMAIN: combining multiple-domains took 0.288596 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73614 sec) DOMAIN: domain decomposition done. (took in total 5.20647 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30874 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.33 MB) GRAVTREE: Tree construction done. took 17.4629 sec =983422 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995253 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.34 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.197 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1710, Time: 0.72259, Redshift: 0.38391, Systemstep: 0.000611145, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1710). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78685 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09861|1.04768 DOMAIN: combining multiple-domains took 0.288799 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39656 sec) DOMAIN: domain decomposition done. (took in total 5.8654 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2996 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.33 MB) GRAVTREE: Tree construction done. took 17.4396 sec =983455 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995253 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.35 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.204 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25628 sec PM-PERIODIC: done. (took 14.0596 seconds) TIMESTEPS: displacement time constraint: 0.00637436 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28536 sec PM-PERIODIC: done. (took 14.4304 seconds) TIMESTEPS: displacement time constraint: 0.00637436 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1711, Time: 0.723202, Redshift: 0.382739, Systemstep: 0.000611662, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1711). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78818 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09868|1.04768 DOMAIN: combining multiple-domains took 0.288761 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.17055 sec) DOMAIN: domain decomposition done. (took in total 4.64094 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2919 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.34 MB) GRAVTREE: Tree construction done. took 17.4373 sec =983494 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.36 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.237 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1712, Time: 0.723814, Redshift: 0.38157, Systemstep: 0.00061218, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1712). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78869 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09875|1.04768 DOMAIN: combining multiple-domains took 0.288759 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2074 sec) DOMAIN: domain decomposition done. (took in total 5.67768 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27278 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.35 MB) GRAVTREE: Tree construction done. took 17.4407 sec =983525 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.37 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.548 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1713, Time: 0.724427, Redshift: 0.380401, Systemstep: 0.000612698, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1713). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78849 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09225|1.01418 DOMAIN: combining multiple-domains took 0.288797 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2741 sec) DOMAIN: domain decomposition done. (took in total 15.7443 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33642 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.59 MB) GRAVTREE: Tree construction done. took 17.3517 sec =983562 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.31 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.765 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1714, Time: 0.72504, Redshift: 0.379234, Systemstep: 0.000613217, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1714). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78144 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09221|1.01418 DOMAIN: combining multiple-domains took 0.287318 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.67912 sec) DOMAIN: domain decomposition done. (took in total 5.139 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26987 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.58 MB) GRAVTREE: Tree construction done. took 17.3857 sec =983604 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.766 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21962 sec PM-PERIODIC: done. (took 13.5159 seconds) TIMESTEPS: displacement time constraint: 0.00637365 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25731 sec PM-PERIODIC: done. (took 14.1425 seconds) TIMESTEPS: displacement time constraint: 0.00637365 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 271.171 sec, total size 352287 MB, corresponds to effective I/O rate of 1299.13 MB/sec Sync-Point 1715, Time: 0.725654, Redshift: 0.378067, Systemstep: 0.000613736, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1715). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78619 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09218|1.01418 DOMAIN: combining multiple-domains took 0.287473 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.40074 sec) DOMAIN: domain decomposition done. (took in total 5.8649 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25264 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.58 MB) GRAVTREE: Tree construction done. took 17.5287 sec =983642 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.3 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.646 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1716, Time: 0.726268, Redshift: 0.376902, Systemstep: 0.000614255, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1716). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78568 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09216|1.01418 DOMAIN: combining multiple-domains took 0.286516 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8308 sec) DOMAIN: domain decomposition done. (took in total 5.29346 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26967 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.5255 sec =983663 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.033 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1717, Time: 0.726883, Redshift: 0.375737, Systemstep: 0.000614775, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1717). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78549 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09214|1.01418 DOMAIN: combining multiple-domains took 0.287572 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.68131 sec) DOMAIN: domain decomposition done. (took in total 5.14688 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20715 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.5323 sec =983668 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995254 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.808 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1718, Time: 0.727498, Redshift: 0.374574, Systemstep: 0.000615295, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1718). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78955 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09211|1.01418 DOMAIN: combining multiple-domains took 0.287975 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1274 sec) DOMAIN: domain decomposition done. (took in total 5.59728 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26176 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.3816 sec =983715 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995255 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.294 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29132 sec PM-PERIODIC: done. (took 13.5711 seconds) TIMESTEPS: displacement time constraint: 0.00637908 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27755 sec PM-PERIODIC: done. (took 13.947 seconds) TIMESTEPS: displacement time constraint: 0.00637908 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1719, Time: 0.728114, Redshift: 0.373411, Systemstep: 0.000615816, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1719). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79273 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09208|1.01418 DOMAIN: combining multiple-domains took 0.287499 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.53157 sec) DOMAIN: domain decomposition done. (took in total 5.00346 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27643 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.56 MB) GRAVTREE: Tree construction done. took 17.3784 sec =983741 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995255 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.28 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.369 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1720, Time: 0.72873, Redshift: 0.37225, Systemstep: 0.000616338, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1720). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78156 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09204|1.01418 DOMAIN: combining multiple-domains took 0.288375 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19276 sec) DOMAIN: domain decomposition done. (took in total 5.65325 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2507 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.56 MB) GRAVTREE: Tree construction done. took 17.3889 sec =983773 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995255 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.28 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.806 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1721, Time: 0.729347, Redshift: 0.371089, Systemstep: 0.000616859, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1721). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77828 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09199|1.01418 DOMAIN: combining multiple-domains took 0.288569 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28987 sec) DOMAIN: domain decomposition done. (took in total 5.74869 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24233 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.3978 sec =983814 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995255 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.27 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.526 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1722, Time: 0.729965, Redshift: 0.369929, Systemstep: 0.000617381, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1722). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78444 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09197|1.01418 DOMAIN: combining multiple-domains took 0.287012 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20605 sec) DOMAIN: domain decomposition done. (took in total 5.66939 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25209 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.4005 sec =983859 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995255 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.146 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26418 sec PM-PERIODIC: done. (took 13.5432 seconds) TIMESTEPS: displacement time constraint: 0.00637338 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23895 sec PM-PERIODIC: done. (took 13.6881 seconds) TIMESTEPS: displacement time constraint: 0.00637338 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1723, Time: 0.730583, Redshift: 0.368771, Systemstep: 0.000617904, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1723). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78547 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09193|1.01418 DOMAIN: combining multiple-domains took 0.28687 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.82392 sec) DOMAIN: domain decomposition done. (took in total 5.28727 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27496 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.4027 sec =983935 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995256 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.994 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1724, Time: 0.731201, Redshift: 0.367613, Systemstep: 0.000618427, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1724). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77978 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0919|1.01418 DOMAIN: combining multiple-domains took 0.288556 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.57238 sec) DOMAIN: domain decomposition done. (took in total 6.03177 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22654 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.3931 sec =983980 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995256 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.368 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1725, Time: 0.73182, Redshift: 0.366456, Systemstep: 0.000618951, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1725). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79448 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09188|1.01418 DOMAIN: combining multiple-domains took 0.288879 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.17862 sec) DOMAIN: domain decomposition done. (took in total 4.65316 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27645 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.3861 sec =984011 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995256 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.436 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1726, Time: 0.732439, Redshift: 0.365301, Systemstep: 0.000619475, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1726). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80034 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09182|1.01418 DOMAIN: combining multiple-domains took 0.28741 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.58364 sec) DOMAIN: domain decomposition done. (took in total 6.06302 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23185 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.4125 sec =984053 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995256 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.054 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2356 sec PM-PERIODIC: done. (took 13.8278 seconds) TIMESTEPS: displacement time constraint: 0.00637374 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30609 sec PM-PERIODIC: done. (took 14.1676 seconds) TIMESTEPS: displacement time constraint: 0.00637373 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1727, Time: 0.733059, Redshift: 0.364146, Systemstep: 0.000619999, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1727). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79228 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0918|1.01418 DOMAIN: combining multiple-domains took 0.287688 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26878 sec) DOMAIN: domain decomposition done. (took in total 4.74115 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25935 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.43 sec =984074 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995256 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.034 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1728, Time: 0.73368, Redshift: 0.362992, Systemstep: 0.000620524, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1728). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78075 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09177|1.01418 DOMAIN: combining multiple-domains took 0.288607 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.336 sec) DOMAIN: domain decomposition done. (took in total 4.79763 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24211 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.4065 sec =984129 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995257 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.23 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 265.877 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1729, Time: 0.734301, Redshift: 0.361839, Systemstep: 0.000621049, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1729). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7893 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09174|1.01418 DOMAIN: combining multiple-domains took 0.287331 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.74814 sec) DOMAIN: domain decomposition done. (took in total 5.2194 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26082 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.5218 sec =984169 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995257 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.23 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.501 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1730, Time: 0.734923, Redshift: 0.360688, Systemstep: 0.000621575, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1730). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78735 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09172|1.01418 DOMAIN: combining multiple-domains took 0.287337 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37763 sec) DOMAIN: domain decomposition done. (took in total 4.84365 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28576 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.4139 sec =984201 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995257 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.064 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32397 sec PM-PERIODIC: done. (took 13.8791 seconds) TIMESTEPS: displacement time constraint: 0.00638223 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29201 sec PM-PERIODIC: done. (took 13.5065 seconds) TIMESTEPS: displacement time constraint: 0.00638223 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1731, Time: 0.735545, Redshift: 0.359537, Systemstep: 0.000622101, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1731). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.05464 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09168|1.01418 DOMAIN: combining multiple-domains took 0.286835 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90833 sec) DOMAIN: domain decomposition done. (took in total 5.64237 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27551 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.4125 sec =984251 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995257 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.241 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1732, Time: 0.736167, Redshift: 0.358387, Systemstep: 0.000622627, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1732). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88342 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09167|1.01418 DOMAIN: combining multiple-domains took 0.366329 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.75835 sec) DOMAIN: domain decomposition done. (took in total 5.40096 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2174 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.4229 sec =984278 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995257 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.335 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1733, Time: 0.73679, Redshift: 0.357238, Systemstep: 0.000623155, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1733). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82967 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09162|1.01418 DOMAIN: combining multiple-domains took 0.29201 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.71435 sec) DOMAIN: domain decomposition done. (took in total 5.22732 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26227 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 17.4106 sec =984297 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995258 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.21 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.096 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1734, Time: 0.737414, Redshift: 0.35609, Systemstep: 0.000623682, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1734). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78536 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09158|1.01418 DOMAIN: combining multiple-domains took 0.286231 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2225 sec) DOMAIN: domain decomposition done. (took in total 5.68631 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26474 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 17.4067 sec =984331 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995258 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.2 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.865 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30368 sec PM-PERIODIC: done. (took 13.9692 seconds) TIMESTEPS: displacement time constraint: 0.00639709 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25083 sec PM-PERIODIC: done. (took 13.8517 seconds) TIMESTEPS: displacement time constraint: 0.00639708 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1735, Time: 0.738038, Redshift: 0.354943, Systemstep: 0.00062421, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1735). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78694 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09155|1.01418 DOMAIN: combining multiple-domains took 0.286232 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17632 sec) DOMAIN: domain decomposition done. (took in total 5.64144 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22934 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.4056 sec =984379 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995258 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.2 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.483 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1736, Time: 0.738663, Redshift: 0.353797, Systemstep: 0.000624738, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1736). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78682 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0915|1.01418 DOMAIN: combining multiple-domains took 0.287597 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.87886 sec) DOMAIN: domain decomposition done. (took in total 6.34563 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26201 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.4293 sec =984414 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995258 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.19 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.436 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1737, Time: 0.739288, Redshift: 0.352652, Systemstep: 0.000625267, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1737). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78368 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09148|1.01418 DOMAIN: combining multiple-domains took 0.294874 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.96133 sec) DOMAIN: domain decomposition done. (took in total 5.43172 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26358 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.49 MB) GRAVTREE: Tree construction done. took 17.4295 sec =984456 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995258 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.18 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.892 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 205.31 sec, total size 352287 MB, corresponds to effective I/O rate of 1715.88 MB/sec Sync-Point 1738, Time: 0.739914, Redshift: 0.351508, Systemstep: 0.000625796, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1738). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78215 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09182|1.01418 DOMAIN: combining multiple-domains took 0.286363 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.32489 sec) DOMAIN: domain decomposition done. (took in total 5.78707 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.47243 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.4632 sec =984509 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.126 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25875 sec PM-PERIODIC: done. (took 13.7142 seconds) TIMESTEPS: displacement time constraint: 0.00640807 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32062 sec PM-PERIODIC: done. (took 13.5236 seconds) TIMESTEPS: displacement time constraint: 0.00640807 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1739, Time: 0.74054, Redshift: 0.350365, Systemstep: 0.000626326, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1739). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79317 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09183|1.01418 DOMAIN: combining multiple-domains took 0.287604 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.63332 sec) DOMAIN: domain decomposition done. (took in total 6.10768 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21468 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.4541 sec =984551 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 266.684 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1740, Time: 0.741167, Redshift: 0.349223, Systemstep: 0.000626856, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1740). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78952 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09183|1.01418 DOMAIN: combining multiple-domains took 0.286423 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11936 sec) DOMAIN: domain decomposition done. (took in total 5.58821 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2363 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.5394 sec =984553 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.258 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1741, Time: 0.741795, Redshift: 0.348082, Systemstep: 0.000627387, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1741). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.91498 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09185|1.01418 DOMAIN: combining multiple-domains took 0.540167 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60315 sec) DOMAIN: domain decomposition done. (took in total 6.68169 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22193 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.4434 sec =984589 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.355 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1742, Time: 0.742423, Redshift: 0.346942, Systemstep: 0.000627918, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1742). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78552 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09187|1.01418 DOMAIN: combining multiple-domains took 0.288818 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07463 sec) DOMAIN: domain decomposition done. (took in total 4.54186 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26521 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.5285 sec =984630 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.44 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24744 sec PM-PERIODIC: done. (took 13.5221 seconds) TIMESTEPS: displacement time constraint: 0.00641591 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23244 sec PM-PERIODIC: done. (took 13.1143 seconds) TIMESTEPS: displacement time constraint: 0.00641591 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1743, Time: 0.743051, Redshift: 0.345803, Systemstep: 0.00062845, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1743). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78009 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09188|1.01418 DOMAIN: combining multiple-domains took 0.28875 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30669 sec) DOMAIN: domain decomposition done. (took in total 5.76755 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24276 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.5487 sec =984658 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.254 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1744, Time: 0.74368, Redshift: 0.344664, Systemstep: 0.000628982, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1744). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79288 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09124|1.01418 DOMAIN: combining multiple-domains took 0.287521 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49367 sec) DOMAIN: domain decomposition done. (took in total 5.96653 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24021 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.47 MB) GRAVTREE: Tree construction done. took 17.5081 sec =984702 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995259 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.14 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.602 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1745, Time: 0.74431, Redshift: 0.343527, Systemstep: 0.000629514, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1745). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78054 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0912|1.01418 DOMAIN: combining multiple-domains took 0.287216 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.59253 sec) DOMAIN: domain decomposition done. (took in total 6.05182 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2424 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.46 MB) GRAVTREE: Tree construction done. took 17.4089 sec =984760 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99526 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.14 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.714 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1746, Time: 0.74494, Redshift: 0.342391, Systemstep: 0.000630047, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1746). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78371 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09862|1.01699 DOMAIN: combining multiple-domains took 0.287864 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.9631 sec) DOMAIN: domain decomposition done. (took in total 15.4255 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.13079 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.33 MB) GRAVTREE: Tree construction done. took 17.4245 sec =984786 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99526 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.432 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27767 sec PM-PERIODIC: done. (took 13.3164 seconds) TIMESTEPS: displacement time constraint: 0.00642746 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18633 sec PM-PERIODIC: done. (took 12.9822 seconds) TIMESTEPS: displacement time constraint: 0.00642745 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1747, Time: 0.74557, Redshift: 0.341255, Systemstep: 0.00063058, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1747). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.95571 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09866|1.01699 DOMAIN: combining multiple-domains took 0.288975 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.6637 sec) DOMAIN: domain decomposition done. (took in total 6.30235 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31635 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.34 MB) GRAVTREE: Tree construction done. took 17.4161 sec =984820 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99526 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.36 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.008 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1748, Time: 0.746201, Redshift: 0.340121, Systemstep: 0.000631114, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1748). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.92612 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09871|1.01699 DOMAIN: combining multiple-domains took 0.350794 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43131 sec) DOMAIN: domain decomposition done. (took in total 6.10192 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.34252 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.35 MB) GRAVTREE: Tree construction done. took 17.4143 sec =984845 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99526 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.36 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.857 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1749, Time: 0.746833, Redshift: 0.338988, Systemstep: 0.000631648, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1749). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88151 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09875|1.01699 DOMAIN: combining multiple-domains took 0.390172 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.03714 sec) DOMAIN: domain decomposition done. (took in total 6.70227 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30177 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.35 MB) GRAVTREE: Tree construction done. took 17.4717 sec =984877 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99526 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.37 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.68 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1750, Time: 0.747465, Redshift: 0.337855, Systemstep: 0.000632183, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1750). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7907 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09879|1.01699 DOMAIN: combining multiple-domains took 0.287346 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39567 sec) DOMAIN: domain decomposition done. (took in total 6.15688 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30957 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.35 MB) GRAVTREE: Tree construction done. took 17.466 sec =984918 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995261 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.807 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24513 sec PM-PERIODIC: done. (took 13.0854 seconds) TIMESTEPS: displacement time constraint: 0.00644908 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21532 sec PM-PERIODIC: done. (took 13.3202 seconds) TIMESTEPS: displacement time constraint: 0.00644907 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1751, Time: 0.748098, Redshift: 0.336724, Systemstep: 0.000632718, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1751). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79657 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09883|1.01699 DOMAIN: combining multiple-domains took 0.289884 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.55544 sec) DOMAIN: domain decomposition done. (took in total 5.0358 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32637 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.36 MB) GRAVTREE: Tree construction done. took 17.4628 sec =984948 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995261 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.673 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1752, Time: 0.748731, Redshift: 0.335593, Systemstep: 0.000633254, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1752). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79637 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09888|1.01699 DOMAIN: combining multiple-domains took 0.289245 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.37837 sec) DOMAIN: domain decomposition done. (took in total 5.85726 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32504 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.37 MB) GRAVTREE: Tree construction done. took 17.5008 sec =984992 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995261 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.39 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.81 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1753, Time: 0.749365, Redshift: 0.334463, Systemstep: 0.00063379, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1753). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79841 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09891|1.01699 DOMAIN: combining multiple-domains took 0.288516 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.68885 sec) DOMAIN: domain decomposition done. (took in total 6.16978 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33906 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.37 MB) GRAVTREE: Tree construction done. took 17.5047 sec =985024 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995261 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.4 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.829 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1754, Time: 0.749999, Redshift: 0.333335, Systemstep: 0.000634326, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1754). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8028 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.10203|1.04768 DOMAIN: combining multiple-domains took 0.287186 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.7959 sec) DOMAIN: domain decomposition done. (took in total 14.2816 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.09958 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.74 MB) GRAVTREE: Tree construction done. took 17.5532 sec =985056 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995261 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.91 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.723 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17024 sec PM-PERIODIC: done. (took 13.167 seconds) TIMESTEPS: displacement time constraint: 0.00644539 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18583 sec PM-PERIODIC: done. (took 13.016 seconds) TIMESTEPS: displacement time constraint: 0.00644539 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1755, Time: 0.750634, Redshift: 0.332207, Systemstep: 0.000634863, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1755). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79524 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09388|1.04768 DOMAIN: combining multiple-domains took 0.288864 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.11755 sec) DOMAIN: domain decomposition done. (took in total 5.59455 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29406 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.78 MB) GRAVTREE: Tree construction done. took 17.3767 sec =985102 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995261 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.58 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.919 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1756, Time: 0.751269, Redshift: 0.33108, Systemstep: 0.0006354, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1756). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78941 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09082|1.01418 DOMAIN: combining multiple-domains took 0.286976 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.9541 sec) DOMAIN: domain decomposition done. (took in total 14.4227 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29075 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.42 MB) GRAVTREE: Tree construction done. took 17.4306 sec =985123 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995262 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.08 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.959 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1757, Time: 0.751905, Redshift: 0.329955, Systemstep: 0.000635938, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1757). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78891 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0908|1.01418 DOMAIN: combining multiple-domains took 0.287232 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41182 sec) DOMAIN: domain decomposition done. (took in total 5.88023 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27922 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.41 MB) GRAVTREE: Tree construction done. took 17.4401 sec =985177 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995262 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.07 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.007 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1758, Time: 0.752542, Redshift: 0.32883, Systemstep: 0.000636477, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1758). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78909 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09079|1.01418 DOMAIN: combining multiple-domains took 0.287534 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11664 sec) DOMAIN: domain decomposition done. (took in total 4.58518 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28983 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.41 MB) GRAVTREE: Tree construction done. took 17.4389 sec =985204 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995262 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.07 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.156 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28332 sec PM-PERIODIC: done. (took 13.1807 seconds) TIMESTEPS: displacement time constraint: 0.0064453 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.52244 sec PM-PERIODIC: done. (took 13.402 seconds) TIMESTEPS: displacement time constraint: 0.0064453 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1759, Time: 0.753179, Redshift: 0.327706, Systemstep: 0.000637015, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1759). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78883 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09075|1.01418 DOMAIN: combining multiple-domains took 0.289046 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12082 sec) DOMAIN: domain decomposition done. (took in total 5.59171 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26895 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.41 MB) GRAVTREE: Tree construction done. took 17.4391 sec =985229 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995262 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.07 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.541 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1760, Time: 0.753816, Redshift: 0.326583, Systemstep: 0.000637555, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1760). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79066 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09072|1.01418 DOMAIN: combining multiple-domains took 0.287954 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.60713 sec) DOMAIN: domain decomposition done. (took in total 5.07836 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29159 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 17.4591 sec =985268 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995262 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.06 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.07 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 200.88 sec, total size 352287 MB, corresponds to effective I/O rate of 1753.72 MB/sec Sync-Point 1761, Time: 0.754455, Redshift: 0.325461, Systemstep: 0.000638094, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1761). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78386 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09068|1.01418 DOMAIN: combining multiple-domains took 0.288069 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.08612 sec) DOMAIN: domain decomposition done. (took in total 5.55038 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2775 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 17.4461 sec =985316 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995262 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.152 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1762, Time: 0.755093, Redshift: 0.32434, Systemstep: 0.000638634, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1762). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78286 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09065|1.01418 DOMAIN: combining multiple-domains took 0.286094 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.69995 sec) DOMAIN: domain decomposition done. (took in total 5.16141 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26785 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 17.4531 sec =985354 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995263 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.217 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28581 sec PM-PERIODIC: done. (took 13.1775 seconds) TIMESTEPS: displacement time constraint: 0.00643103 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28186 sec PM-PERIODIC: done. (took 13.343 seconds) TIMESTEPS: displacement time constraint: 0.00643103 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1763, Time: 0.755732, Redshift: 0.32322, Systemstep: 0.000639175, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1763). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79818 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09063|1.01418 DOMAIN: combining multiple-domains took 0.287741 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.4985 sec) DOMAIN: domain decomposition done. (took in total 5.97703 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28197 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 17.4429 sec =985370 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995263 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.511 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1764, Time: 0.756372, Redshift: 0.322101, Systemstep: 0.000639716, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1764). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78528 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0906|1.01418 DOMAIN: combining multiple-domains took 0.287199 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.58158 sec) DOMAIN: domain decomposition done. (took in total 5.04562 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29228 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 17.4564 sec =985428 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995263 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.04 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.894 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1765, Time: 0.757012, Redshift: 0.320982, Systemstep: 0.000640258, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1765). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78493 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09056|1.01418 DOMAIN: combining multiple-domains took 0.286955 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.17441 sec) DOMAIN: domain decomposition done. (took in total 6.63921 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2161 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 17.5381 sec =985479 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995263 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.683 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1766, Time: 0.757653, Redshift: 0.319865, Systemstep: 0.0006408, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1766). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78582 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09053|1.01418 DOMAIN: combining multiple-domains took 0.286675 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37087 sec) DOMAIN: domain decomposition done. (took in total 4.83555 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26286 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 17.4578 sec =985509 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995263 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.522 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24499 sec PM-PERIODIC: done. (took 13.105 seconds) TIMESTEPS: displacement time constraint: 0.0064014 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23916 sec PM-PERIODIC: done. (took 13.1313 seconds) TIMESTEPS: displacement time constraint: 0.0064014 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1767, Time: 0.758294, Redshift: 0.318749, Systemstep: 0.000641342, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1767). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78493 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09052|1.01418 DOMAIN: combining multiple-domains took 0.288549 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36717 sec) DOMAIN: domain decomposition done. (took in total 5.83234 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25546 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 17.4197 sec =985536 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995263 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.363 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1768, Time: 0.758936, Redshift: 0.317634, Systemstep: 0.000641885, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1768). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78525 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09049|1.01418 DOMAIN: combining multiple-domains took 0.288353 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95186 sec) DOMAIN: domain decomposition done. (took in total 5.41836 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21937 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 17.424 sec =985585 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995264 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.406 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1769, Time: 0.759579, Redshift: 0.316519, Systemstep: 0.000642428, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1769). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79134 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09045|1.01418 DOMAIN: combining multiple-domains took 0.287229 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14487 sec) DOMAIN: domain decomposition done. (took in total 4.6151 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23427 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 17.425 sec =985609 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995264 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.706 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1770, Time: 0.760222, Redshift: 0.315406, Systemstep: 0.000642972, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1770). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.788 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09043|1.01418 DOMAIN: combining multiple-domains took 0.286583 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44306 sec) DOMAIN: domain decomposition done. (took in total 5.91056 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25565 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 17.4266 sec =985644 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995264 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.073 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25018 sec PM-PERIODIC: done. (took 13.0628 seconds) TIMESTEPS: displacement time constraint: 0.00640226 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22743 sec PM-PERIODIC: done. (took 13.3594 seconds) TIMESTEPS: displacement time constraint: 0.00640226 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1771, Time: 0.760865, Redshift: 0.314293, Systemstep: 0.000643516, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1771). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78628 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09041|1.01418 DOMAIN: combining multiple-domains took 0.287585 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.58013 sec) DOMAIN: domain decomposition done. (took in total 6.0465 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22668 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 17.4318 sec =985704 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995264 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.106 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1772, Time: 0.761509, Redshift: 0.313182, Systemstep: 0.000644061, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1772). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79232 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09038|1.01418 DOMAIN: combining multiple-domains took 0.286491 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8579 sec) DOMAIN: domain decomposition done. (took in total 5.32909 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24105 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.4317 sec =985752 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.203 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1773, Time: 0.762154, Redshift: 0.312071, Systemstep: 0.000644606, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1773). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79368 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09473|1.04768 DOMAIN: combining multiple-domains took 0.287744 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.4374 sec) DOMAIN: domain decomposition done. (took in total 13.911 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40063 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.88 MB) GRAVTREE: Tree construction done. took 17.5371 sec =985783 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.72 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.839 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1774, Time: 0.762799, Redshift: 0.310961, Systemstep: 0.000645152, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1774). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78812 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09488|1.04768 DOMAIN: combining multiple-domains took 0.289742 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.33856 sec) DOMAIN: domain decomposition done. (took in total 4.80929 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30885 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.89 MB) GRAVTREE: Tree construction done. took 17.538 sec =985826 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.74 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.014 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21142 sec PM-PERIODIC: done. (took 13.0551 seconds) TIMESTEPS: displacement time constraint: 0.00639122 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17177 sec PM-PERIODIC: done. (took 12.8942 seconds) TIMESTEPS: displacement time constraint: 0.00639122 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1775, Time: 0.763445, Redshift: 0.309852, Systemstep: 0.000645698, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1775). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78912 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09502|1.04768 DOMAIN: combining multiple-domains took 0.289165 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.84849 sec) DOMAIN: domain decomposition done. (took in total 5.3185 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32051 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.91 MB) GRAVTREE: Tree construction done. took 17.6416 sec =985827 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.76 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.991 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1776, Time: 0.764091, Redshift: 0.308745, Systemstep: 0.000646245, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1776). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78703 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09517|1.04768 DOMAIN: combining multiple-domains took 0.288848 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 5.45842 sec) DOMAIN: domain decomposition done. (took in total 7.92701 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3108 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.93 MB) GRAVTREE: Tree construction done. took 17.4929 sec =985873 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.79 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.257 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1777, Time: 0.764738, Redshift: 0.307638, Systemstep: 0.000646792, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1777). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78742 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09533|1.04768 DOMAIN: combining multiple-domains took 0.287413 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.9046 sec) DOMAIN: domain decomposition done. (took in total 6.37127 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31948 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.95 MB) GRAVTREE: Tree construction done. took 17.5145 sec =985897 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.81 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.333 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1778, Time: 0.765385, Redshift: 0.306532, Systemstep: 0.000647339, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1778). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.9134 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09549|1.04768 DOMAIN: combining multiple-domains took 0.286548 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49536 sec) DOMAIN: domain decomposition done. (took in total 6.10554 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30745 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.97 MB) GRAVTREE: Tree construction done. took 17.5704 sec =985932 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995265 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.84 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.322 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28122 sec PM-PERIODIC: done. (took 13.1536 seconds) TIMESTEPS: displacement time constraint: 0.00638172 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29089 sec PM-PERIODIC: done. (took 13.515 seconds) TIMESTEPS: displacement time constraint: 0.00638172 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1779, Time: 0.766033, Redshift: 0.305427, Systemstep: 0.000647887, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1779). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80085 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09565|1.04768 DOMAIN: combining multiple-domains took 0.28783 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.42775 sec) DOMAIN: domain decomposition done. (took in total 4.91744 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29414 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.5068 sec =985967 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995266 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.87 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.459 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1780, Time: 0.766681, Redshift: 0.304323, Systemstep: 0.000648435, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1780). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79647 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09346|1.01982 DOMAIN: combining multiple-domains took 0.288984 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.8414 sec) DOMAIN: domain decomposition done. (took in total 15.3186 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38125 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.429 sec =986012 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995266 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.51 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 270.224 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1781, Time: 0.76733, Redshift: 0.303219, Systemstep: 0.000648984, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1781). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.03089 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09352|1.01982 DOMAIN: combining multiple-domains took 0.288674 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22853 sec) DOMAIN: domain decomposition done. (took in total 6.00898 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24958 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.4372 sec =986040 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995266 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.52 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 270.244 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1782, Time: 0.76798, Redshift: 0.302117, Systemstep: 0.000649534, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1782). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79576 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09359|1.01982 DOMAIN: combining multiple-domains took 0.288357 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12248 sec) DOMAIN: domain decomposition done. (took in total 5.59806 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32597 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.5639 sec =986076 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995266 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 272.038 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27763 sec PM-PERIODIC: done. (took 13.0081 seconds) TIMESTEPS: displacement time constraint: 0.00635173 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30982 sec PM-PERIODIC: done. (took 13.5865 seconds) TIMESTEPS: displacement time constraint: 0.00635173 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1783, Time: 0.76863, Redshift: 0.301016, Systemstep: 0.000650084, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1783). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79337 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09366|1.01982 DOMAIN: combining multiple-domains took 0.288607 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.26709 sec) DOMAIN: domain decomposition done. (took in total 4.74137 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30535 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.4521 sec =986097 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995266 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.54 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.17 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 230.315 sec, total size 352287 MB, corresponds to effective I/O rate of 1529.59 MB/sec Sync-Point 1784, Time: 0.769281, Redshift: 0.299916, Systemstep: 0.000650634, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1784). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.90994 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09557|1.01699 DOMAIN: combining multiple-domains took 0.288426 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1321 sec) DOMAIN: domain decomposition done. (took in total 14.7579 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.48356 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.4551 sec =986150 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995266 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.85 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.049 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1785, Time: 0.769932, Redshift: 0.298816, Systemstep: 0.000651185, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1785). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79818 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09565|1.01699 DOMAIN: combining multiple-domains took 0.288569 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.57731 sec) DOMAIN: domain decomposition done. (took in total 5.05691 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2993 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.4563 sec =986169 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995267 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.87 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 268.751 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1786, Time: 0.770584, Redshift: 0.297718, Systemstep: 0.000651736, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1786). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79569 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09414|1.04768 DOMAIN: combining multiple-domains took 0.288419 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.6028 sec) DOMAIN: domain decomposition done. (took in total 14.08 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.96681 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.81 MB) GRAVTREE: Tree construction done. took 17.6384 sec =986219 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995267 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.62 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.758 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17439 sec PM-PERIODIC: done. (took 12.8733 seconds) TIMESTEPS: displacement time constraint: 0.00634856 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30405 sec PM-PERIODIC: done. (took 13.1546 seconds) TIMESTEPS: displacement time constraint: 0.00634856 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1787, Time: 0.771236, Redshift: 0.29662, Systemstep: 0.000652287, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1787). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79512 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09413|1.04768 DOMAIN: combining multiple-domains took 0.289098 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.793 sec) DOMAIN: domain decomposition done. (took in total 5.26946 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27769 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.81 MB) GRAVTREE: Tree construction done. took 17.4838 sec =986231 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995267 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.62 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.982 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1788, Time: 0.771889, Redshift: 0.295523, Systemstep: 0.00065284, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1788). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79102 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09002|1.04768 DOMAIN: combining multiple-domains took 0.288658 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.06209 sec) DOMAIN: domain decomposition done. (took in total 6.53391 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29748 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 17.447 sec =986265 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995267 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.95 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.936 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1789, Time: 0.772542, Redshift: 0.294428, Systemstep: 0.000653392, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1789). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78741 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08999|1.04768 DOMAIN: combining multiple-domains took 0.288415 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.00253 sec) DOMAIN: domain decomposition done. (took in total 5.46957 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26834 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 17.4525 sec =986300 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995267 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.94 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.089 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1790, Time: 0.773196, Redshift: 0.293333, Systemstep: 0.000653945, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1790). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79531 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08994|1.04768 DOMAIN: combining multiple-domains took 0.286142 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.79473 sec) DOMAIN: domain decomposition done. (took in total 6.26894 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17743 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.31 MB) GRAVTREE: Tree construction done. took 17.4335 sec =986351 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995267 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.93 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.691 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17604 sec PM-PERIODIC: done. (took 12.9833 seconds) TIMESTEPS: displacement time constraint: 0.00632264 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19126 sec PM-PERIODIC: done. (took 13.2314 seconds) TIMESTEPS: displacement time constraint: 0.00632264 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1791, Time: 0.773851, Redshift: 0.292239, Systemstep: 0.000654499, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1791). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79167 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08991|1.04768 DOMAIN: combining multiple-domains took 0.287194 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.31156 sec) DOMAIN: domain decomposition done. (took in total 5.7817 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27672 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.31 MB) GRAVTREE: Tree construction done. took 17.4227 sec =986374 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.93 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 264.473 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1792, Time: 0.774506, Redshift: 0.291146, Systemstep: 0.000655053, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1792). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79521 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08989|1.04768 DOMAIN: combining multiple-domains took 0.28587 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17289 sec) DOMAIN: domain decomposition done. (took in total 5.64641 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21684 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.31 MB) GRAVTREE: Tree construction done. took 17.5148 sec =986418 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.92 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 264.567 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1793, Time: 0.775161, Redshift: 0.290054, Systemstep: 0.000655607, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1793). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.05545 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08985|1.04768 DOMAIN: combining multiple-domains took 0.327658 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.88141 sec) DOMAIN: domain decomposition done. (took in total 5.65592 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20544 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 17.3966 sec =986451 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.92 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.597 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1794, Time: 0.775817, Redshift: 0.288963, Systemstep: 0.000656162, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1794). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78203 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08982|1.04768 DOMAIN: combining multiple-domains took 0.288214 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1257 sec) DOMAIN: domain decomposition done. (took in total 5.58735 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19321 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.3 MB) GRAVTREE: Tree construction done. took 17.4008 sec =986478 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.219 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22668 sec PM-PERIODIC: done. (took 13.352 seconds) TIMESTEPS: displacement time constraint: 0.00630573 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20932 sec PM-PERIODIC: done. (took 13.0822 seconds) TIMESTEPS: displacement time constraint: 0.00630573 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1795, Time: 0.776474, Redshift: 0.287873, Systemstep: 0.000656718, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1795). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78826 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08977|1.04768 DOMAIN: combining multiple-domains took 0.287216 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.27991 sec) DOMAIN: domain decomposition done. (took in total 5.74661 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25902 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 17.4022 sec =986511 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.91 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 265.602 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1796, Time: 0.777131, Redshift: 0.286784, Systemstep: 0.000657274, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1796). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79738 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08974|1.04768 DOMAIN: combining multiple-domains took 0.289104 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47797 sec) DOMAIN: domain decomposition done. (took in total 5.95606 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27966 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.29 MB) GRAVTREE: Tree construction done. took 17.397 sec =986518 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.9 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.984 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1797, Time: 0.777789, Redshift: 0.285695, Systemstep: 0.00065783, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1797). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86252 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08898|1.01418 DOMAIN: combining multiple-domains took 0.288517 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.0327 sec) DOMAIN: domain decomposition done. (took in total 14.5749 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.96301 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.5176 sec =986553 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995268 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.6 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1798, Time: 0.778448, Redshift: 0.284608, Systemstep: 0.000658387, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1798). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78089 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08893|1.01418 DOMAIN: combining multiple-domains took 0.286059 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.16998 sec) DOMAIN: domain decomposition done. (took in total 4.62875 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23747 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.19 MB) GRAVTREE: Tree construction done. took 17.433 sec =986584 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995269 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.77 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.689 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21417 sec PM-PERIODIC: done. (took 13.129 seconds) TIMESTEPS: displacement time constraint: 0.00629985 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24285 sec PM-PERIODIC: done. (took 13.1232 seconds) TIMESTEPS: displacement time constraint: 0.00629985 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1799, Time: 0.779107, Redshift: 0.283521, Systemstep: 0.000658944, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1799). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78591 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0889|1.01418 DOMAIN: combining multiple-domains took 0.287251 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.96712 sec) DOMAIN: domain decomposition done. (took in total 5.43232 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22547 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.19 MB) GRAVTREE: Tree construction done. took 17.4929 sec =986635 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995269 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.76 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.668 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1800, Time: 0.779766, Redshift: 0.282436, Systemstep: 0.000659502, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1800). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78828 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08885|1.01418 DOMAIN: combining multiple-domains took 0.28731 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17623 sec) DOMAIN: domain decomposition done. (took in total 5.64338 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18036 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.18 MB) GRAVTREE: Tree construction done. took 17.5295 sec =986662 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995269 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.75 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.711 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1801, Time: 0.780426, Redshift: 0.281351, Systemstep: 0.00066006, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1801). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78471 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08268|1.04768 DOMAIN: combining multiple-domains took 0.28681 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4947 sec) DOMAIN: domain decomposition done. (took in total 14.9574 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.89024 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.46 MB) GRAVTREE: Tree construction done. took 17.3204 sec =986732 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995269 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.75 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.543 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1802, Time: 0.781087, Redshift: 0.280268, Systemstep: 0.000660619, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1802). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.76947 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08265|1.04768 DOMAIN: combining multiple-domains took 0.28595 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.87065 sec) DOMAIN: domain decomposition done. (took in total 6.3157 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.14222 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.46 MB) GRAVTREE: Tree construction done. took 17.3318 sec =986754 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995269 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.74 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.415 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20108 sec PM-PERIODIC: done. (took 13.0974 seconds) TIMESTEPS: displacement time constraint: 0.00629169 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21528 sec PM-PERIODIC: done. (took 13.4004 seconds) TIMESTEPS: displacement time constraint: 0.00629168 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1803, Time: 0.781748, Redshift: 0.279185, Systemstep: 0.000661178, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1803). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78661 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08259|1.04768 DOMAIN: combining multiple-domains took 0.28578 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.25174 sec) DOMAIN: domain decomposition done. (took in total 5.73011 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22587 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.45 MB) GRAVTREE: Tree construction done. took 17.3526 sec =986801 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.73 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 265.756 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1804, Time: 0.78241, Redshift: 0.278103, Systemstep: 0.000661738, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1804). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77845 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08254|1.04768 DOMAIN: combining multiple-domains took 0.286011 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38018 sec) DOMAIN: domain decomposition done. (took in total 5.83475 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.1674 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.44 MB) GRAVTREE: Tree construction done. took 17.3534 sec =986850 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.73 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 266.911 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1805, Time: 0.783072, Redshift: 0.277022, Systemstep: 0.000662298, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1805). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78223 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08249|1.04768 DOMAIN: combining multiple-domains took 0.286751 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.3023 sec) DOMAIN: domain decomposition done. (took in total 4.76078 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23372 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.44 MB) GRAVTREE: Tree construction done. took 17.3499 sec =986876 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.72 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.016 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1806, Time: 0.783735, Redshift: 0.275942, Systemstep: 0.000662859, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1806). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7883 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08791|1.01559 DOMAIN: combining multiple-domains took 0.285485 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1369 sec) DOMAIN: domain decomposition done. (took in total 14.5998 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.12837 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.4278 sec =986902 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.647 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28454 sec PM-PERIODIC: done. (took 13.0607 seconds) TIMESTEPS: displacement time constraint: 0.00627633 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28254 sec PM-PERIODIC: done. (took 13.2036 seconds) TIMESTEPS: displacement time constraint: 0.00627633 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 190.448 sec, total size 352287 MB, corresponds to effective I/O rate of 1849.78 MB/sec Sync-Point 1807, Time: 0.784398, Redshift: 0.274863, Systemstep: 0.00066342, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1807). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78655 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08791|1.01559 DOMAIN: combining multiple-domains took 0.285783 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.90409 sec) DOMAIN: domain decomposition done. (took in total 4.36794 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29494 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.07 MB) GRAVTREE: Tree construction done. took 17.4459 sec =986912 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.569 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1808, Time: 0.785062, Redshift: 0.273784, Systemstep: 0.000663981, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1808). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78012 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08792|1.01559 DOMAIN: combining multiple-domains took 0.286467 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.24764 sec) DOMAIN: domain decomposition done. (took in total 5.7053 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24053 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.08 MB) GRAVTREE: Tree construction done. took 17.4201 sec =986945 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.6 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.78 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1809, Time: 0.785727, Redshift: 0.272707, Systemstep: 0.000664543, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1809). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78241 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08843|1.01418 DOMAIN: combining multiple-domains took 0.285369 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.6047 sec) DOMAIN: domain decomposition done. (took in total 14.0643 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.42139 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.4378 sec =986981 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99527 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.416 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1810, Time: 0.786392, Redshift: 0.271631, Systemstep: 0.000665106, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1810). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88771 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0884|1.01418 DOMAIN: combining multiple-domains took 0.359028 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.37526 sec) DOMAIN: domain decomposition done. (took in total 5.01354 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21871 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.4401 sec =987006 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995271 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 266.379 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20855 sec PM-PERIODIC: done. (took 13.3332 seconds) TIMESTEPS: displacement time constraint: 0.00626728 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22866 sec PM-PERIODIC: done. (took 13.0285 seconds) TIMESTEPS: displacement time constraint: 0.00626728 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1811, Time: 0.787058, Redshift: 0.270555, Systemstep: 0.000665669, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1811). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78261 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08837|1.01418 DOMAIN: combining multiple-domains took 0.290503 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.50655 sec) DOMAIN: domain decomposition done. (took in total 4.97064 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24243 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.4385 sec =987051 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995271 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.358 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1812, Time: 0.787724, Redshift: 0.269481, Systemstep: 0.000666232, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1812). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78305 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09187|1.01982 DOMAIN: combining multiple-domains took 0.289862 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5647 sec) DOMAIN: domain decomposition done. (took in total 15.0289 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.36198 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.5554 sec =987105 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995271 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 270.982 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1813, Time: 0.788391, Redshift: 0.268407, Systemstep: 0.000666796, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1813). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78925 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.0919|1.01982 DOMAIN: combining multiple-domains took 0.288468 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42397 sec) DOMAIN: domain decomposition done. (took in total 5.89499 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2948 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.4631 sec =987148 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995271 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 270.556 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1814, Time: 0.789058, Redshift: 0.267334, Systemstep: 0.000667361, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1814). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78605 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09715|1.04768 DOMAIN: combining multiple-domains took 0.28754 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.2138 sec) DOMAIN: domain decomposition done. (took in total 14.6796 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.98764 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.16 MB) GRAVTREE: Tree construction done. took 17.4791 sec =987175 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995271 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.11 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.97 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18152 sec PM-PERIODIC: done. (took 12.9873 seconds) TIMESTEPS: displacement time constraint: 0.00624116 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17908 sec PM-PERIODIC: done. (took 12.9942 seconds) TIMESTEPS: displacement time constraint: 0.00624116 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1815, Time: 0.789726, Redshift: 0.266262, Systemstep: 0.000667926, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1815). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7956 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09711|1.04768 DOMAIN: combining multiple-domains took 0.287426 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.14833 sec) DOMAIN: domain decomposition done. (took in total 5.62405 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26787 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.16 MB) GRAVTREE: Tree construction done. took 17.6106 sec =987210 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995272 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.1 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.011 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1816, Time: 0.790394, Redshift: 0.265191, Systemstep: 0.000668491, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1816). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79216 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08813|1.01418 DOMAIN: combining multiple-domains took 0.289798 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.1516 sec) DOMAIN: domain decomposition done. (took in total 13.6264 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.90089 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.4173 sec =987270 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995272 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.64 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1817, Time: 0.791063, Redshift: 0.264121, Systemstep: 0.000669057, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1817). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7823 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0881|1.01418 DOMAIN: combining multiple-domains took 0.286529 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1299 sec) DOMAIN: domain decomposition done. (took in total 5.5902 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21422 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.1 MB) GRAVTREE: Tree construction done. took 17.4361 sec =987304 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995272 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.63 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.631 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1818, Time: 0.791733, Redshift: 0.263052, Systemstep: 0.000669623, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1818). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78171 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09816|1.01699 DOMAIN: combining multiple-domains took 0.289333 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.9156 sec) DOMAIN: domain decomposition done. (took in total 16.3775 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.93935 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.28 MB) GRAVTREE: Tree construction done. took 17.5302 sec =987354 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995272 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.27 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.234 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22848 sec PM-PERIODIC: done. (took 13.1275 seconds) TIMESTEPS: displacement time constraint: 0.00625778 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20781 sec PM-PERIODIC: done. (took 13.3444 seconds) TIMESTEPS: displacement time constraint: 0.00625778 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1819, Time: 0.792403, Redshift: 0.261984, Systemstep: 0.00067019, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1819). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79342 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09824|1.01699 DOMAIN: combining multiple-domains took 0.290521 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.72831 sec) DOMAIN: domain decomposition done. (took in total 6.20613 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.34869 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.29 MB) GRAVTREE: Tree construction done. took 17.575 sec =987367 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995272 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.168 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1820, Time: 0.793074, Redshift: 0.260916, Systemstep: 0.000670757, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1820). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78991 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09832|1.01699 DOMAIN: combining multiple-domains took 0.288816 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14642 sec) DOMAIN: domain decomposition done. (took in total 4.61867 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32495 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.3 MB) GRAVTREE: Tree construction done. took 17.5594 sec =987408 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995272 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.514 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1821, Time: 0.793745, Redshift: 0.25985, Systemstep: 0.000671325, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1821). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78525 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09913|1.04768 DOMAIN: combining multiple-domains took 0.288374 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.489 sec) DOMAIN: domain decomposition done. (took in total 14.9548 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40595 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.39 MB) GRAVTREE: Tree construction done. took 17.5263 sec =987453 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995273 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.17 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1822, Time: 0.794417, Redshift: 0.258784, Systemstep: 0.000671893, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1822). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79068 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09922|1.04768 DOMAIN: combining multiple-domains took 0.288146 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.08965 sec) DOMAIN: domain decomposition done. (took in total 5.56066 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28727 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.4 MB) GRAVTREE: Tree construction done. took 17.4945 sec =987476 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995273 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.45 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 272.263 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.48513 sec PM-PERIODIC: done. (took 13.1878 seconds) TIMESTEPS: displacement time constraint: 0.00625998 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28307 sec PM-PERIODIC: done. (took 13.0737 seconds) TIMESTEPS: displacement time constraint: 0.00625998 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1823, Time: 0.79509, Redshift: 0.25772, Systemstep: 0.000672462, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1823). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.08364 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09933|1.04768 DOMAIN: combining multiple-domains took 0.288119 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.10349 sec) DOMAIN: domain decomposition done. (took in total 4.8931 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31176 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.42 MB) GRAVTREE: Tree construction done. took 17.4795 sec =987517 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995273 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.47 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.227 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1824, Time: 0.795763, Redshift: 0.256656, Systemstep: 0.000673031, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1824). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79065 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09941|1.04768 DOMAIN: combining multiple-domains took 0.288757 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.21745 sec) DOMAIN: domain decomposition done. (took in total 5.68961 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30134 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.43 MB) GRAVTREE: Tree construction done. took 17.5592 sec =987534 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995273 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.622 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1825, Time: 0.796436, Redshift: 0.255593, Systemstep: 0.000673601, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1825). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79454 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09952|1.04768 DOMAIN: combining multiple-domains took 0.287885 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.24866 sec) DOMAIN: domain decomposition done. (took in total 5.72379 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29967 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.44 MB) GRAVTREE: Tree construction done. took 17.4772 sec =987568 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995273 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.5 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 272.631 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1826, Time: 0.79711, Redshift: 0.254531, Systemstep: 0.000674171, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1826). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79773 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09963|1.04768 DOMAIN: combining multiple-domains took 0.288022 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.10487 sec) DOMAIN: domain decomposition done. (took in total 5.58312 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27965 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.45 MB) GRAVTREE: Tree construction done. took 17.4849 sec =987613 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995273 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 272.59 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29218 sec PM-PERIODIC: done. (took 13.2532 seconds) TIMESTEPS: displacement time constraint: 0.00625458 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19128 sec PM-PERIODIC: done. (took 13.3239 seconds) TIMESTEPS: displacement time constraint: 0.00625458 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1827, Time: 0.797785, Redshift: 0.25347, Systemstep: 0.000674742, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1827). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80283 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09932|1.01418 DOMAIN: combining multiple-domains took 0.288505 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1119 sec) DOMAIN: domain decomposition done. (took in total 14.6003 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18634 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.42 MB) GRAVTREE: Tree construction done. took 17.6481 sec =987648 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995274 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.46 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.303 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1828, Time: 0.798461, Redshift: 0.25241, Systemstep: 0.000675313, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1828). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79476 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09934|1.01418 DOMAIN: combining multiple-domains took 0.289561 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.50545 sec) DOMAIN: domain decomposition done. (took in total 5.98254 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26635 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.42 MB) GRAVTREE: Tree construction done. took 17.5428 sec =987699 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995274 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.47 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.911 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1829, Time: 0.799136, Redshift: 0.251351, Systemstep: 0.000675885, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1829). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.866 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09936|1.01418 DOMAIN: combining multiple-domains took 0.289165 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.83905 sec) DOMAIN: domain decomposition done. (took in total 6.38714 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26289 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.42 MB) GRAVTREE: Tree construction done. took 17.557 sec =987724 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995274 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.47 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 269.391 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 326.208 sec, total size 352287 MB, corresponds to effective I/O rate of 1079.95 MB/sec Sync-Point 1830, Time: 0.799813, Redshift: 0.250292, Systemstep: 0.000676457, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1830). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80008 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09669|1.04768 DOMAIN: combining multiple-domains took 0.288011 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.6459 sec) DOMAIN: domain decomposition done. (took in total 15.1279 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.92286 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.4 sec =987758 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995274 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.04 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 267.198 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22321 sec PM-PERIODIC: done. (took 13.4081 seconds) TIMESTEPS: displacement time constraint: 0.00624673 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24011 sec PM-PERIODIC: done. (took 13.3698 seconds) TIMESTEPS: displacement time constraint: 0.00624673 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1831, Time: 0.80049, Redshift: 0.249235, Systemstep: 0.00067703, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1831). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7899 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0927|1.01559 DOMAIN: combining multiple-domains took 0.288475 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.1234 sec) DOMAIN: domain decomposition done. (took in total 15.5941 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32392 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.64 MB) GRAVTREE: Tree construction done. took 17.4837 sec =987795 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995274 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.38 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 269.388 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1832, Time: 0.801167, Redshift: 0.248178, Systemstep: 0.000677603, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1832). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7857 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09273|1.01559 DOMAIN: combining multiple-domains took 0.287349 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15033 sec) DOMAIN: domain decomposition done. (took in total 5.615 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24456 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.64 MB) GRAVTREE: Tree construction done. took 17.4814 sec =987797 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995274 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.39 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.117 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1833, Time: 0.801846, Redshift: 0.247123, Systemstep: 0.000678176, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1833). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78563 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09274|1.01559 DOMAIN: combining multiple-domains took 0.286704 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.48776 sec) DOMAIN: domain decomposition done. (took in total 5.95268 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27535 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.64 MB) GRAVTREE: Tree construction done. took 17.4722 sec =987835 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.39 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 269.118 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1834, Time: 0.802524, Redshift: 0.246068, Systemstep: 0.00067875, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1834). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7842 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08908|1.01418 DOMAIN: combining multiple-domains took 0.286412 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.9678 sec) DOMAIN: domain decomposition done. (took in total 16.4305 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.00765 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.4335 sec =987886 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.601 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.53694 sec PM-PERIODIC: done. (took 13.3994 seconds) TIMESTEPS: displacement time constraint: 0.00625069 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34014 sec PM-PERIODIC: done. (took 13.2481 seconds) TIMESTEPS: displacement time constraint: 0.0062507 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1835, Time: 0.803204, Redshift: 0.245014, Systemstep: 0.000679325, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1835). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.07967 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08907|1.01418 DOMAIN: combining multiple-domains took 0.290758 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.96203 sec) DOMAIN: domain decomposition done. (took in total 5.72575 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25651 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.4375 sec =987935 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.118 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1836, Time: 0.803884, Redshift: 0.243961, Systemstep: 0.0006799, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1836). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.03802 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08907|1.01418 DOMAIN: combining multiple-domains took 0.290604 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.84362 sec) DOMAIN: domain decomposition done. (took in total 4.62235 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27923 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.43 sec =987961 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 269.414 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1837, Time: 0.804564, Redshift: 0.242909, Systemstep: 0.000680475, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1837). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.02564 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08905|1.01418 DOMAIN: combining multiple-domains took 0.29105 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.29995 sec) DOMAIN: domain decomposition done. (took in total 6.07998 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21701 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.4416 sec =987993 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.626 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1838, Time: 0.804905, Redshift: 0.242383, Systemstep: 0.000340454, Dloga: 0.000423063, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1838). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.75978 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08904|1.01418 DOMAIN: combining multiple-domains took 0.291181 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.0893 sec) DOMAIN: domain decomposition done. (took in total 4.53201 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17028 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.4371 sec =988017 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=16 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.464 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=16: particles 2147483648 KICKS: 1st gravity for highest active timebin=16: particles 2147483648 Sync-Point 1839, Time: 0.805245, Redshift: 0.241858, Systemstep: 0.000340598, Dloga: 0.000423063, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1839). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.98719 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08903|1.01418 DOMAIN: combining multiple-domains took 0.28644 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.95706 sec) DOMAIN: domain decomposition done. (took in total 4.68401 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21679 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.4369 sec =988012 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=16 (presently allocated=1862.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.205 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=16: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.46473 sec PM-PERIODIC: done. (took 13.6544 seconds) TIMESTEPS: displacement time constraint: 0.00624941 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36054 sec PM-PERIODIC: done. (took 13.3826 seconds) TIMESTEPS: displacement time constraint: 0.00624941 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=16: particles 2147483648 Sync-Point 1840, Time: 0.805586, Redshift: 0.241333, Systemstep: 0.000340742, Dloga: 0.000423063, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1840). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.07301 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08903|1.01418 DOMAIN: combining multiple-domains took 0.28678 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.77942 sec) DOMAIN: domain decomposition done. (took in total 5.53181 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.13581 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.21 MB) GRAVTREE: Tree construction done. took 17.4271 sec =988020 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995275 GRAVTREE: Begin tree force. timebin=16 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.389 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=16: particles 2147483648 KICKS: 1st gravity for highest active timebin=16: particles 2147483648 Sync-Point 1841, Time: 0.805927, Redshift: 0.240807, Systemstep: 0.000340886, Dloga: 0.000423063, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1841). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.00842 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08902|1.01418 DOMAIN: combining multiple-domains took 0.286458 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07897 sec) DOMAIN: domain decomposition done. (took in total 4.82342 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21517 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.4381 sec =988042 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995276 GRAVTREE: Begin tree force. timebin=16 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.741 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=16: particles 2147483648 KICKS: 1st gravity for highest active timebin=16: particles 2147483648 Sync-Point 1842, Time: 0.806609, Redshift: 0.239758, Systemstep: 0.000682205, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1842). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.93904 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08898|1.01418 DOMAIN: combining multiple-domains took 0.354842 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.46345 sec) DOMAIN: domain decomposition done. (took in total 6.14839 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23628 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.456 sec =988071 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995276 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.34 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1843, Time: 0.807292, Redshift: 0.23871, Systemstep: 0.000682782, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1843). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.91256 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08897|1.01418 DOMAIN: combining multiple-domains took 0.356593 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.43216 sec) DOMAIN: domain decomposition done. (took in total 5.09294 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30243 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.4385 sec =988116 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995276 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.77 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.189 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1844, Time: 0.807975, Redshift: 0.237662, Systemstep: 0.00068336, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1844). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78156 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08896|1.01418 DOMAIN: combining multiple-domains took 0.391743 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.62816 sec) DOMAIN: domain decomposition done. (took in total 6.19242 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25857 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.2 MB) GRAVTREE: Tree construction done. took 17.4532 sec =988141 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995276 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.77 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.59 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34012 sec PM-PERIODIC: done. (took 13.6926 seconds) TIMESTEPS: displacement time constraint: 0.00626298 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3123 sec PM-PERIODIC: done. (took 13.3399 seconds) TIMESTEPS: displacement time constraint: 0.00626298 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1845, Time: 0.808659, Redshift: 0.236615, Systemstep: 0.000683939, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1845). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82822 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08893|1.01418 DOMAIN: combining multiple-domains took 0.410256 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.34444 sec) DOMAIN: domain decomposition done. (took in total 5.97498 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24553 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.19 MB) GRAVTREE: Tree construction done. took 17.4735 sec =988210 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995276 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.77 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 270.11 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1846, Time: 0.809344, Redshift: 0.235569, Systemstep: 0.000684518, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1846). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.91744 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.093|1.01559 DOMAIN: combining multiple-domains took 0.285837 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.643 sec) DOMAIN: domain decomposition done. (took in total 15.2969 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.43076 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.4548 sec =988240 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995276 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 266.771 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1847, Time: 0.810029, Redshift: 0.234524, Systemstep: 0.000685097, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1847). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7869 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.093|1.01559 DOMAIN: combining multiple-domains took 0.288086 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.93518 sec) DOMAIN: domain decomposition done. (took in total 5.40174 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26225 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.4283 sec =988260 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.304 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1848, Time: 0.810714, Redshift: 0.23348, Systemstep: 0.000685677, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1848). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78264 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09301|1.01559 DOMAIN: combining multiple-domains took 0.286311 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12157 sec) DOMAIN: domain decomposition done. (took in total 5.58228 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2599 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.67 MB) GRAVTREE: Tree construction done. took 17.4001 sec =988279 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.43 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.171 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21357 sec PM-PERIODIC: done. (took 13.5322 seconds) TIMESTEPS: displacement time constraint: 0.00626994 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2231 sec PM-PERIODIC: done. (took 13.9758 seconds) TIMESTEPS: displacement time constraint: 0.00626994 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1849, Time: 0.811401, Redshift: 0.232437, Systemstep: 0.000686258, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1849). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78052 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09302|1.01559 DOMAIN: combining multiple-domains took 0.286628 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22667 sec) DOMAIN: domain decomposition done. (took in total 5.68509 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26954 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.4178 sec =988287 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 268.246 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1850, Time: 0.812087, Redshift: 0.231394, Systemstep: 0.000686838, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1850). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78065 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09305|1.01559 DOMAIN: combining multiple-domains took 0.289325 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.16733 sec) DOMAIN: domain decomposition done. (took in total 5.62832 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27937 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.4216 sec =988320 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.703 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1851, Time: 0.812775, Redshift: 0.230353, Systemstep: 0.00068742, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1851). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7824 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09306|1.01559 DOMAIN: combining multiple-domains took 0.28877 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.13071 sec) DOMAIN: domain decomposition done. (took in total 5.59269 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26049 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.3899 sec =988373 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.331 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1852, Time: 0.813463, Redshift: 0.229312, Systemstep: 0.000688002, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1852). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7845 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09307|1.01559 DOMAIN: combining multiple-domains took 0.287029 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.0982 sec) DOMAIN: domain decomposition done. (took in total 5.56283 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24261 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.4214 sec =988414 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 269.152 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20833 sec PM-PERIODIC: done. (took 13.4069 seconds) TIMESTEPS: displacement time constraint: 0.00628245 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.38347 sec PM-PERIODIC: done. (took 13.6067 seconds) TIMESTEPS: displacement time constraint: 0.00628245 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 233.417 sec, total size 352287 MB, corresponds to effective I/O rate of 1509.26 MB/sec Sync-Point 1853, Time: 0.814151, Redshift: 0.228273, Systemstep: 0.000688584, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1853). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78426 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09309|1.01559 DOMAIN: combining multiple-domains took 0.287946 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.9272 sec) DOMAIN: domain decomposition done. (took in total 4.39027 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27173 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.4082 sec =988417 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995277 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.169 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1854, Time: 0.814841, Redshift: 0.227234, Systemstep: 0.000689167, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1854). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77829 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09311|1.01559 DOMAIN: combining multiple-domains took 0.288152 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14406 sec) DOMAIN: domain decomposition done. (took in total 4.60126 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27228 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.4459 sec =988460 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.183 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1855, Time: 0.81553, Redshift: 0.226196, Systemstep: 0.00068975, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1855). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77501 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09312|1.01559 DOMAIN: combining multiple-domains took 0.289699 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.3836 sec) DOMAIN: domain decomposition done. (took in total 5.83978 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22823 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.416 sec =988465 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.103 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1856, Time: 0.816221, Redshift: 0.225159, Systemstep: 0.000690334, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1856). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77464 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09316|1.01559 DOMAIN: combining multiple-domains took 0.288156 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22027 sec) DOMAIN: domain decomposition done. (took in total 4.67397 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2796 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.4118 sec =988487 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.219 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19906 sec PM-PERIODIC: done. (took 13.4849 seconds) TIMESTEPS: displacement time constraint: 0.00630681 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19955 sec PM-PERIODIC: done. (took 13.954 seconds) TIMESTEPS: displacement time constraint: 0.0063068 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1857, Time: 0.816912, Redshift: 0.224123, Systemstep: 0.000690919, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1857). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78065 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09318|1.01559 DOMAIN: combining multiple-domains took 0.28709 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.35801 sec) DOMAIN: domain decomposition done. (took in total 4.8159 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27364 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.4114 sec =988539 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.332 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1858, Time: 0.817603, Redshift: 0.223087, Systemstep: 0.000691503, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1858). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78172 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08575|1.04768 DOMAIN: combining multiple-domains took 0.2865 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.647 sec) DOMAIN: domain decomposition done. (took in total 15.1062 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.34166 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.82 MB) GRAVTREE: Tree construction done. took 17.4431 sec =988579 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.25 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 269.608 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1859, Time: 0.818295, Redshift: 0.222053, Systemstep: 0.000692089, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1859). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78146 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08584|1.04768 DOMAIN: combining multiple-domains took 0.287425 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.90126 sec) DOMAIN: domain decomposition done. (took in total 6.35947 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26064 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.83 MB) GRAVTREE: Tree construction done. took 17.385 sec =988612 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.26 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.781 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1860, Time: 0.818988, Redshift: 0.221019, Systemstep: 0.000692675, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1860). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7791 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.08594|1.04768 DOMAIN: combining multiple-domains took 0.286151 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.84272 sec) DOMAIN: domain decomposition done. (took in total 6.2981 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31988 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.84 MB) GRAVTREE: Tree construction done. took 17.3622 sec =988666 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995278 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.28 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 269.842 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20783 sec PM-PERIODIC: done. (took 13.8002 seconds) TIMESTEPS: displacement time constraint: 0.0063312 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23295 sec PM-PERIODIC: done. (took 13.4131 seconds) TIMESTEPS: displacement time constraint: 0.0063312 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1861, Time: 0.819681, Redshift: 0.219987, Systemstep: 0.000693261, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1861). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88403 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09329|1.01559 DOMAIN: combining multiple-domains took 0.3873 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.5687 sec) DOMAIN: domain decomposition done. (took in total 15.2283 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.41247 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.4403 sec =988684 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995279 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.66 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1862, Time: 0.820375, Redshift: 0.218955, Systemstep: 0.000693848, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1862). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79374 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0933|1.01559 DOMAIN: combining multiple-domains took 0.287898 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62214 sec) DOMAIN: domain decomposition done. (took in total 5.09482 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29171 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.4245 sec =988713 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995279 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.307 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1863, Time: 0.821069, Redshift: 0.217924, Systemstep: 0.000694435, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1863). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78568 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09332|1.01559 DOMAIN: combining multiple-domains took 0.287521 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89863 sec) DOMAIN: domain decomposition done. (took in total 5.36239 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24621 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.4249 sec =988769 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995279 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.934 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1864, Time: 0.821764, Redshift: 0.216894, Systemstep: 0.000695023, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1864). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79207 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09333|1.01559 DOMAIN: combining multiple-domains took 0.286804 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.35185 sec) DOMAIN: domain decomposition done. (took in total 4.82224 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2752 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.4225 sec =988798 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995279 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.49 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.734 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20307 sec PM-PERIODIC: done. (took 13.5405 seconds) TIMESTEPS: displacement time constraint: 0.00635637 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24703 sec PM-PERIODIC: done. (took 13.782 seconds) TIMESTEPS: displacement time constraint: 0.00635638 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1865, Time: 0.82246, Redshift: 0.215864, Systemstep: 0.000695611, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1865). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78667 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09335|1.01559 DOMAIN: combining multiple-domains took 0.288716 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.7251 sec) DOMAIN: domain decomposition done. (took in total 5.19305 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23365 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.5065 sec =988819 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995279 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.49 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.785 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1866, Time: 0.823156, Redshift: 0.214836, Systemstep: 0.0006962, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1866). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79153 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09338|1.01559 DOMAIN: combining multiple-domains took 0.287923 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.02813 sec) DOMAIN: domain decomposition done. (took in total 4.49852 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28448 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.72 MB) GRAVTREE: Tree construction done. took 17.4181 sec =988867 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995279 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.855 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1867, Time: 0.823853, Redshift: 0.213809, Systemstep: 0.000696789, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1867). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79021 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09344|1.01559 DOMAIN: combining multiple-domains took 0.288073 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.9527 sec) DOMAIN: domain decomposition done. (took in total 4.42197 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30657 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.72 MB) GRAVTREE: Tree construction done. took 17.4312 sec =988884 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.5 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.882 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1868, Time: 0.82455, Redshift: 0.212782, Systemstep: 0.000697379, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1868). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78986 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09345|1.01559 DOMAIN: combining multiple-domains took 0.287048 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.81966 sec) DOMAIN: domain decomposition done. (took in total 5.28736 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27281 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.4424 sec =988907 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.51 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 268.966 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.209 sec PM-PERIODIC: done. (took 13.4409 seconds) TIMESTEPS: displacement time constraint: 0.00639578 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24833 sec PM-PERIODIC: done. (took 13.5103 seconds) TIMESTEPS: displacement time constraint: 0.00639578 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1869, Time: 0.825248, Redshift: 0.211756, Systemstep: 0.00069797, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1869). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78792 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09348|1.01559 DOMAIN: combining multiple-domains took 0.28701 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.88902 sec) DOMAIN: domain decomposition done. (took in total 5.35627 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27719 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.4414 sec =988933 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.51 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.857 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1870, Time: 0.825947, Redshift: 0.210731, Systemstep: 0.00069856, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1870). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78588 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09352|1.01559 DOMAIN: combining multiple-domains took 0.291992 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.77322 sec) DOMAIN: domain decomposition done. (took in total 5.24198 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29853 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.73 MB) GRAVTREE: Tree construction done. took 17.4649 sec =988987 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.52 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.955 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1871, Time: 0.826646, Redshift: 0.209707, Systemstep: 0.000699152, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1871). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78194 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09357|1.01559 DOMAIN: combining multiple-domains took 0.292725 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.91287 sec) DOMAIN: domain decomposition done. (took in total 5.37982 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24143 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.6331 sec =988986 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.741 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1872, Time: 0.827346, Redshift: 0.208684, Systemstep: 0.000699744, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1872). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78095 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09359|1.01559 DOMAIN: combining multiple-domains took 0.293229 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.68266 sec) DOMAIN: domain decomposition done. (took in total 5.14974 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26254 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.4708 sec =989013 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.858 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21325 sec PM-PERIODIC: done. (took 14.0199 seconds) TIMESTEPS: displacement time constraint: 0.00641906 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20475 sec PM-PERIODIC: done. (took 13.4768 seconds) TIMESTEPS: displacement time constraint: 0.00641906 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1873, Time: 0.828046, Redshift: 0.207662, Systemstep: 0.000700336, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1873). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7833 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09361|1.01559 DOMAIN: combining multiple-domains took 0.292656 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.89344 sec) DOMAIN: domain decomposition done. (took in total 5.36151 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2472 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.74 MB) GRAVTREE: Tree construction done. took 17.449 sec =989053 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99528 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.53 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.672 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1874, Time: 0.828747, Redshift: 0.206641, Systemstep: 0.000700929, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1874). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86925 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09366|1.01559 DOMAIN: combining multiple-domains took 0.401271 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.00979 sec) DOMAIN: domain decomposition done. (took in total 5.67227 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26266 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.4524 sec =989098 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.54 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 269.736 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1875, Time: 0.829449, Redshift: 0.20562, Systemstep: 0.000701522, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1875). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.12505 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09368|1.01559 DOMAIN: combining multiple-domains took 0.292811 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.48318 sec) DOMAIN: domain decomposition done. (took in total 6.33379 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22675 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.75 MB) GRAVTREE: Tree construction done. took 17.4719 sec =989137 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.54 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.482 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 217.023 sec, total size 352287 MB, corresponds to effective I/O rate of 1623.27 MB/sec Sync-Point 1876, Time: 0.830151, Redshift: 0.2046, Systemstep: 0.000702116, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1876). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78594 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09401|1.02124 DOMAIN: combining multiple-domains took 0.287264 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2399 sec) DOMAIN: domain decomposition done. (took in total 15.7097 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.01734 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.79 MB) GRAVTREE: Tree construction done. took 17.6237 sec =989151 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.6 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 271.021 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35168 sec PM-PERIODIC: done. (took 13.725 seconds) TIMESTEPS: displacement time constraint: 0.00646455 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33048 sec PM-PERIODIC: done. (took 13.4419 seconds) TIMESTEPS: displacement time constraint: 0.00646455 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1877, Time: 0.830853, Redshift: 0.203582, Systemstep: 0.00070271, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1877). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79092 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.08736|1.03815 DOMAIN: combining multiple-domains took 0.286975 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.2359 sec) DOMAIN: domain decomposition done. (took in total 14.706 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.05731 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.5244 sec =989181 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.51 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 271.246 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1878, Time: 0.831557, Redshift: 0.202564, Systemstep: 0.000703305, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1878). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78489 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09399|1.02124 DOMAIN: combining multiple-domains took 0.285974 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.993 sec) DOMAIN: domain decomposition done. (took in total 15.453 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.96548 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.79 MB) GRAVTREE: Tree construction done. took 17.5161 sec =989238 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.59 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.944 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1879, Time: 0.832261, Redshift: 0.201547, Systemstep: 0.0007039, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1879). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78806 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09395|1.02124 DOMAIN: combining multiple-domains took 0.287937 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62223 sec) DOMAIN: domain decomposition done. (took in total 5.09074 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26628 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.78 MB) GRAVTREE: Tree construction done. took 17.6521 sec =989269 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.59 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 271.826 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1880, Time: 0.832965, Redshift: 0.20053, Systemstep: 0.000704496, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1880). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79105 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.09331|1.01982 DOMAIN: combining multiple-domains took 0.289269 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.1354 sec) DOMAIN: domain decomposition done. (took in total 14.6092 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38748 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.71 MB) GRAVTREE: Tree construction done. took 17.6499 sec =989295 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995281 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.48 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.65 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23414 sec PM-PERIODIC: done. (took 13.284 seconds) TIMESTEPS: displacement time constraint: 0.00649256 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26521 sec PM-PERIODIC: done. (took 13.8178 seconds) TIMESTEPS: displacement time constraint: 0.00649256 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1881, Time: 0.83367, Redshift: 0.199515, Systemstep: 0.000705093, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1881). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78394 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08267|1.01418 DOMAIN: combining multiple-domains took 0.289355 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.8298 sec) DOMAIN: domain decomposition done. (took in total 15.2958 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.06756 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.46 MB) GRAVTREE: Tree construction done. took 17.5607 sec =989314 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.75 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 271.675 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1882, Time: 0.834376, Redshift: 0.1985, Systemstep: 0.000705689, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1882). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78289 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08279|1.01418 DOMAIN: combining multiple-domains took 0.290207 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44478 sec) DOMAIN: domain decomposition done. (took in total 5.90749 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28666 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.47 MB) GRAVTREE: Tree construction done. took 17.468 sec =989351 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.77 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 271.67 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1883, Time: 0.835082, Redshift: 0.197487, Systemstep: 0.000706287, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1883). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.97926 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0829|1.01418 DOMAIN: combining multiple-domains took 0.337976 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.41394 sec) DOMAIN: domain decomposition done. (took in total 5.12154 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23522 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.48 MB) GRAVTREE: Tree construction done. took 17.4818 sec =989379 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 271.704 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1884, Time: 0.835789, Redshift: 0.196474, Systemstep: 0.000706885, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1884). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78142 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08302|1.01418 DOMAIN: combining multiple-domains took 0.289903 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.80146 sec) DOMAIN: domain decomposition done. (took in total 5.26271 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29064 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.5 MB) GRAVTREE: Tree construction done. took 17.5333 sec =989396 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.8 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 271.954 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24497 sec PM-PERIODIC: done. (took 13.2903 seconds) TIMESTEPS: displacement time constraint: 0.00653996 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24352 sec PM-PERIODIC: done. (took 13.7297 seconds) TIMESTEPS: displacement time constraint: 0.00653996 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1885, Time: 0.836497, Redshift: 0.195462, Systemstep: 0.000707483, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1885). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78995 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08313|1.01418 DOMAIN: combining multiple-domains took 0.28767 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.77381 sec) DOMAIN: domain decomposition done. (took in total 6.24133 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32386 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.51 MB) GRAVTREE: Tree construction done. took 17.4874 sec =989428 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.82 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 272.14 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1886, Time: 0.837205, Redshift: 0.194451, Systemstep: 0.000708082, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1886). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78134 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08325|1.01418 DOMAIN: combining multiple-domains took 0.288899 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8998 sec) DOMAIN: domain decomposition done. (took in total 5.35953 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28734 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.53 MB) GRAVTREE: Tree construction done. took 17.4881 sec =989454 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1861.84 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 271.957 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1887, Time: 0.837913, Redshift: 0.193441, Systemstep: 0.000708681, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1887). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78064 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.08828|1.03815 DOMAIN: combining multiple-domains took 0.285703 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.9497 sec) DOMAIN: domain decomposition done. (took in total 15.4061 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18687 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.4074 sec =989493 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995282 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.66 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 272.28 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1888, Time: 0.838623, Redshift: 0.192431, Systemstep: 0.000709281, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1888). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.11207 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=44 for nextra=0, reaching maximum imbalance of 1.08833|1.03815 DOMAIN: combining multiple-domains took 0.352471 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.27959 sec) DOMAIN: domain decomposition done. (took in total 6.1333 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30593 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.4224 sec =989529 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 272.364 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21863 sec PM-PERIODIC: done. (took 13.5046 seconds) TIMESTEPS: displacement time constraint: 0.00656646 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20623 sec PM-PERIODIC: done. (took 13.3728 seconds) TIMESTEPS: displacement time constraint: 0.00656646 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1889, Time: 0.839333, Redshift: 0.191423, Systemstep: 0.000709882, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1889). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78082 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09101|1.01418 DOMAIN: combining multiple-domains took 0.287218 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7525 sec) DOMAIN: domain decomposition done. (took in total 15.2106 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.00644 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.44 MB) GRAVTREE: Tree construction done. took 17.488 sec =989542 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.11 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 273.314 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1890, Time: 0.840043, Redshift: 0.190415, Systemstep: 0.000710482, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1890). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77939 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09104|1.01418 DOMAIN: combining multiple-domains took 0.290085 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.91187 sec) DOMAIN: domain decomposition done. (took in total 4.37274 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30061 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.44 MB) GRAVTREE: Tree construction done. took 17.4823 sec =989586 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.11 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 273.475 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1891, Time: 0.840754, Redshift: 0.189408, Systemstep: 0.000711084, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1891). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77962 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09107|1.01418 DOMAIN: combining multiple-domains took 0.290034 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.28322 sec) DOMAIN: domain decomposition done. (took in total 4.74423 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30742 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.45 MB) GRAVTREE: Tree construction done. took 17.478 sec =989617 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.12 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 273.496 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1892, Time: 0.841466, Redshift: 0.188402, Systemstep: 0.000711686, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1892). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.98733 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09109|1.01418 DOMAIN: combining multiple-domains took 0.366984 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.0694 sec) DOMAIN: domain decomposition done. (took in total 6.81539 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27515 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.45 MB) GRAVTREE: Tree construction done. took 17.4837 sec =989635 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.12 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 273.567 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27815 sec PM-PERIODIC: done. (took 13.4174 seconds) TIMESTEPS: displacement time constraint: 0.00659874 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27946 sec PM-PERIODIC: done. (took 13.9334 seconds) TIMESTEPS: displacement time constraint: 0.00659874 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1893, Time: 0.842178, Redshift: 0.187397, Systemstep: 0.000712288, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1893). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78112 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09111|1.01418 DOMAIN: combining multiple-domains took 0.289151 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98515 sec) DOMAIN: domain decomposition done. (took in total 5.44714 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27169 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.45 MB) GRAVTREE: Tree construction done. took 17.4923 sec =989663 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.12 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 271.835 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1894, Time: 0.842891, Redshift: 0.186393, Systemstep: 0.000712891, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1894). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77912 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09116|1.01418 DOMAIN: combining multiple-domains took 0.292518 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18816 sec) DOMAIN: domain decomposition done. (took in total 5.65161 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31566 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.46 MB) GRAVTREE: Tree construction done. took 17.4858 sec =989688 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995283 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.13 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 273.009 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1895, Time: 0.843604, Redshift: 0.18539, Systemstep: 0.000713495, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1895). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78888 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09119|1.01418 DOMAIN: combining multiple-domains took 0.288612 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12074 sec) DOMAIN: domain decomposition done. (took in total 5.58981 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31186 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.46 MB) GRAVTREE: Tree construction done. took 17.4969 sec =989727 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995284 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.14 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 271.483 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1896, Time: 0.844319, Redshift: 0.184387, Systemstep: 0.000714099, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1896). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78313 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09123|1.01418 DOMAIN: combining multiple-domains took 0.290814 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.9464 sec) DOMAIN: domain decomposition done. (took in total 5.41299 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28867 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.46 MB) GRAVTREE: Tree construction done. took 17.635 sec =989751 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995284 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.14 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 274.393 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26465 sec PM-PERIODIC: done. (took 13.9508 seconds) TIMESTEPS: displacement time constraint: 0.00658422 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24532 sec PM-PERIODIC: done. (took 13.5274 seconds) TIMESTEPS: displacement time constraint: 0.00658423 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1897, Time: 0.845033, Redshift: 0.183385, Systemstep: 0.000714703, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1897). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78163 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09125|1.01418 DOMAIN: combining multiple-domains took 0.287505 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.1434 sec) DOMAIN: domain decomposition done. (took in total 6.60459 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29711 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.47 MB) GRAVTREE: Tree construction done. took 17.4703 sec =989787 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995284 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.15 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 273.849 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1898, Time: 0.845749, Redshift: 0.182384, Systemstep: 0.000715308, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1898). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78824 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09129|1.01418 DOMAIN: combining multiple-domains took 0.287112 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.99176 sec) DOMAIN: domain decomposition done. (took in total 4.45889 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30859 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.47 MB) GRAVTREE: Tree construction done. took 17.5786 sec =989852 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995284 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.15 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 273.811 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 196.805 sec, total size 352287 MB, corresponds to effective I/O rate of 1790.03 MB/sec Sync-Point 1899, Time: 0.846465, Redshift: 0.181384, Systemstep: 0.000715913, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1899). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77925 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09132|1.01418 DOMAIN: combining multiple-domains took 0.285489 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39602 sec) DOMAIN: domain decomposition done. (took in total 5.85127 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23164 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.48 MB) GRAVTREE: Tree construction done. took 17.4817 sec =989885 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995284 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.16 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.267 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1900, Time: 0.847181, Redshift: 0.180385, Systemstep: 0.00071652, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1900). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78415 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09136|1.01418 DOMAIN: combining multiple-domains took 0.287634 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.63269 sec) DOMAIN: domain decomposition done. (took in total 6.09735 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31839 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.48 MB) GRAVTREE: Tree construction done. took 17.4787 sec =989897 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995284 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.16 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.981 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20206 sec PM-PERIODIC: done. (took 13.4889 seconds) TIMESTEPS: displacement time constraint: 0.00655611 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21385 sec PM-PERIODIC: done. (took 13.9441 seconds) TIMESTEPS: displacement time constraint: 0.00655611 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1901, Time: 0.847898, Redshift: 0.179387, Systemstep: 0.000717126, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1901). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77746 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09139|1.01418 DOMAIN: combining multiple-domains took 0.288404 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.99883 sec) DOMAIN: domain decomposition done. (took in total 5.45591 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27026 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.48 MB) GRAVTREE: Tree construction done. took 17.469 sec =989933 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.17 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.058 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1902, Time: 0.848616, Redshift: 0.178389, Systemstep: 0.000717733, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1902). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78074 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09142|1.01418 DOMAIN: combining multiple-domains took 0.287431 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.77998 sec) DOMAIN: domain decomposition done. (took in total 6.23954 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23634 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.49 MB) GRAVTREE: Tree construction done. took 17.4718 sec =989971 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.18 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.252 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1903, Time: 0.849334, Redshift: 0.177393, Systemstep: 0.000718341, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1903). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84556 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09147|1.01418 DOMAIN: combining multiple-domains took 0.288474 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.8651 sec) DOMAIN: domain decomposition done. (took in total 5.43846 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26859 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.49 MB) GRAVTREE: Tree construction done. took 17.4887 sec =990030 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.18 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.452 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1904, Time: 0.850053, Redshift: 0.176397, Systemstep: 0.000718949, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1904). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78541 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0915|1.01418 DOMAIN: combining multiple-domains took 0.287631 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.39173 sec) DOMAIN: domain decomposition done. (took in total 5.85587 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28192 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.4887 sec =990054 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.19 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.94 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22358 sec PM-PERIODIC: done. (took 13.4766 seconds) TIMESTEPS: displacement time constraint: 0.00654278 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.19408 sec PM-PERIODIC: done. (took 13.6073 seconds) TIMESTEPS: displacement time constraint: 0.00654278 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1905, Time: 0.850773, Redshift: 0.175402, Systemstep: 0.000719557, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1905). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79171 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09152|1.01418 DOMAIN: combining multiple-domains took 0.288999 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.03817 sec) DOMAIN: domain decomposition done. (took in total 5.51013 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30668 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.4719 sec =990087 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.19 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.813 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1906, Time: 0.851493, Redshift: 0.174408, Systemstep: 0.000720166, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1906). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84027 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09154|1.01418 DOMAIN: combining multiple-domains took 0.406886 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.74083 sec) DOMAIN: domain decomposition done. (took in total 7.37916 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30094 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.4804 sec =990127 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.19 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.627 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1907, Time: 0.852214, Redshift: 0.173415, Systemstep: 0.000720776, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1907). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7863 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.09156|1.01418 DOMAIN: combining multiple-domains took 0.287845 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.05951 sec) DOMAIN: domain decomposition done. (took in total 4.52436 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29312 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.4735 sec =990123 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995285 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.2 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.796 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1908, Time: 0.852935, Redshift: 0.172422, Systemstep: 0.000721386, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1908). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78045 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08601|1.01418 DOMAIN: combining multiple-domains took 0.288808 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.23733 sec) DOMAIN: domain decomposition done. (took in total 5.69797 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32524 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.85 MB) GRAVTREE: Tree construction done. took 17.485 sec =990162 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995286 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.29 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.594 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22634 sec PM-PERIODIC: done. (took 13.8401 seconds) TIMESTEPS: displacement time constraint: 0.00652609 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21687 sec PM-PERIODIC: done. (took 13.4743 seconds) TIMESTEPS: displacement time constraint: 0.0065261 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1909, Time: 0.853657, Redshift: 0.171431, Systemstep: 0.000721997, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1909). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77782 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08613|1.01418 DOMAIN: combining multiple-domains took 0.285521 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.50568 sec) DOMAIN: domain decomposition done. (took in total 4.95959 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31702 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.86 MB) GRAVTREE: Tree construction done. took 17.4902 sec =990210 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995286 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.31 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.654 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1910, Time: 0.85438, Redshift: 0.17044, Systemstep: 0.000722608, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1910). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77434 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08626|1.01418 DOMAIN: combining multiple-domains took 0.285523 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.59378 sec) DOMAIN: domain decomposition done. (took in total 6.04383 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3001 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.88 MB) GRAVTREE: Tree construction done. took 17.6056 sec =990242 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995286 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.33 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.713 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1911, Time: 0.855103, Redshift: 0.16945, Systemstep: 0.00072322, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1911). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7859 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08639|1.01418 DOMAIN: combining multiple-domains took 0.2955 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.58964 sec) DOMAIN: domain decomposition done. (took in total 6.06166 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32883 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.9 MB) GRAVTREE: Tree construction done. took 17.4985 sec =990278 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995286 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.998 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1912, Time: 0.855827, Redshift: 0.168461, Systemstep: 0.000723832, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1912). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77771 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08652|1.01418 DOMAIN: combining multiple-domains took 0.291021 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47292 sec) DOMAIN: domain decomposition done. (took in total 5.93174 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27843 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.91 MB) GRAVTREE: Tree construction done. took 17.6131 sec =990290 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995286 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.38 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.575 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23369 sec PM-PERIODIC: done. (took 13.8877 seconds) TIMESTEPS: displacement time constraint: 0.00650157 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23667 sec PM-PERIODIC: done. (took 13.4218 seconds) TIMESTEPS: displacement time constraint: 0.00650158 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1913, Time: 0.856551, Redshift: 0.167473, Systemstep: 0.000724444, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1913). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.92605 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08665|1.01418 DOMAIN: combining multiple-domains took 0.359475 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.73412 sec) DOMAIN: domain decomposition done. (took in total 6.41013 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23312 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.93 MB) GRAVTREE: Tree construction done. took 17.4818 sec =990334 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995286 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.4 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.047 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1914, Time: 0.857276, Redshift: 0.166485, Systemstep: 0.000725058, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1914). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77549 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08679|1.01418 DOMAIN: combining multiple-domains took 0.286631 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44224 sec) DOMAIN: domain decomposition done. (took in total 5.89482 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27603 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.94 MB) GRAVTREE: Tree construction done. took 17.4725 sec =990362 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.42 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.882 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1915, Time: 0.858002, Redshift: 0.165499, Systemstep: 0.000725671, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1915). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77477 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08691|1.01418 DOMAIN: combining multiple-domains took 0.285555 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.23751 sec) DOMAIN: domain decomposition done. (took in total 5.68832 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25967 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.96 MB) GRAVTREE: Tree construction done. took 17.4806 sec =990410 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.915 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1916, Time: 0.858728, Redshift: 0.164513, Systemstep: 0.000726286, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1916). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77036 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08705|1.01418 DOMAIN: combining multiple-domains took 0.287014 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95511 sec) DOMAIN: domain decomposition done. (took in total 5.40308 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32772 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.97 MB) GRAVTREE: Tree construction done. took 17.4662 sec =990445 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.46 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.193 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17991 sec PM-PERIODIC: done. (took 13.567 seconds) TIMESTEPS: displacement time constraint: 0.00649233 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2485 sec PM-PERIODIC: done. (took 13.4559 seconds) TIMESTEPS: displacement time constraint: 0.00649233 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1917, Time: 0.859455, Redshift: 0.163528, Systemstep: 0.000726901, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1917). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77561 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08716|1.01418 DOMAIN: combining multiple-domains took 0.28676 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.43572 sec) DOMAIN: domain decomposition done. (took in total 4.88841 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30396 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1812.99 MB) GRAVTREE: Tree construction done. took 17.496 sec =990478 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.48 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.396 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1918, Time: 0.860183, Redshift: 0.162544, Systemstep: 0.000727516, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1918). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78414 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.0873|1.01418 DOMAIN: combining multiple-domains took 0.286208 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.43501 sec) DOMAIN: domain decomposition done. (took in total 5.89537 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28109 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813 MB) GRAVTREE: Tree construction done. took 17.464 sec =990496 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.5 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.158 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1919, Time: 0.860911, Redshift: 0.161561, Systemstep: 0.000728132, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1919). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77381 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08742|1.01418 DOMAIN: combining multiple-domains took 0.287043 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.49425 sec) DOMAIN: domain decomposition done. (took in total 5.94596 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23694 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.02 MB) GRAVTREE: Tree construction done. took 17.5042 sec =990527 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.364 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1920, Time: 0.861639, Redshift: 0.160578, Systemstep: 0.000728748, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1920). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77866 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.08755|1.01418 DOMAIN: combining multiple-domains took 0.408686 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.17199 sec) DOMAIN: domain decomposition done. (took in total 4.74959 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31879 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.03 MB) GRAVTREE: Tree construction done. took 17.4834 sec =990555 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995287 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.54 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.349 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24252 sec PM-PERIODIC: done. (took 13.3814 seconds) TIMESTEPS: displacement time constraint: 0.00646807 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24447 sec PM-PERIODIC: done. (took 13.4441 seconds) TIMESTEPS: displacement time constraint: 0.00646807 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1921, Time: 0.862369, Redshift: 0.159597, Systemstep: 0.000729365, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1921). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77262 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0918|1.04768 DOMAIN: combining multiple-domains took 0.286015 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.4785 sec) DOMAIN: domain decomposition done. (took in total 15.9275 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.99818 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.4357 sec =990579 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 274.612 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 195.988 sec, total size 352287 MB, corresponds to effective I/O rate of 1797.49 MB/sec Sync-Point 1922, Time: 0.863099, Redshift: 0.158616, Systemstep: 0.000729982, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1922). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78425 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09507|1.04768 DOMAIN: combining multiple-domains took 0.287201 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.28167 sec) DOMAIN: domain decomposition done. (took in total 5.74465 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.56461 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.92 MB) GRAVTREE: Tree construction done. took 17.4778 sec =990640 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.77 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 274.837 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1923, Time: 0.863829, Redshift: 0.157636, Systemstep: 0.0007306, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1923). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79305 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09511|1.04768 DOMAIN: combining multiple-domains took 0.288414 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11204 sec) DOMAIN: domain decomposition done. (took in total 4.58563 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27881 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.92 MB) GRAVTREE: Tree construction done. took 17.4739 sec =990674 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 274.814 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1924, Time: 0.864561, Redshift: 0.156657, Systemstep: 0.000731219, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1924). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78307 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09513|1.04768 DOMAIN: combining multiple-domains took 0.288095 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79742 sec) DOMAIN: domain decomposition done. (took in total 5.26052 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28168 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.92 MB) GRAVTREE: Tree construction done. took 17.5703 sec =990689 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 274.866 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18953 sec PM-PERIODIC: done. (took 13.7802 seconds) TIMESTEPS: displacement time constraint: 0.00646404 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20352 sec PM-PERIODIC: done. (took 13.3129 seconds) TIMESTEPS: displacement time constraint: 0.00646404 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1925, Time: 0.865292, Redshift: 0.155679, Systemstep: 0.000731838, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1925). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.93618 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09515|1.04768 DOMAIN: combining multiple-domains took 0.335563 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11553 sec) DOMAIN: domain decomposition done. (took in total 4.7802 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28773 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.93 MB) GRAVTREE: Tree construction done. took 17.4879 sec =990701 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.78 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 274.926 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1926, Time: 0.866025, Redshift: 0.154701, Systemstep: 0.000732457, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1926). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78485 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09518|1.04768 DOMAIN: combining multiple-domains took 0.288512 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71081 sec) DOMAIN: domain decomposition done. (took in total 6.17659 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26289 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.93 MB) GRAVTREE: Tree construction done. took 17.4534 sec =990724 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.075 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1927, Time: 0.866758, Redshift: 0.153725, Systemstep: 0.000733077, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1927). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78309 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0952|1.04768 DOMAIN: combining multiple-domains took 0.286373 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.98845 sec) DOMAIN: domain decomposition done. (took in total 6.45046 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22855 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.93 MB) GRAVTREE: Tree construction done. took 17.48 sec =990751 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995288 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.79 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.202 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1928, Time: 0.867492, Redshift: 0.152749, Systemstep: 0.000733698, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1928). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78544 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09526|1.04768 DOMAIN: combining multiple-domains took 0.287141 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.10541 sec) DOMAIN: domain decomposition done. (took in total 5.57015 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29803 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.94 MB) GRAVTREE: Tree construction done. took 17.5759 sec =990775 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.8 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.207 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24383 sec PM-PERIODIC: done. (took 14.0736 seconds) TIMESTEPS: displacement time constraint: 0.00644732 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2634 sec PM-PERIODIC: done. (took 13.7077 seconds) TIMESTEPS: displacement time constraint: 0.00644732 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1929, Time: 0.868226, Redshift: 0.151774, Systemstep: 0.000734319, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1929). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.09315 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0953|1.04768 DOMAIN: combining multiple-domains took 0.287919 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17776 sec) DOMAIN: domain decomposition done. (took in total 5.95786 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22151 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.94 MB) GRAVTREE: Tree construction done. took 17.4788 sec =990828 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.81 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.303 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1930, Time: 0.868961, Redshift: 0.1508, Systemstep: 0.00073494, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1930). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79252 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09534|1.04768 DOMAIN: combining multiple-domains took 0.286768 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.64788 sec) DOMAIN: domain decomposition done. (took in total 6.11809 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20568 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.95 MB) GRAVTREE: Tree construction done. took 17.486 sec =990858 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.81 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.416 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1931, Time: 0.869697, Redshift: 0.149826, Systemstep: 0.000735562, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1931). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78516 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09535|1.04768 DOMAIN: combining multiple-domains took 0.286824 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.48379 sec) DOMAIN: domain decomposition done. (took in total 5.94906 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24632 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.95 MB) GRAVTREE: Tree construction done. took 17.4692 sec =990874 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.82 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.553 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1932, Time: 0.870433, Redshift: 0.148854, Systemstep: 0.000736185, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1932). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78558 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09538|1.04768 DOMAIN: combining multiple-domains took 0.286696 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.39034 sec) DOMAIN: domain decomposition done. (took in total 4.85447 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29196 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.95 MB) GRAVTREE: Tree construction done. took 17.4706 sec =990900 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.82 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.50006 sec PM-PERIODIC: done. (took 13.8404 seconds) TIMESTEPS: displacement time constraint: 0.00643958 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28954 sec PM-PERIODIC: done. (took 13.624 seconds) TIMESTEPS: displacement time constraint: 0.00643959 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1933, Time: 0.87117, Redshift: 0.147882, Systemstep: 0.000736808, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1933). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.91391 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0954|1.04768 DOMAIN: combining multiple-domains took 0.288262 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.7973 sec) DOMAIN: domain decomposition done. (took in total 6.42343 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28613 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.96 MB) GRAVTREE: Tree construction done. took 17.4791 sec =990913 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.82 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.693 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1934, Time: 0.871907, Redshift: 0.146911, Systemstep: 0.000737432, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1934). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.82377 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09544|1.04768 DOMAIN: combining multiple-domains took 0.288438 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.39036 sec) DOMAIN: domain decomposition done. (took in total 4.89692 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23602 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.96 MB) GRAVTREE: Tree construction done. took 17.469 sec =990937 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995289 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.83 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.83 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1935, Time: 0.872645, Redshift: 0.145941, Systemstep: 0.000738056, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1935). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80082 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09547|1.04768 DOMAIN: combining multiple-domains took 0.288534 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.69889 sec) DOMAIN: domain decomposition done. (took in total 5.18071 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29371 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.96 MB) GRAVTREE: Tree construction done. took 17.4785 sec =990998 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.84 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 275.955 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1936, Time: 0.873384, Redshift: 0.144972, Systemstep: 0.000738681, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1936). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79332 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09551|1.04768 DOMAIN: combining multiple-domains took 0.28689 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.82803 sec) DOMAIN: domain decomposition done. (took in total 5.30031 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29009 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.97 MB) GRAVTREE: Tree construction done. took 17.4715 sec =991030 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.84 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.13 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26574 sec PM-PERIODIC: done. (took 13.5584 seconds) TIMESTEPS: displacement time constraint: 0.00646037 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.20668 sec PM-PERIODIC: done. (took 13.4634 seconds) TIMESTEPS: displacement time constraint: 0.00646037 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1937, Time: 0.874123, Redshift: 0.144004, Systemstep: 0.000739306, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1937). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79536 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09555|1.04768 DOMAIN: combining multiple-domains took 0.288569 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.32751 sec) DOMAIN: domain decomposition done. (took in total 6.80311 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24359 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.97 MB) GRAVTREE: Tree construction done. took 17.4808 sec =991075 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.85 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.154 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1938, Time: 0.874863, Redshift: 0.143036, Systemstep: 0.000739932, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1938). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78961 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09557|1.04768 DOMAIN: combining multiple-domains took 0.287203 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62322 sec) DOMAIN: domain decomposition done. (took in total 5.09201 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26586 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.4807 sec =991101 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.85 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.269 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1939, Time: 0.875603, Redshift: 0.142069, Systemstep: 0.000740558, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1939). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78915 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09561|1.04768 DOMAIN: combining multiple-domains took 0.287785 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.8364 sec) DOMAIN: domain decomposition done. (took in total 6.30594 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27833 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.5941 sec =991113 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.86 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.423 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1940, Time: 0.876345, Redshift: 0.141104, Systemstep: 0.000741185, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1940). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.09023 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09564|1.04768 DOMAIN: combining multiple-domains took 0.288087 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42382 sec) DOMAIN: domain decomposition done. (took in total 6.26297 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2087 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.98 MB) GRAVTREE: Tree construction done. took 17.4796 sec =991138 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.86 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.613 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28028 sec PM-PERIODIC: done. (took 13.5381 seconds) TIMESTEPS: displacement time constraint: 0.00644666 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27857 sec PM-PERIODIC: done. (took 14.0349 seconds) TIMESTEPS: displacement time constraint: 0.00644666 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1941, Time: 0.877086, Redshift: 0.140138, Systemstep: 0.000741813, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1941). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7841 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0957|1.04768 DOMAIN: combining multiple-domains took 0.287368 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.72272 sec) DOMAIN: domain decomposition done. (took in total 5.18634 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29005 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.4809 sec =991164 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99529 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.87 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.765 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1942, Time: 0.877829, Redshift: 0.139174, Systemstep: 0.000742441, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1942). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78251 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09573|1.04768 DOMAIN: combining multiple-domains took 0.287868 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.22409 sec) DOMAIN: domain decomposition done. (took in total 5.68675 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2252 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.99 MB) GRAVTREE: Tree construction done. took 17.4802 sec =991205 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.88 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.698 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1943, Time: 0.878572, Redshift: 0.138211, Systemstep: 0.000743069, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1943). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8106 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09577|1.04768 DOMAIN: combining multiple-domains took 0.417553 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.79216 sec) DOMAIN: domain decomposition done. (took in total 6.41279 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27654 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814 MB) GRAVTREE: Tree construction done. took 17.4812 sec =991253 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.88 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 276.348 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1944, Time: 0.879316, Redshift: 0.137248, Systemstep: 0.000743698, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1944). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78038 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09579|1.04768 DOMAIN: combining multiple-domains took 0.287005 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.50182 sec) DOMAIN: domain decomposition done. (took in total 4.96114 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24891 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814 MB) GRAVTREE: Tree construction done. took 17.4749 sec =991281 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.89 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 276.393 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27185 sec PM-PERIODIC: done. (took 13.39 seconds) TIMESTEPS: displacement time constraint: 0.006454 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.48078 sec PM-PERIODIC: done. (took 13.7437 seconds) TIMESTEPS: displacement time constraint: 0.00645399 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 213.756 sec, total size 352287 MB, corresponds to effective I/O rate of 1648.08 MB/sec Sync-Point 1945, Time: 0.88006, Redshift: 0.136286, Systemstep: 0.000744328, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1945). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77693 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0962|1.04768 DOMAIN: combining multiple-domains took 0.287308 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.71789 sec) DOMAIN: domain decomposition done. (took in total 6.17373 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.10146 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.05 MB) GRAVTREE: Tree construction done. took 17.6773 sec =991287 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.95 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.438 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1946, Time: 0.880805, Redshift: 0.135325, Systemstep: 0.000744958, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1946). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.89328 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0963|1.04768 DOMAIN: combining multiple-domains took 0.396345 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.52094 sec) DOMAIN: domain decomposition done. (took in total 6.2048 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27193 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.06 MB) GRAVTREE: Tree construction done. took 17.5725 sec =991316 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.97 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.613 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1947, Time: 0.881551, Redshift: 0.134365, Systemstep: 0.000745588, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1947). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79428 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09641|1.04768 DOMAIN: combining multiple-domains took 0.288088 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.40837 sec) DOMAIN: domain decomposition done. (took in total 4.88415 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28956 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.07 MB) GRAVTREE: Tree construction done. took 17.5362 sec =991341 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.99 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.277 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1948, Time: 0.882297, Redshift: 0.133405, Systemstep: 0.000746219, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1948). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79024 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09651|1.04768 DOMAIN: combining multiple-domains took 0.290086 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.68779 sec) DOMAIN: domain decomposition done. (took in total 5.16145 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23504 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.09 MB) GRAVTREE: Tree construction done. took 17.5193 sec =991394 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995291 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.01 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.879 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30333 sec PM-PERIODIC: done. (took 14.1081 seconds) TIMESTEPS: displacement time constraint: 0.00646406 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25549 sec PM-PERIODIC: done. (took 13.5535 seconds) TIMESTEPS: displacement time constraint: 0.00646406 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1949, Time: 0.883044, Redshift: 0.132447, Systemstep: 0.000746851, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1949). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78665 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09662|1.04768 DOMAIN: combining multiple-domains took 0.287946 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.33266 sec) DOMAIN: domain decomposition done. (took in total 5.80005 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2689 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.1 MB) GRAVTREE: Tree construction done. took 17.5018 sec =991431 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995292 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.02 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.923 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1950, Time: 0.883791, Redshift: 0.131489, Systemstep: 0.000747483, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1950). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79239 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09672|1.04768 DOMAIN: combining multiple-domains took 0.288709 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98773 sec) DOMAIN: domain decomposition done. (took in total 5.46151 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29362 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.4956 sec =991468 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995292 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.04 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.988 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1951, Time: 0.884539, Redshift: 0.130532, Systemstep: 0.000748116, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1951). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78412 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09684|1.04768 DOMAIN: combining multiple-domains took 0.287501 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.76976 sec) DOMAIN: domain decomposition done. (took in total 6.23435 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26263 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.12 MB) GRAVTREE: Tree construction done. took 17.5042 sec =991489 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995292 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.06 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.069 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1952, Time: 0.885288, Redshift: 0.129576, Systemstep: 0.000748749, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1952). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80313 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09695|1.04768 DOMAIN: combining multiple-domains took 0.28688 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.10938 sec) DOMAIN: domain decomposition done. (took in total 5.59186 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20937 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.14 MB) GRAVTREE: Tree construction done. took 17.5033 sec =991513 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995292 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.08 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.357 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24817 sec PM-PERIODIC: done. (took 13.623 seconds) TIMESTEPS: displacement time constraint: 0.00647186 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28143 sec PM-PERIODIC: done. (took 13.6146 seconds) TIMESTEPS: displacement time constraint: 0.00647186 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1953, Time: 0.886037, Redshift: 0.128621, Systemstep: 0.000749383, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1953). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78223 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09705|1.04768 DOMAIN: combining multiple-domains took 0.289336 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.14129 sec) DOMAIN: domain decomposition done. (took in total 4.60736 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27213 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.15 MB) GRAVTREE: Tree construction done. took 17.5768 sec =991552 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995292 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.09 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.335 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1954, Time: 0.886787, Redshift: 0.127666, Systemstep: 0.000750017, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1954). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78478 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09716|1.04768 DOMAIN: combining multiple-domains took 0.287801 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.40979 sec) DOMAIN: domain decomposition done. (took in total 4.87493 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28162 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.16 MB) GRAVTREE: Tree construction done. took 17.5006 sec =991594 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995292 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.11 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.478 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1955, Time: 0.887538, Redshift: 0.126712, Systemstep: 0.000750652, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1955). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7853 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09726|1.04768 DOMAIN: combining multiple-domains took 0.286754 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12441 sec) DOMAIN: domain decomposition done. (took in total 5.5891 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30057 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.17 MB) GRAVTREE: Tree construction done. took 17.568 sec =991635 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995293 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.13 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.578 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1956, Time: 0.888289, Redshift: 0.125759, Systemstep: 0.000751288, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1956). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79276 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09734|1.04768 DOMAIN: combining multiple-domains took 0.28805 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.47434 sec) DOMAIN: domain decomposition done. (took in total 5.94907 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20436 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.18 MB) GRAVTREE: Tree construction done. took 17.6587 sec =991670 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995293 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.14 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 277.682 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25913 sec PM-PERIODIC: done. (took 13.7797 seconds) TIMESTEPS: displacement time constraint: 0.00648592 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23404 sec PM-PERIODIC: done. (took 14.067 seconds) TIMESTEPS: displacement time constraint: 0.00648592 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1957, Time: 0.889041, Redshift: 0.124807, Systemstep: 0.000751924, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1957). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85305 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09743|1.04768 DOMAIN: combining multiple-domains took 0.289546 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.12102 sec) DOMAIN: domain decomposition done. (took in total 5.66444 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27314 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.19 MB) GRAVTREE: Tree construction done. took 17.6779 sec =991725 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995293 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.16 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 277.718 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1958, Time: 0.889794, Redshift: 0.123856, Systemstep: 0.00075256, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1958). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80256 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0922|1.01699 DOMAIN: combining multiple-domains took 0.290595 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.9699 sec) DOMAIN: domain decomposition done. (took in total 15.4572 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.43199 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.58 MB) GRAVTREE: Tree construction done. took 17.4923 sec =991751 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995293 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.3 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.853 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1959, Time: 0.890547, Redshift: 0.122905, Systemstep: 0.000753197, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1959). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7888 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09217|1.01699 DOMAIN: combining multiple-domains took 0.288696 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20445 sec) DOMAIN: domain decomposition done. (took in total 5.67227 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20363 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.58 MB) GRAVTREE: Tree construction done. took 17.4267 sec =991769 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995293 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.3 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.087 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1960, Time: 0.891301, Redshift: 0.121956, Systemstep: 0.000753835, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1960). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78893 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09214|1.01699 DOMAIN: combining multiple-domains took 0.287153 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.4054 sec) DOMAIN: domain decomposition done. (took in total 5.87186 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27168 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.4304 sec =991797 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995293 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 267.06 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30045 sec PM-PERIODIC: done. (took 13.673 seconds) TIMESTEPS: displacement time constraint: 0.00651948 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33723 sec PM-PERIODIC: done. (took 13.9119 seconds) TIMESTEPS: displacement time constraint: 0.00651948 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1961, Time: 0.892055, Redshift: 0.121007, Systemstep: 0.000754473, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1961). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79621 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09211|1.01699 DOMAIN: combining multiple-domains took 0.286143 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19064 sec) DOMAIN: domain decomposition done. (took in total 5.66349 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24154 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.4429 sec =991834 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 267.079 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1962, Time: 0.89281, Redshift: 0.120059, Systemstep: 0.000755111, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1962). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77988 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09209|1.01699 DOMAIN: combining multiple-domains took 0.286693 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.17421 sec) DOMAIN: domain decomposition done. (took in total 5.63058 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23436 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.4333 sec =991863 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.28 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.912 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1963, Time: 0.893566, Redshift: 0.119111, Systemstep: 0.000755751, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1963). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78006 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09205|1.01699 DOMAIN: combining multiple-domains took 0.286462 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.40611 sec) DOMAIN: domain decomposition done. (took in total 5.8634 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22388 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.56 MB) GRAVTREE: Tree construction done. took 17.4321 sec =991885 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.28 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 272.421 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1964, Time: 0.894323, Redshift: 0.118165, Systemstep: 0.00075639, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1964). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78365 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09203|1.01699 DOMAIN: combining multiple-domains took 0.28664 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12544 sec) DOMAIN: domain decomposition done. (took in total 4.58623 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27509 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.56 MB) GRAVTREE: Tree construction done. took 17.4431 sec =991920 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.27 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 270.773 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33066 sec PM-PERIODIC: done. (took 13.7241 seconds) TIMESTEPS: displacement time constraint: 0.00654068 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.57462 sec PM-PERIODIC: done. (took 13.9148 seconds) TIMESTEPS: displacement time constraint: 0.00654068 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1965, Time: 0.89508, Redshift: 0.117219, Systemstep: 0.000757031, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1965). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77646 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.092|1.01699 DOMAIN: combining multiple-domains took 0.28614 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11383 sec) DOMAIN: domain decomposition done. (took in total 4.56682 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28577 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.56 MB) GRAVTREE: Tree construction done. took 17.4452 sec =991934 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.27 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.685 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1966, Time: 0.895837, Redshift: 0.116274, Systemstep: 0.000757671, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1966). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78683 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09196|1.01699 DOMAIN: combining multiple-domains took 0.287689 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.10271 sec) DOMAIN: domain decomposition done. (took in total 5.56862 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27201 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.4388 sec =991954 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 271.045 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1967, Time: 0.896596, Redshift: 0.11533, Systemstep: 0.000758313, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1967). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7923 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09194|1.01699 DOMAIN: combining multiple-domains took 0.287334 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.48608 sec) DOMAIN: domain decomposition done. (took in total 4.9561 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28389 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.5962 sec =991956 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 192.009 sec, total size 352287 MB, corresponds to effective I/O rate of 1834.74 MB/sec Sync-Point 1968, Time: 0.897355, Redshift: 0.114387, Systemstep: 0.000758955, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1968). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79547 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09194|1.01699 DOMAIN: combining multiple-domains took 0.286407 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.46934 sec) DOMAIN: domain decomposition done. (took in total 4.94253 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22332 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.4401 sec =991999 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.868 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31421 sec PM-PERIODIC: done. (took 13.692 seconds) TIMESTEPS: displacement time constraint: 0.00656141 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29575 sec PM-PERIODIC: done. (took 14.074 seconds) TIMESTEPS: displacement time constraint: 0.00656141 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1969, Time: 0.898114, Redshift: 0.113444, Systemstep: 0.000759597, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1969). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79115 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09192|1.01699 DOMAIN: combining multiple-domains took 0.28743 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.97608 sec) DOMAIN: domain decomposition done. (took in total 6.4451 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27935 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.4735 sec =992015 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995294 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 270.826 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1970, Time: 0.898874, Redshift: 0.112503, Systemstep: 0.00076024, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1970). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78878 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09727|1.01699 DOMAIN: combining multiple-domains took 0.288404 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.41325 sec) DOMAIN: domain decomposition done. (took in total 5.88139 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.55635 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.18 MB) GRAVTREE: Tree construction done. took 17.5606 sec =992066 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995295 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.13 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.715 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1971, Time: 0.899635, Redshift: 0.111562, Systemstep: 0.000760884, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1971). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80399 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09726|1.01699 DOMAIN: combining multiple-domains took 0.288833 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.53201 sec) DOMAIN: domain decomposition done. (took in total 6.01618 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.15558 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.18 MB) GRAVTREE: Tree construction done. took 17.5342 sec =992089 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995295 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.13 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.214 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1972, Time: 0.900397, Redshift: 0.110621, Systemstep: 0.000761528, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1972). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80683 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09726|1.01699 DOMAIN: combining multiple-domains took 0.290018 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.25694 sec) DOMAIN: domain decomposition done. (took in total 5.7454 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22211 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.17 MB) GRAVTREE: Tree construction done. took 17.539 sec =992129 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995295 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.13 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 272.796 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29662 sec PM-PERIODIC: done. (took 14.0193 seconds) TIMESTEPS: displacement time constraint: 0.00660572 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26057 sec PM-PERIODIC: done. (took 13.7715 seconds) TIMESTEPS: displacement time constraint: 0.00660572 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1973, Time: 0.901159, Redshift: 0.109682, Systemstep: 0.000762172, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1973). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.84452 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09671|1.04768 DOMAIN: combining multiple-domains took 0.393101 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.9317 sec) DOMAIN: domain decomposition done. (took in total 16.5614 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32764 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.5949 sec =992144 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995295 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.04 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 279.344 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1974, Time: 0.901922, Redshift: 0.108744, Systemstep: 0.000762818, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1974). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7978 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09674|1.04768 DOMAIN: combining multiple-domains took 0.288836 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.69678 sec) DOMAIN: domain decomposition done. (took in total 5.17728 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21555 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.7036 sec =992181 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995295 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.04 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 279.433 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1975, Time: 0.902685, Redshift: 0.107806, Systemstep: 0.000763463, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1975). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80292 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09675|1.04768 DOMAIN: combining multiple-domains took 0.289774 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.97674 sec) DOMAIN: domain decomposition done. (took in total 6.46379 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21957 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.11 MB) GRAVTREE: Tree construction done. took 17.6289 sec =992234 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995295 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.04 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 279.595 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1976, Time: 0.903449, Redshift: 0.106869, Systemstep: 0.00076411, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1976). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78858 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09678|1.04768 DOMAIN: combining multiple-domains took 0.28721 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15685 sec) DOMAIN: domain decomposition done. (took in total 5.62612 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2669 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.12 MB) GRAVTREE: Tree construction done. took 17.5592 sec =992256 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.05 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 279.691 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23296 sec PM-PERIODIC: done. (took 13.7955 seconds) TIMESTEPS: displacement time constraint: 0.00663785 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23584 sec PM-PERIODIC: done. (took 13.5408 seconds) TIMESTEPS: displacement time constraint: 0.00663785 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1977, Time: 0.904214, Redshift: 0.105933, Systemstep: 0.000764756, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1977). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86954 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09678|1.04768 DOMAIN: combining multiple-domains took 0.414061 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.56267 sec) DOMAIN: domain decomposition done. (took in total 6.23998 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21365 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.12 MB) GRAVTREE: Tree construction done. took 17.5385 sec =992285 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.05 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 279.701 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1978, Time: 0.90498, Redshift: 0.104997, Systemstep: 0.000765404, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1978). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78908 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.09679|1.04768 DOMAIN: combining multiple-domains took 0.289687 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.60408 sec) DOMAIN: domain decomposition done. (took in total 5.07678 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2678 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.12 MB) GRAVTREE: Tree construction done. took 17.5337 sec =992317 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.05 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 279.887 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1979, Time: 0.905746, Redshift: 0.104063, Systemstep: 0.000766052, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1979). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78793 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=59 for nextra=0, reaching maximum imbalance of 1.0968|1.04768 DOMAIN: combining multiple-domains took 0.288835 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.67722 sec) DOMAIN: domain decomposition done. (took in total 5.14754 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24948 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.12 MB) GRAVTREE: Tree construction done. took 17.5214 sec =992325 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.05 MB) GRAVTREE: tree-forces are calculated, with 31 cycles took 279.944 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1980, Time: 0.906512, Redshift: 0.103129, Systemstep: 0.0007667, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1980). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80454 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10681|1.01559 DOMAIN: combining multiple-domains took 0.290024 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.2887 sec) DOMAIN: domain decomposition done. (took in total 15.7782 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.37334 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.3 MB) GRAVTREE: Tree construction done. took 17.6769 sec =992352 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.69 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 276.478 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28827 sec PM-PERIODIC: done. (took 13.9998 seconds) TIMESTEPS: displacement time constraint: 0.00668825 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3123 sec PM-PERIODIC: done. (took 13.6726 seconds) TIMESTEPS: displacement time constraint: 0.00668825 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1981, Time: 0.90728, Redshift: 0.102196, Systemstep: 0.000767349, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1981). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79164 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10681|1.01559 DOMAIN: combining multiple-domains took 0.291674 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.74113 sec) DOMAIN: domain decomposition done. (took in total 6.21974 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26019 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.3 MB) GRAVTREE: Tree construction done. took 17.6622 sec =992373 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.787 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1982, Time: 0.908048, Redshift: 0.101264, Systemstep: 0.000767999, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1982). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79863 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10681|1.01559 DOMAIN: combining multiple-domains took 0.290569 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.62935 sec) DOMAIN: domain decomposition done. (took in total 6.11416 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27792 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.3 MB) GRAVTREE: Tree construction done. took 17.6642 sec =992417 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995296 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.896 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1983, Time: 0.908816, Redshift: 0.100332, Systemstep: 0.000768649, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1983). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79723 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10679|1.01559 DOMAIN: combining multiple-domains took 0.290761 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.12966 sec) DOMAIN: domain decomposition done. (took in total 6.61318 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30515 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.3 MB) GRAVTREE: Tree construction done. took 17.669 sec =992460 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.69 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1984, Time: 0.909586, Redshift: 0.0994018, Systemstep: 0.000769299, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1984). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79295 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10678|1.01559 DOMAIN: combining multiple-domains took 0.289085 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.87402 sec) DOMAIN: domain decomposition done. (took in total 5.35057 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27248 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.3 MB) GRAVTREE: Tree construction done. took 17.6787 sec =992504 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.949 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3647 sec PM-PERIODIC: done. (took 13.831 seconds) TIMESTEPS: displacement time constraint: 0.00671734 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29257 sec PM-PERIODIC: done. (took 13.6558 seconds) TIMESTEPS: displacement time constraint: 0.00671734 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1985, Time: 0.910356, Redshift: 0.098472, Systemstep: 0.000769951, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1985). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80204 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10679|1.01559 DOMAIN: combining multiple-domains took 0.29146 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15764 sec) DOMAIN: domain decomposition done. (took in total 5.64647 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28603 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.3 MB) GRAVTREE: Tree construction done. took 17.6762 sec =992509 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.762 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1986, Time: 0.911126, Redshift: 0.0975429, Systemstep: 0.000770602, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1986). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7977 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10678|1.01559 DOMAIN: combining multiple-domains took 0.290234 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1877 sec) DOMAIN: domain decomposition done. (took in total 5.67115 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29305 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.29 MB) GRAVTREE: Tree construction done. took 17.6581 sec =992519 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.436 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1987, Time: 0.911897, Redshift: 0.0966146, Systemstep: 0.000771255, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1987). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80325 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10676|1.01559 DOMAIN: combining multiple-domains took 0.293225 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.45476 sec) DOMAIN: domain decomposition done. (took in total 6.94654 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20034 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.29 MB) GRAVTREE: Tree construction done. took 17.6604 sec =992553 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.68 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.964 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1988, Time: 0.912669, Redshift: 0.0956872, Systemstep: 0.000771907, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1988). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79681 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10674|1.01559 DOMAIN: combining multiple-domains took 0.289308 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.27906 sec) DOMAIN: domain decomposition done. (took in total 4.76088 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25932 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.29 MB) GRAVTREE: Tree construction done. took 17.7216 sec =992578 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.108 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35322 sec PM-PERIODIC: done. (took 13.6068 seconds) TIMESTEPS: displacement time constraint: 0.0067171 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33633 sec PM-PERIODIC: done. (took 14.052 seconds) TIMESTEPS: displacement time constraint: 0.00671709 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1989, Time: 0.913442, Redshift: 0.0947605, Systemstep: 0.000772561, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1989). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80125 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10672|1.01559 DOMAIN: combining multiple-domains took 0.290234 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.25779 sec) DOMAIN: domain decomposition done. (took in total 4.74406 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26673 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.29 MB) GRAVTREE: Tree construction done. took 17.6434 sec =992613 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.67 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 277.047 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1990, Time: 0.914215, Redshift: 0.0938345, Systemstep: 0.000773215, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1990). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78994 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.1067|1.01559 DOMAIN: combining multiple-domains took 0.292066 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42046 sec) DOMAIN: domain decomposition done. (took in total 5.89821 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.18193 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.29 MB) GRAVTREE: Tree construction done. took 17.6533 sec =992652 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995297 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.011 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 188.951 sec, total size 352287 MB, corresponds to effective I/O rate of 1864.43 MB/sec Sync-Point 1991, Time: 0.914989, Redshift: 0.0929094, Systemstep: 0.000773869, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1991). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80235 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10668|1.01559 DOMAIN: combining multiple-domains took 0.290644 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.19366 sec) DOMAIN: domain decomposition done. (took in total 6.68133 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24085 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.28 MB) GRAVTREE: Tree construction done. took 17.6334 sec =992680 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.66 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 279.141 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1992, Time: 0.915763, Redshift: 0.0919851, Systemstep: 0.000774524, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1992). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79173 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10666|1.01559 DOMAIN: combining multiple-domains took 0.292308 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79932 sec) DOMAIN: domain decomposition done. (took in total 5.27806 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20973 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.28 MB) GRAVTREE: Tree construction done. took 17.6403 sec =992711 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.66 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.348 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30735 sec PM-PERIODIC: done. (took 13.7885 seconds) TIMESTEPS: displacement time constraint: 0.00669992 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32273 sec PM-PERIODIC: done. (took 13.6469 seconds) TIMESTEPS: displacement time constraint: 0.00669991 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1993, Time: 0.916539, Redshift: 0.0910615, Systemstep: 0.00077518, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1993). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79985 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10666|1.01559 DOMAIN: combining multiple-domains took 0.292693 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.90434 sec) DOMAIN: domain decomposition done. (took in total 6.39144 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26763 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.28 MB) GRAVTREE: Tree construction done. took 17.6485 sec =992751 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.66 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.065 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1994, Time: 0.917314, Redshift: 0.0901387, Systemstep: 0.000775836, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1994). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79938 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10239|1.01559 DOMAIN: combining multiple-domains took 0.290487 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.90945 sec) DOMAIN: domain decomposition done. (took in total 5.39363 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26296 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.78 MB) GRAVTREE: Tree construction done. took 17.6202 sec =992771 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.96 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.659 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1995, Time: 0.918091, Redshift: 0.0892167, Systemstep: 0.000776493, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1995). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79726 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10245|1.01559 DOMAIN: combining multiple-domains took 0.289145 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.91473 sec) DOMAIN: domain decomposition done. (took in total 5.39471 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24365 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.79 MB) GRAVTREE: Tree construction done. took 17.6216 sec =992790 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.305 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1996, Time: 0.918868, Redshift: 0.0882955, Systemstep: 0.00077715, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1996). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78858 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10253|1.01559 DOMAIN: combining multiple-domains took 0.290389 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.95309 sec) DOMAIN: domain decomposition done. (took in total 5.42601 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2614 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.8 MB) GRAVTREE: Tree construction done. took 17.6651 sec =992829 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.99 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.711 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24761 sec PM-PERIODIC: done. (took 13.5297 seconds) TIMESTEPS: displacement time constraint: 0.00669642 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25843 sec PM-PERIODIC: done. (took 13.8454 seconds) TIMESTEPS: displacement time constraint: 0.00669642 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1997, Time: 0.919646, Redshift: 0.087375, Systemstep: 0.000777808, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1997). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79511 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10259|1.01559 DOMAIN: combining multiple-domains took 0.290644 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18668 sec) DOMAIN: domain decomposition done. (took in total 5.66596 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28437 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.8 MB) GRAVTREE: Tree construction done. took 17.6144 sec =992865 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995298 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.764 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1998, Time: 0.920424, Redshift: 0.0864554, Systemstep: 0.000778466, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1998). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79116 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10266|1.01559 DOMAIN: combining multiple-domains took 0.293531 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.38267 sec) DOMAIN: domain decomposition done. (took in total 5.86029 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.19734 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.81 MB) GRAVTREE: Tree construction done. took 17.6173 sec =992893 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995299 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.01 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.477 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 1999, Time: 0.921203, Redshift: 0.0855365, Systemstep: 0.000779125, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 1999). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80091 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10273|1.01559 DOMAIN: combining multiple-domains took 0.290407 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.4941 sec) DOMAIN: domain decomposition done. (took in total 5.97965 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25283 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.82 MB) GRAVTREE: Tree construction done. took 17.6728 sec =992929 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995299 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.02 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.803 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2000, Time: 0.921983, Redshift: 0.0846184, Systemstep: 0.000779785, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2000). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79714 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10282|1.01559 DOMAIN: combining multiple-domains took 0.289945 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.41103 sec) DOMAIN: domain decomposition done. (took in total 4.89235 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20026 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.83 MB) GRAVTREE: Tree construction done. took 17.617 sec =992961 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995299 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.775 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.24365 sec PM-PERIODIC: done. (took 13.9717 seconds) TIMESTEPS: displacement time constraint: 0.00668082 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25888 sec PM-PERIODIC: done. (took 13.5751 seconds) TIMESTEPS: displacement time constraint: 0.00668082 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2001, Time: 0.922764, Redshift: 0.083701, Systemstep: 0.000780445, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2001). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79005 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10289|1.01559 DOMAIN: combining multiple-domains took 0.289738 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.99473 sec) DOMAIN: domain decomposition done. (took in total 6.46819 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28535 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.84 MB) GRAVTREE: Tree construction done. took 17.6012 sec =992993 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995299 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.05 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.993 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2002, Time: 0.923545, Redshift: 0.0827845, Systemstep: 0.000781106, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2002). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79851 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.10297|1.01559 DOMAIN: combining multiple-domains took 0.290105 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.81238 sec) DOMAIN: domain decomposition done. (took in total 5.29543 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20175 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.85 MB) GRAVTREE: Tree construction done. took 17.7049 sec =993017 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995299 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1865.06 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 279.875 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2003, Time: 0.924327, Redshift: 0.0818687, Systemstep: 0.000781767, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2003). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79318 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10239|1.01418 DOMAIN: combining multiple-domains took 0.294062 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4135 sec) DOMAIN: domain decomposition done. (took in total 14.8979 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.17195 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.78 MB) GRAVTREE: Tree construction done. took 17.5927 sec =993059 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995299 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.96 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 281.097 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2004, Time: 0.925109, Redshift: 0.0809537, Systemstep: 0.000782429, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2004). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7915 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10237|1.01418 DOMAIN: combining multiple-domains took 0.291056 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60879 sec) DOMAIN: domain decomposition done. (took in total 6.08331 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31979 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.78 MB) GRAVTREE: Tree construction done. took 17.4831 sec =993092 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.96 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 271.734 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34139 sec PM-PERIODIC: done. (took 13.5495 seconds) TIMESTEPS: displacement time constraint: 0.00668385 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33969 sec PM-PERIODIC: done. (took 13.9412 seconds) TIMESTEPS: displacement time constraint: 0.00668385 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2005, Time: 0.925892, Redshift: 0.0800394, Systemstep: 0.000783091, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2005). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78599 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10234|1.01418 DOMAIN: combining multiple-domains took 0.288884 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.53727 sec) DOMAIN: domain decomposition done. (took in total 5.00574 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26803 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.77 MB) GRAVTREE: Tree construction done. took 17.5184 sec =993118 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.96 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 273.418 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2006, Time: 0.926676, Redshift: 0.079126, Systemstep: 0.000783754, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2006). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78274 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10233|1.01418 DOMAIN: combining multiple-domains took 0.29197 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.4234 sec) DOMAIN: domain decomposition done. (took in total 5.89065 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28226 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.77 MB) GRAVTREE: Tree construction done. took 17.547 sec =993140 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.96 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 272.377 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2007, Time: 0.92746, Redshift: 0.0782133, Systemstep: 0.000784417, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2007). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78275 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10231|1.01418 DOMAIN: combining multiple-domains took 0.290053 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.45294 sec) DOMAIN: domain decomposition done. (took in total 5.9183 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28944 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.77 MB) GRAVTREE: Tree construction done. took 17.5197 sec =993163 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.95 MB) GRAVTREE: tree-forces are calculated, with 26 cycles took 271.657 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2008, Time: 0.928245, Redshift: 0.0773014, Systemstep: 0.000785081, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2008). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78818 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10228|1.01418 DOMAIN: combining multiple-domains took 0.290966 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.1667 sec) DOMAIN: domain decomposition done. (took in total 5.63877 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27011 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.77 MB) GRAVTREE: Tree construction done. took 17.5216 sec =993167 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.95 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 271.648 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.56303 sec PM-PERIODIC: done. (took 13.7763 seconds) TIMESTEPS: displacement time constraint: 0.00668963 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25791 sec PM-PERIODIC: done. (took 13.5238 seconds) TIMESTEPS: displacement time constraint: 0.00668963 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2009, Time: 0.929031, Redshift: 0.0763902, Systemstep: 0.000785746, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2009). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.99107 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10227|1.01418 DOMAIN: combining multiple-domains took 0.28964 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.30663 sec) DOMAIN: domain decomposition done. (took in total 6.01309 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30821 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.76 MB) GRAVTREE: Tree construction done. took 17.5124 sec =993199 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.94 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 272.798 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2010, Time: 0.929818, Redshift: 0.0754798, Systemstep: 0.000786411, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2010). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78886 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10226|1.01418 DOMAIN: combining multiple-domains took 0.291771 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.40338 sec) DOMAIN: domain decomposition done. (took in total 5.87682 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32221 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.76 MB) GRAVTREE: Tree construction done. took 17.4899 sec =993221 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.94 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 272.805 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2011, Time: 0.930605, Redshift: 0.0745702, Systemstep: 0.000787077, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2011). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7835 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10124|1.01418 DOMAIN: combining multiple-domains took 0.289157 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.2555 sec) DOMAIN: domain decomposition done. (took in total 5.72 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29933 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.64 MB) GRAVTREE: Tree construction done. took 17.439 sec =993252 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.78 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 273.597 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2012, Time: 0.931392, Redshift: 0.0736614, Systemstep: 0.000787743, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2012). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78312 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10119|1.01418 DOMAIN: combining multiple-domains took 0.288245 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.36721 sec) DOMAIN: domain decomposition done. (took in total 5.8297 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20823 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.64 MB) GRAVTREE: Tree construction done. took 17.4362 sec =993296 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.9953 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.77 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 273.74 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.17646 sec PM-PERIODIC: done. (took 13.828 seconds) TIMESTEPS: displacement time constraint: 0.00669021 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.18629 sec PM-PERIODIC: done. (took 13.5102 seconds) TIMESTEPS: displacement time constraint: 0.00669021 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2013, Time: 0.932181, Redshift: 0.0727533, Systemstep: 0.00078841, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2013). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78359 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=2 for nextra=3, reaching maximum imbalance of 1.10112|1.01418 DOMAIN: combining multiple-domains took 0.289931 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.15496 sec) DOMAIN: domain decomposition done. (took in total 6.61932 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29596 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1814.63 MB) GRAVTREE: Tree construction done. took 17.4776 sec =993322 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1864.76 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 273.726 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 199.101 sec, total size 352287 MB, corresponds to effective I/O rate of 1769.39 MB/sec Sync-Point 2014, Time: 0.93297, Redshift: 0.071846, Systemstep: 0.000789077, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2014). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.85375 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=13 for nextra=8, reaching maximum imbalance of 1.09159|1.02124 DOMAIN: combining multiple-domains took 0.287397 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.4363 sec) DOMAIN: domain decomposition done. (took in total 15.9695 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40742 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 17.4833 sec =993333 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.2 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.166 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2015, Time: 0.93376, Redshift: 0.0709395, Systemstep: 0.000789745, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2015). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77479 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09001|1.01559 DOMAIN: combining multiple-domains took 0.288101 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.7158 sec) DOMAIN: domain decomposition done. (took in total 15.1696 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38238 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.32 MB) GRAVTREE: Tree construction done. took 17.5089 sec =993370 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.94 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 276.071 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2016, Time: 0.93455, Redshift: 0.0700337, Systemstep: 0.000790413, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2016). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09008|1.01559 DOMAIN: combining multiple-domains took 0.287146 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.13405 sec) DOMAIN: domain decomposition done. (took in total 4.59234 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29267 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.33 MB) GRAVTREE: Tree construction done. took 17.5073 sec =993408 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.96 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.329 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22365 sec PM-PERIODIC: done. (took 13.5455 seconds) TIMESTEPS: displacement time constraint: 0.00670907 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.21155 sec PM-PERIODIC: done. (took 13.6065 seconds) TIMESTEPS: displacement time constraint: 0.00670906 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2017, Time: 0.935341, Redshift: 0.0691287, Systemstep: 0.000791083, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2017). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77605 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09014|1.01559 DOMAIN: combining multiple-domains took 0.287888 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18647 sec) DOMAIN: domain decomposition done. (took in total 4.64122 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30638 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.34 MB) GRAVTREE: Tree construction done. took 17.5786 sec =993432 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.97 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.305 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2018, Time: 0.936133, Redshift: 0.0682245, Systemstep: 0.000791752, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2018). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77577 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09022|1.01559 DOMAIN: combining multiple-domains took 0.289275 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.06786 sec) DOMAIN: domain decomposition done. (took in total 5.52393 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28145 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.35 MB) GRAVTREE: Tree construction done. took 17.5096 sec =993466 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.98 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.426 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2019, Time: 0.936925, Redshift: 0.067321, Systemstep: 0.000792422, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2019). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77626 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0903|1.01559 DOMAIN: combining multiple-domains took 0.288875 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.06353 sec) DOMAIN: domain decomposition done. (took in total 4.52061 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31703 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.5174 sec =993501 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995301 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.99 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.579 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2020, Time: 0.937718, Redshift: 0.0664183, Systemstep: 0.000793093, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2020). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77729 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09035|1.01559 DOMAIN: combining multiple-domains took 0.289857 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.12842 sec) DOMAIN: domain decomposition done. (took in total 4.58664 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30264 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.36 MB) GRAVTREE: Tree construction done. took 17.6189 sec =993550 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.629 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3112 sec PM-PERIODIC: done. (took 13.6472 seconds) TIMESTEPS: displacement time constraint: 0.00670876 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.44875 sec PM-PERIODIC: done. (took 14.1785 seconds) TIMESTEPS: displacement time constraint: 0.00670875 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2021, Time: 0.938512, Redshift: 0.0655164, Systemstep: 0.000793765, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2021). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77308 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09041|1.01559 DOMAIN: combining multiple-domains took 0.288922 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20112 sec) DOMAIN: domain decomposition done. (took in total 5.65357 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30758 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.37 MB) GRAVTREE: Tree construction done. took 17.5003 sec =993568 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.01 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.658 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2022, Time: 0.939307, Redshift: 0.0646152, Systemstep: 0.000794436, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2022). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77256 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09048|1.01559 DOMAIN: combining multiple-domains took 0.287689 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.03924 sec) DOMAIN: domain decomposition done. (took in total 5.49035 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24944 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.38 MB) GRAVTREE: Tree construction done. took 17.4975 sec =993581 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.02 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.815 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2023, Time: 0.940102, Redshift: 0.0637148, Systemstep: 0.000795109, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2023). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77178 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09056|1.01559 DOMAIN: combining multiple-domains took 0.286336 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22033 sec) DOMAIN: domain decomposition done. (took in total 4.66973 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30718 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 17.5003 sec =993617 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.03 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.795 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2024, Time: 0.940897, Redshift: 0.0628151, Systemstep: 0.000795782, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2024). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.777 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09063|1.01559 DOMAIN: combining multiple-domains took 0.28749 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.32422 sec) DOMAIN: domain decomposition done. (took in total 5.78051 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30233 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.39 MB) GRAVTREE: Tree construction done. took 17.5177 sec =993636 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.05 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 277.852 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28516 sec PM-PERIODIC: done. (took 14.1705 seconds) TIMESTEPS: displacement time constraint: 0.00670961 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.29503 sec PM-PERIODIC: done. (took 13.7227 seconds) TIMESTEPS: displacement time constraint: 0.00670961 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2025, Time: 0.941694, Redshift: 0.0619162, Systemstep: 0.000796456, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2025). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77908 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0907|1.01559 DOMAIN: combining multiple-domains took 0.289226 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.0424 sec) DOMAIN: domain decomposition done. (took in total 4.50199 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.32374 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.4 MB) GRAVTREE: Tree construction done. took 17.5036 sec =993671 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.06 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.12 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2026, Time: 0.942491, Redshift: 0.0610181, Systemstep: 0.00079713, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2026). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77393 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09078|1.01559 DOMAIN: combining multiple-domains took 0.289176 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.83416 sec) DOMAIN: domain decomposition done. (took in total 5.28976 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29236 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.41 MB) GRAVTREE: Tree construction done. took 17.5192 sec =993696 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.07 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.022 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2027, Time: 0.943289, Redshift: 0.0601207, Systemstep: 0.000797805, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2027). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77001 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09085|1.01559 DOMAIN: combining multiple-domains took 0.290278 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.54981 sec) DOMAIN: domain decomposition done. (took in total 5.00177 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28812 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.42 MB) GRAVTREE: Tree construction done. took 17.4925 sec =993697 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995302 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.08 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.343 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2028, Time: 0.944087, Redshift: 0.0592241, Systemstep: 0.00079848, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2028). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77072 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09246|1.01559 DOMAIN: combining multiple-domains took 0.289931 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.07807 sec) DOMAIN: domain decomposition done. (took in total 5.52999 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.51471 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.61 MB) GRAVTREE: Tree construction done. took 17.5135 sec =993739 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.233 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.27634 sec PM-PERIODIC: done. (took 14.0789 seconds) TIMESTEPS: displacement time constraint: 0.00672419 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2929 sec PM-PERIODIC: done. (took 14.6019 seconds) TIMESTEPS: displacement time constraint: 0.00672419 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2029, Time: 0.944886, Redshift: 0.0583282, Systemstep: 0.000799156, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2029). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78185 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09242|1.01559 DOMAIN: combining multiple-domains took 0.28647 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07493 sec) DOMAIN: domain decomposition done. (took in total 4.53549 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.181 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.6 MB) GRAVTREE: Tree construction done. took 17.5142 sec =993762 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.528 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2030, Time: 0.945686, Redshift: 0.0574331, Systemstep: 0.000799832, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2030). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77997 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09106|1.01559 DOMAIN: combining multiple-domains took 0.288538 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.60689 sec) DOMAIN: domain decomposition done. (took in total 6.06768 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20477 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.44 MB) GRAVTREE: Tree construction done. took 17.5149 sec =993801 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.12 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.207 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2031, Time: 0.946487, Redshift: 0.0565388, Systemstep: 0.000800509, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2031). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77812 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09113|1.01559 DOMAIN: combining multiple-domains took 0.287603 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.18249 sec) DOMAIN: domain decomposition done. (took in total 5.63969 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22468 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.45 MB) GRAVTREE: Tree construction done. took 17.5134 sec =993835 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.13 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.336 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2032, Time: 0.947288, Redshift: 0.0556452, Systemstep: 0.000801187, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2032). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77333 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09119|1.01559 DOMAIN: combining multiple-domains took 0.287546 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.89128 sec) DOMAIN: domain decomposition done. (took in total 4.34333 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29825 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.46 MB) GRAVTREE: Tree construction done. took 17.5197 sec =993847 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.14 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.319 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35792 sec PM-PERIODIC: done. (took 14.0834 seconds) TIMESTEPS: displacement time constraint: 0.00672929 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.72694 sec PM-PERIODIC: done. (took 14.5006 seconds) TIMESTEPS: displacement time constraint: 0.00672929 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2033, Time: 0.94809, Redshift: 0.0547523, Systemstep: 0.000801865, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2033). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77108 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09127|1.01559 DOMAIN: combining multiple-domains took 0.287783 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.66487 sec) DOMAIN: domain decomposition done. (took in total 5.11546 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29192 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.47 MB) GRAVTREE: Tree construction done. took 17.5453 sec =993875 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.15 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 278.302 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2034, Time: 0.948892, Redshift: 0.0538603, Systemstep: 0.000802544, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2034). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7714 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09135|1.01559 DOMAIN: combining multiple-domains took 0.321498 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.02024 sec) DOMAIN: domain decomposition done. (took in total 6.50383 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2969 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.48 MB) GRAVTREE: Tree construction done. took 17.5252 sec =993904 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995303 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.16 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.004 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2035, Time: 0.949696, Redshift: 0.0529689, Systemstep: 0.000803223, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2035). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77139 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09141|1.01559 DOMAIN: combining multiple-domains took 0.288637 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.50823 sec) DOMAIN: domain decomposition done. (took in total 4.95907 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28843 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.49 MB) GRAVTREE: Tree construction done. took 17.5212 sec =993940 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.17 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.044 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2036, Time: 0.9505, Redshift: 0.0520784, Systemstep: 0.000803903, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2036). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77849 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09147|1.01559 DOMAIN: combining multiple-domains took 0.289844 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.64727 sec) DOMAIN: domain decomposition done. (took in total 6.10701 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29745 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.49 MB) GRAVTREE: Tree construction done. took 17.5296 sec =993960 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.18 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.243 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.2945 sec PM-PERIODIC: done. (took 14.7137 seconds) TIMESTEPS: displacement time constraint: 0.00672353 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28681 sec PM-PERIODIC: done. (took 14.3321 seconds) TIMESTEPS: displacement time constraint: 0.00672352 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 207.336 sec, total size 352287 MB, corresponds to effective I/O rate of 1699.11 MB/sec Sync-Point 2037, Time: 0.951304, Redshift: 0.0511886, Systemstep: 0.000804584, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2037). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77549 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09154|1.01559 DOMAIN: combining multiple-domains took 0.288811 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.19136 sec) DOMAIN: domain decomposition done. (took in total 4.64681 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25693 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.5 MB) GRAVTREE: Tree construction done. took 17.517 sec =993986 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.19 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.334 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2038, Time: 0.952109, Redshift: 0.0502995, Systemstep: 0.000805265, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2038). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78172 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09161|1.01559 DOMAIN: combining multiple-domains took 0.288371 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.07861 sec) DOMAIN: domain decomposition done. (took in total 4.53925 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29321 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.51 MB) GRAVTREE: Tree construction done. took 17.6185 sec =994009 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.21 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.56 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2039, Time: 0.952915, Redshift: 0.0494112, Systemstep: 0.000805946, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2039). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7885 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09168|1.01559 DOMAIN: combining multiple-domains took 0.286811 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.32011 sec) DOMAIN: domain decomposition done. (took in total 5.7864 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27438 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.52 MB) GRAVTREE: Tree construction done. took 17.5049 sec =994033 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.22 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.682 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2040, Time: 0.953722, Redshift: 0.0485236, Systemstep: 0.000806629, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2040). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.76877 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09176|1.01559 DOMAIN: combining multiple-domains took 0.288184 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.84301 sec) DOMAIN: domain decomposition done. (took in total 5.2907 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26849 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.5118 sec =994064 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.23 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.591 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30361 sec PM-PERIODIC: done. (took 14.1301 seconds) TIMESTEPS: displacement time constraint: 0.00672965 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30562 sec PM-PERIODIC: done. (took 14.1196 seconds) TIMESTEPS: displacement time constraint: 0.00672965 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2041, Time: 0.954529, Redshift: 0.0476368, Systemstep: 0.000807311, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2041). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77283 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09179|1.01559 DOMAIN: combining multiple-domains took 0.288116 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.09739 sec) DOMAIN: domain decomposition done. (took in total 5.54917 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24124 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.53 MB) GRAVTREE: Tree construction done. took 17.5202 sec =994116 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.24 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 277.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2042, Time: 0.955337, Redshift: 0.0467508, Systemstep: 0.000807995, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2042). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77134 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09185|1.01559 DOMAIN: combining multiple-domains took 0.288822 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.82438 sec) DOMAIN: domain decomposition done. (took in total 6.27522 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27662 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.54 MB) GRAVTREE: Tree construction done. took 17.5199 sec =994129 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995304 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.25 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.721 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2043, Time: 0.956146, Redshift: 0.0458655, Systemstep: 0.000808679, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2043). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77614 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09192|1.01559 DOMAIN: combining multiple-domains took 0.289212 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.83044 sec) DOMAIN: domain decomposition done. (took in total 5.28692 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29146 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.5999 sec =994146 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.26 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.895 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2044, Time: 0.956955, Redshift: 0.0449809, Systemstep: 0.000809363, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2044). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.88251 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09198|1.01559 DOMAIN: combining multiple-domains took 0.393132 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.19643 sec) DOMAIN: domain decomposition done. (took in total 5.86375 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22906 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.55 MB) GRAVTREE: Tree construction done. took 17.5272 sec =994185 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.27 MB) GRAVTREE: tree-forces are calculated, with 27 cycles took 274.587 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.3577 sec PM-PERIODIC: done. (took 14.0998 seconds) TIMESTEPS: displacement time constraint: 0.0067234 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.34618 sec PM-PERIODIC: done. (took 14.6751 seconds) TIMESTEPS: displacement time constraint: 0.00672339 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2045, Time: 0.957765, Redshift: 0.0440971, Systemstep: 0.000810048, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2045). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7754 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09206|1.01559 DOMAIN: combining multiple-domains took 0.285926 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.79752 sec) DOMAIN: domain decomposition done. (took in total 5.24935 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30584 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.56 MB) GRAVTREE: Tree construction done. took 17.5619 sec =994204 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.28 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.065 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2046, Time: 0.958576, Redshift: 0.043214, Systemstep: 0.000810734, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2046). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77809 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09214|1.01559 DOMAIN: combining multiple-domains took 0.287777 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.09412 sec) DOMAIN: domain decomposition done. (took in total 4.55164 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31034 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.57 MB) GRAVTREE: Tree construction done. took 17.5636 sec =994246 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.29 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.97 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2047, Time: 0.959387, Redshift: 0.0423317, Systemstep: 0.00081142, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2047). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78192 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09221|1.01559 DOMAIN: combining multiple-domains took 0.287554 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.62107 sec) DOMAIN: domain decomposition done. (took in total 5.08204 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27993 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.58 MB) GRAVTREE: Tree construction done. took 17.6976 sec =994256 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.3 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.084 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2048, Time: 0.9602, Redshift: 0.0414501, Systemstep: 0.000812107, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2048). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77819 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09227|1.01559 DOMAIN: combining multiple-domains took 0.288322 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.00348 sec) DOMAIN: domain decomposition done. (took in total 6.46435 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.3012 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.59 MB) GRAVTREE: Tree construction done. took 17.6076 sec =994286 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.31 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.777 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32774 sec PM-PERIODIC: done. (took 14.0798 seconds) TIMESTEPS: displacement time constraint: 0.0067321 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32418 sec PM-PERIODIC: done. (took 14.7139 seconds) TIMESTEPS: displacement time constraint: 0.0067321 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2049, Time: 0.961012, Redshift: 0.0405693, Systemstep: 0.000812795, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2049). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7874 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09233|1.01559 DOMAIN: combining multiple-domains took 0.289331 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.8402 sec) DOMAIN: domain decomposition done. (took in total 6.30921 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24924 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.59 MB) GRAVTREE: Tree construction done. took 17.5794 sec =994304 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.32 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.627 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2050, Time: 0.961826, Redshift: 0.0396892, Systemstep: 0.000813483, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2050). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78477 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09238|1.01559 DOMAIN: combining multiple-domains took 0.288592 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.11941 sec) DOMAIN: domain decomposition done. (took in total 4.5871 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30899 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.6 MB) GRAVTREE: Tree construction done. took 17.5891 sec =994323 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995305 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.33 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.58 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2051, Time: 0.96264, Redshift: 0.0388099, Systemstep: 0.000814171, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2051). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77932 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09245|1.01559 DOMAIN: combining multiple-domains took 0.289301 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.86389 sec) DOMAIN: domain decomposition done. (took in total 5.3252 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29922 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.61 MB) GRAVTREE: Tree construction done. took 17.5889 sec =994363 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.34 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.555 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2052, Time: 0.963455, Redshift: 0.0379313, Systemstep: 0.00081486, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2052). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78045 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09251|1.01559 DOMAIN: combining multiple-domains took 0.289621 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.5303 sec) DOMAIN: domain decomposition done. (took in total 4.99266 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25326 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.61 MB) GRAVTREE: Tree construction done. took 17.6967 sec =994393 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.35 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.643 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35289 sec PM-PERIODIC: done. (took 13.6816 seconds) TIMESTEPS: displacement time constraint: 0.00673297 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.35294 sec PM-PERIODIC: done. (took 14.0777 seconds) TIMESTEPS: displacement time constraint: 0.00673297 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2053, Time: 0.96427, Redshift: 0.0370534, Systemstep: 0.00081555, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2053). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78281 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09258|1.01559 DOMAIN: combining multiple-domains took 0.289539 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.60536 sec) DOMAIN: domain decomposition done. (took in total 5.07009 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33307 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.62 MB) GRAVTREE: Tree construction done. took 17.5676 sec =994441 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.36 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.755 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2054, Time: 0.965087, Redshift: 0.0361763, Systemstep: 0.00081624, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2054). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.76912 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09265|1.01559 DOMAIN: combining multiple-domains took 0.288264 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98493 sec) DOMAIN: domain decomposition done. (took in total 5.43413 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2926 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.63 MB) GRAVTREE: Tree construction done. took 17.6486 sec =994480 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.37 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.767 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2055, Time: 0.965904, Redshift: 0.0353, Systemstep: 0.000816931, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2055). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.97787 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09273|1.01559 DOMAIN: combining multiple-domains took 0.289567 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 4.30633 sec) DOMAIN: domain decomposition done. (took in total 7.04065 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23037 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.64 MB) GRAVTREE: Tree construction done. took 17.5647 sec =994498 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.39 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.368 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2056, Time: 0.966721, Redshift: 0.0344243, Systemstep: 0.000817623, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2056). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77922 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09137|1.01559 DOMAIN: combining multiple-domains took 0.290012 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.35709 sec) DOMAIN: domain decomposition done. (took in total 5.81841 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.21333 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.48 MB) GRAVTREE: Tree construction done. took 17.5415 sec =994516 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.17 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.758 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30309 sec PM-PERIODIC: done. (took 13.586 seconds) TIMESTEPS: displacement time constraint: 0.00674013 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.57665 sec PM-PERIODIC: done. (took 13.847 seconds) TIMESTEPS: displacement time constraint: 0.00674013 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2057, Time: 0.96754, Redshift: 0.0335495, Systemstep: 0.000818315, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2057). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78014 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.09139|1.01559 DOMAIN: combining multiple-domains took 0.287554 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.08886 sec) DOMAIN: domain decomposition done. (took in total 5.54747 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2363 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.48 MB) GRAVTREE: Tree construction done. took 17.5295 sec =994550 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995306 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.17 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.572 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2058, Time: 0.968359, Redshift: 0.0326753, Systemstep: 0.000819008, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2058). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77008 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08835|1.01559 DOMAIN: combining multiple-domains took 0.287298 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.98857 sec) DOMAIN: domain decomposition done. (took in total 5.43704 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25249 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.5088 sec =994612 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995307 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.682 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2059, Time: 0.969178, Redshift: 0.0318019, Systemstep: 0.000819701, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2059). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.08172 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08835|1.01559 DOMAIN: combining multiple-domains took 0.353743 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.24912 sec) DOMAIN: domain decomposition done. (took in total 6.07414 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24367 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.5054 sec =994628 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995307 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.516 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 229.035 sec, total size 352287 MB, corresponds to effective I/O rate of 1538.14 MB/sec Sync-Point 2060, Time: 0.969999, Redshift: 0.0309292, Systemstep: 0.000820395, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2060). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.76979 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08834|1.01559 DOMAIN: combining multiple-domains took 0.284148 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.73087 sec) DOMAIN: domain decomposition done. (took in total 5.17402 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.16464 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.12 MB) GRAVTREE: Tree construction done. took 17.4317 sec =994680 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995307 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.67 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.146 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31241 sec PM-PERIODIC: done. (took 13.6127 seconds) TIMESTEPS: displacement time constraint: 0.00674059 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30373 sec PM-PERIODIC: done. (took 13.6763 seconds) TIMESTEPS: displacement time constraint: 0.00674058 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2061, Time: 0.97082, Redshift: 0.0300573, Systemstep: 0.000821089, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2061). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77674 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08836|1.01559 DOMAIN: combining multiple-domains took 0.29011 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.91726 sec) DOMAIN: domain decomposition done. (took in total 5.37417 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25068 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.599 sec =994707 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995307 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.662 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2062, Time: 0.971642, Redshift: 0.0291861, Systemstep: 0.000821784, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2062). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77919 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08838|1.01559 DOMAIN: combining multiple-domains took 0.286923 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.67253 sec) DOMAIN: domain decomposition done. (took in total 5.12858 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23634 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.5049 sec =994757 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995307 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.807 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2063, Time: 0.972464, Redshift: 0.0283157, Systemstep: 0.00082248, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2063). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77147 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08838|1.01559 DOMAIN: combining multiple-domains took 0.285674 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.55298 sec) DOMAIN: domain decomposition done. (took in total 5.00067 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22972 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.5053 sec =994780 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.687 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2064, Time: 0.973287, Redshift: 0.0274459, Systemstep: 0.000823176, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2064). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77354 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.0884|1.01559 DOMAIN: combining multiple-domains took 0.287313 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.53195 sec) DOMAIN: domain decomposition done. (took in total 5.98275 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.2042 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.5166 sec =994784 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.848 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.4515 sec PM-PERIODIC: done. (took 13.8244 seconds) TIMESTEPS: displacement time constraint: 0.00675291 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32779 sec PM-PERIODIC: done. (took 13.724 seconds) TIMESTEPS: displacement time constraint: 0.00675292 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2065, Time: 0.974111, Redshift: 0.026577, Systemstep: 0.000823873, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2065). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77506 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08841|1.01559 DOMAIN: combining multiple-domains took 0.286832 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.15371 sec) DOMAIN: domain decomposition done. (took in total 5.60687 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.22991 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.6067 sec =994791 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 273.863 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2066, Time: 0.974936, Redshift: 0.0257087, Systemstep: 0.00082457, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2066). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77513 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08841|1.01559 DOMAIN: combining multiple-domains took 0.286552 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.41641 sec) DOMAIN: domain decomposition done. (took in total 4.86797 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27162 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.13 MB) GRAVTREE: Tree construction done. took 17.5122 sec =994807 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.68 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.797 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2067, Time: 0.975761, Redshift: 0.0248412, Systemstep: 0.000825268, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2067). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77701 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08843|1.01559 DOMAIN: combining multiple-domains took 0.285678 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.27846 sec) DOMAIN: domain decomposition done. (took in total 4.73159 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25706 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.4929 sec =994853 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.794 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2068, Time: 0.976587, Redshift: 0.0239744, Systemstep: 0.000825967, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2068). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78169 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08929|1.01559 DOMAIN: combining multiple-domains took 0.287292 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.89627 sec) DOMAIN: domain decomposition done. (took in total 6.35584 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.50376 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.24 MB) GRAVTREE: Tree construction done. took 17.6412 sec =994883 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.83 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.757 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31181 sec PM-PERIODIC: done. (took 13.996 seconds) TIMESTEPS: displacement time constraint: 0.00675688 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.32126 sec PM-PERIODIC: done. (took 13.714 seconds) TIMESTEPS: displacement time constraint: 0.00675687 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2069, Time: 0.977414, Redshift: 0.0231084, Systemstep: 0.000826666, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2069). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.08895 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08845|1.01559 DOMAIN: combining multiple-domains took 0.343553 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.78619 sec) DOMAIN: domain decomposition done. (took in total 6.60988 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27839 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.5315 sec =994906 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.095 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2070, Time: 0.978241, Redshift: 0.0222431, Systemstep: 0.000827366, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2070). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77453 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08847|1.01559 DOMAIN: combining multiple-domains took 0.287952 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.157 sec) DOMAIN: domain decomposition done. (took in total 4.61025 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27422 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.5307 sec =994943 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.69 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 276.177 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2071, Time: 0.979069, Redshift: 0.0213785, Systemstep: 0.000828066, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2071). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77558 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08848|1.01559 DOMAIN: combining multiple-domains took 0.287648 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.99352 sec) DOMAIN: domain decomposition done. (took in total 5.44773 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27769 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.5358 sec =994970 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995308 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.112 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2072, Time: 0.979898, Redshift: 0.0205146, Systemstep: 0.000828767, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2072). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.83241 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08849|1.01559 DOMAIN: combining multiple-domains took 0.289312 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.35132 sec) DOMAIN: domain decomposition done. (took in total 4.86432 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26333 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.629 sec =994992 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.373 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.39552 sec PM-PERIODIC: done. (took 14.1894 seconds) TIMESTEPS: displacement time constraint: 0.00675356 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36669 sec PM-PERIODIC: done. (took 13.9396 seconds) TIMESTEPS: displacement time constraint: 0.00675356 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2073, Time: 0.980727, Redshift: 0.0196515, Systemstep: 0.000829469, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2073). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.08405 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08851|1.01559 DOMAIN: combining multiple-domains took 0.288424 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.20886 sec) DOMAIN: domain decomposition done. (took in total 5.97231 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.23381 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.14 MB) GRAVTREE: Tree construction done. took 17.5314 sec =995038 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 274.089 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2074, Time: 0.981557, Redshift: 0.0187891, Systemstep: 0.000830171, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2074). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77989 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=3 for nextra=4, reaching maximum imbalance of 1.08851|1.01559 DOMAIN: combining multiple-domains took 0.288579 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.65519 sec) DOMAIN: domain decomposition done. (took in total 5.11465 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.24806 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.15 MB) GRAVTREE: Tree construction done. took 17.5331 sec =995044 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.7 MB) GRAVTREE: tree-forces are calculated, with 28 cycles took 275.011 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2075, Time: 0.982388, Redshift: 0.0179275, Systemstep: 0.000830874, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2075). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.78129 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09102|1.01699 DOMAIN: combining multiple-domains took 0.289667 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 11.9198 sec) DOMAIN: domain decomposition done. (took in total 14.3815 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.98027 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.44 MB) GRAVTREE: Tree construction done. took 17.5914 sec =995083 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.11 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.312 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2076, Time: 0.98322, Redshift: 0.0170665, Systemstep: 0.000831577, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2076). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7932 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09314|1.01699 DOMAIN: combining multiple-domains took 0.287348 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.4341 sec) DOMAIN: domain decomposition done. (took in total 5.90763 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.55553 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.7121 sec =995118 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.853 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.23923 sec PM-PERIODIC: done. (took 13.7413 seconds) TIMESTEPS: displacement time constraint: 0.00673986 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.28236 sec PM-PERIODIC: done. (took 14.203 seconds) TIMESTEPS: displacement time constraint: 0.00673986 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2077, Time: 0.984052, Redshift: 0.0162063, Systemstep: 0.000832281, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2077). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79667 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09314|1.01699 DOMAIN: combining multiple-domains took 0.287716 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.54634 sec) DOMAIN: domain decomposition done. (took in total 6.02346 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28271 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.6155 sec =995147 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.46 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 275.644 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2078, Time: 0.984885, Redshift: 0.0153469, Systemstep: 0.000832985, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2078). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79693 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09312|1.01699 DOMAIN: combining multiple-domains took 0.287327 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.65277 sec) DOMAIN: domain decomposition done. (took in total 6.12997 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.20497 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.69 MB) GRAVTREE: Tree construction done. took 17.6878 sec =995177 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.236 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2079, Time: 0.985719, Redshift: 0.0144881, Systemstep: 0.00083369, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2079). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.7946 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.0931|1.01699 DOMAIN: combining multiple-domains took 0.287166 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 1.93324 sec) DOMAIN: domain decomposition done. (took in total 4.40841 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27329 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6207 sec =995200 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995309 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.203 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2080, Time: 0.986553, Redshift: 0.0136301, Systemstep: 0.000834396, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2080). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80564 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09309|1.01699 DOMAIN: combining multiple-domains took 0.288371 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44428 sec) DOMAIN: domain decomposition done. (took in total 5.93209 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.28851 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6297 sec =995236 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.36 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26594 sec PM-PERIODIC: done. (took 14.1873 seconds) TIMESTEPS: displacement time constraint: 0.00675413 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.22377 sec PM-PERIODIC: done. (took 13.627 seconds) TIMESTEPS: displacement time constraint: 0.00675413 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2081, Time: 0.987388, Redshift: 0.0127728, Systemstep: 0.000835102, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2081). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79388 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09309|1.01699 DOMAIN: combining multiple-domains took 0.289785 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.44014 sec) DOMAIN: domain decomposition done. (took in total 5.91642 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29618 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6102 sec =995243 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.534 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2082, Time: 0.988224, Redshift: 0.0119162, Systemstep: 0.000835809, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2082). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79836 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09309|1.01699 DOMAIN: combining multiple-domains took 0.287749 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.29983 sec) DOMAIN: domain decomposition done. (took in total 4.7791 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27171 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6598 sec =995254 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.45 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.259 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 198.117 sec, total size 352287 MB, corresponds to effective I/O rate of 1778.17 MB/sec Sync-Point 2083, Time: 0.989061, Redshift: 0.0110604, Systemstep: 0.000836517, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2083). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79506 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09307|1.01699 DOMAIN: combining multiple-domains took 0.28862 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.67934 sec) DOMAIN: domain decomposition done. (took in total 5.15534 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.26973 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6822 sec =995277 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 278.704 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2084, Time: 0.989898, Redshift: 0.0102052, Systemstep: 0.000837225, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2084). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80151 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09306|1.01699 DOMAIN: combining multiple-domains took 0.288171 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.91443 sec) DOMAIN: domain decomposition done. (took in total 5.39687 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.25204 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6189 sec =995320 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 278.977 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.26089 sec PM-PERIODIC: done. (took 14.1959 seconds) TIMESTEPS: displacement time constraint: 0.00673442 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.25127 sec PM-PERIODIC: done. (took 13.7157 seconds) TIMESTEPS: displacement time constraint: 0.00673442 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2085, Time: 0.990736, Redshift: 0.00935084, Systemstep: 0.000837934, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2085). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79692 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09305|1.01699 DOMAIN: combining multiple-domains took 0.28762 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.01626 sec) DOMAIN: domain decomposition done. (took in total 5.49358 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.29076 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6201 sec =995343 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 278.692 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2086, Time: 0.991574, Redshift: 0.00849717, Systemstep: 0.000838643, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2086). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.79121 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=6 for nextra=5, reaching maximum imbalance of 1.09303|1.01699 DOMAIN: combining multiple-domains took 0.289501 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.88693 sec) DOMAIN: domain decomposition done. (took in total 6.36216 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.27126 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.68 MB) GRAVTREE: Tree construction done. took 17.6182 sec =995388 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.99531 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1863.44 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 278.629 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2087, Time: 0.992414, Redshift: 0.00764421, Systemstep: 0.000839353, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2087). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80016 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11023|1.02408 DOMAIN: combining multiple-domains took 0.287301 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 12.4673 sec) DOMAIN: domain decomposition done. (took in total 14.948 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 1.97287 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.7 MB) GRAVTREE: Tree construction done. took 17.8029 sec =995416 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.24 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 281.746 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2088, Time: 0.993254, Redshift: 0.00679198, Systemstep: 0.000840063, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2088). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80951 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11029|1.02408 DOMAIN: combining multiple-domains took 0.291895 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.26672 sec) DOMAIN: domain decomposition done. (took in total 5.76561 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.30066 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.71 MB) GRAVTREE: Tree construction done. took 17.8088 sec =995442 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.25 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 281.921 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36878 sec PM-PERIODIC: done. (took 14.4594 seconds) TIMESTEPS: displacement time constraint: 0.00673209 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.36506 sec PM-PERIODIC: done. (took 14.0345 seconds) TIMESTEPS: displacement time constraint: 0.00673209 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2089, Time: 0.994095, Redshift: 0.00594046, Systemstep: 0.000840774, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2089). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.87249 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11036|1.02408 DOMAIN: combining multiple-domains took 0.415898 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.80046 sec) DOMAIN: domain decomposition done. (took in total 6.4864 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.31376 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.72 MB) GRAVTREE: Tree construction done. took 17.8292 sec =995472 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.27 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 282.104 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2090, Time: 0.994936, Redshift: 0.00508967, Systemstep: 0.000841486, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2090). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80797 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11044|1.02408 DOMAIN: combining multiple-domains took 0.291941 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.20964 sec) DOMAIN: domain decomposition done. (took in total 4.70726 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.39787 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.73 MB) GRAVTREE: Tree construction done. took 17.8263 sec =995493 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.28 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 282.029 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2091, Time: 0.995778, Redshift: 0.0042396, Systemstep: 0.000842198, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2091). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.80664 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11052|1.02408 DOMAIN: combining multiple-domains took 0.410701 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.68031 sec) DOMAIN: domain decomposition done. (took in total 6.29512 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.40044 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.74 MB) GRAVTREE: Tree construction done. took 17.8183 sec =995498 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.29 MB) GRAVTREE: tree-forces are calculated, with 30 cycles took 282.152 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2092, Time: 0.996621, Redshift: 0.00339024, Systemstep: 0.000842911, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2092). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.8035 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11057|1.02408 DOMAIN: combining multiple-domains took 0.290367 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 3.42347 sec) DOMAIN: domain decomposition done. (took in total 5.91588 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.33749 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.74 MB) GRAVTREE: Tree construction done. took 17.8318 sec =995545 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.3 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 281.922 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.33227 sec PM-PERIODIC: done. (took 14.0673 seconds) TIMESTEPS: displacement time constraint: 0.00675052 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30411 sec PM-PERIODIC: done. (took 13.9354 seconds) TIMESTEPS: displacement time constraint: 0.00675052 (0.02) GRAVTREE/FMM: Setting OldAcc! KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2093, Time: 0.997465, Redshift: 0.00254161, Systemstep: 0.000843625, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2093). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 2.0391 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11065|1.02408 DOMAIN: combining multiple-domains took 0.2916 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.22938 sec) DOMAIN: domain decomposition done. (took in total 4.95767 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38449 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.75 MB) GRAVTREE: Tree construction done. took 17.8238 sec =995555 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.31 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 281.969 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2094, Time: 0.998309, Redshift: 0.00169369, Systemstep: 0.000844339, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2094). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.81159 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11072|1.02408 DOMAIN: combining multiple-domains took 0.290692 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 2.18409 sec) DOMAIN: domain decomposition done. (took in total 4.68385 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.38349 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.76 MB) GRAVTREE: Tree construction done. took 17.8199 sec =995572 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.33 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 283.384 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2095, Time: 0.999154, Redshift: 0.000846485, Systemstep: 0.000845054, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2095). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.86335 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=11 for nextra=7, reaching maximum imbalance of 1.08741|1.01982 DOMAIN: combining multiple-domains took 0.419988 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.5285 sec) DOMAIN: domain decomposition done. (took in total 16.2113 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.43466 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1813.01 MB) GRAVTREE: Tree construction done. took 17.6721 sec =995608 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1862.52 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 281.08 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: 1st gravity for highest active timebin=17: particles 2147483648 Sync-Point 2096, Time: 1, Redshift: 0, Systemstep: 0.000845769, Dloga: 0.000846127, Nsync-grv: 2147483648, Nsync-hyd: 0 DOMAIN: Begin domain decomposition (sync-point 2096). DOMAIN: Sum=2 TotalCost=2 NumTimeBinsToBeBalanced=1 MultipleDomains=2 DOMAIN: NTopleaves=4096, determination of top-level tree involved 4 iterations and took 1.77382 sec DOMAIN: we are going to try at most 497 different settings for combining the domains on tasks=360, nnodes=24 DOMAIN: total_cost=2 total_load=1 DOMAIN: best solution found after 1 iterations by task=18 for nextra=10, reaching maximum imbalance of 1.11088|1.02408 DOMAIN: combining multiple-domains took 0.295021 sec DOMAIN: exchange of 2147483648 particles DOMAIN: particle exchange done. (took 13.842 sec) DOMAIN: domain decomposition done. (took in total 16.3022 sec) PEANO: Begin Peano-Hilbert order... PEANO: done, took 2.15532 sec. ACCEL: Start tree gravity force computation... (2147483648 particles) TREE: Full tree construction for all particles. (presently allocated=1815.78 MB) GRAVTREE: Tree construction done. took 17.9455 sec =995615 NTopnodes=4681 NTopleaves=4096 tree-build-scalability=0.995311 GRAVTREE: Begin tree force. timebin=17 (presently allocated=1866.35 MB) GRAVTREE: tree-forces are calculated, with 29 cycles took 282.986 sec GRAVTREE: tree-force is done. ACCEL: tree force computation done. KICKS: 2nd gravity for highest active timebin=17: particles 2147483648 KICKS: Computing PM forces WITHOUT delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.30394 sec PM-PERIODIC: done. (took 13.8374 seconds) TIMESTEPS: displacement time constraint: 0.00676004 (0.02) KICKS: Computing PM forces WITH delta-f weighting. PM-PERIODIC: Starting periodic PM calculation. (Rcut=3.4689) presently allocated=1685.02 MB PM-PERIODIC: FFT took 2.31201 sec PM-PERIODIC: done. (took 14.0157 seconds) TIMESTEPS: displacement time constraint: 0.00676003 (0.02) GRAVTREE/FMM: Setting OldAcc! SNAPSHOT: writing snapshot file #1 @ time 1 ... SNAPSHOT: writing snapshot file: './output//snapdir_001/snapshot_001.0' (file 1 of 4) SNAPSHOT: writing snapshot block 0 (Coordinates)... SNAPSHOT: writing snapshot block 1 (Velocities)... SNAPSHOT: writing snapshot block 2 (ParticleIDs)... SNAPSHOT: writing snapshot block 4 (Weights)... SNAPSHOT: writing snapshot block 5 (PhaseSpaceDensities)... SNAPSHOT: writing snapshot block 9 (IntCoordinates)... SNAPSHOT: writing snapshot block 10 (IntVelocities)... SNAPSHOT: writing snapshot block 11 (IntPredictedVelocities)... SNAPSHOT: done with writing snapshot. Took 857.686 sec, total size 147456 MB, corresponds to effective I/O rate of 171.923 MB/sec SNAPSHOT: There is no valid time for a further snapshot file. Final time=1 reached. Simulation ends. RESTART: Writing restart files. RESTART: Backing up restart files... RESTART: done renaming pre-existing restart files to bak files. RESTART: Writing restart files group #1 out of 90... RESTART: Writing restart files group #2 out of 90... RESTART: Writing restart files group #3 out of 90... RESTART: Writing restart files group #4 out of 90... RESTART: Writing restart files group #5 out of 90... RESTART: Writing restart files group #6 out of 90... RESTART: Writing restart files group #7 out of 90... RESTART: Writing restart files group #8 out of 90... RESTART: Writing restart files group #9 out of 90... RESTART: Writing restart files group #10 out of 90... RESTART: Writing restart files group #11 out of 90... RESTART: Writing restart files group #12 out of 90... RESTART: Writing restart files group #13 out of 90... RESTART: Writing restart files group #14 out of 90... RESTART: Writing restart files group #15 out of 90... RESTART: Writing restart files group #16 out of 90... RESTART: Writing restart files group #17 out of 90... RESTART: Writing restart files group #18 out of 90... RESTART: Writing restart files group #19 out of 90... RESTART: Writing restart files group #20 out of 90... RESTART: Writing restart files group #21 out of 90... RESTART: Writing restart files group #22 out of 90... RESTART: Writing restart files group #23 out of 90... RESTART: Writing restart files group #24 out of 90... RESTART: Writing restart files group #25 out of 90... RESTART: Writing restart files group #26 out of 90... RESTART: Writing restart files group #27 out of 90... RESTART: Writing restart files group #28 out of 90... RESTART: Writing restart files group #29 out of 90... RESTART: Writing restart files group #30 out of 90... RESTART: Writing restart files group #31 out of 90... RESTART: Writing restart files group #32 out of 90... RESTART: Writing restart files group #33 out of 90... RESTART: Writing restart files group #34 out of 90... RESTART: Writing restart files group #35 out of 90... RESTART: Writing restart files group #36 out of 90... RESTART: Writing restart files group #37 out of 90... RESTART: Writing restart files group #38 out of 90... RESTART: Writing restart files group #39 out of 90... RESTART: Writing restart files group #40 out of 90... RESTART: Writing restart files group #41 out of 90... RESTART: Writing restart files group #42 out of 90... RESTART: Writing restart files group #43 out of 90... RESTART: Writing restart files group #44 out of 90... RESTART: Writing restart files group #45 out of 90... RESTART: Writing restart files group #46 out of 90... RESTART: Writing restart files group #47 out of 90... RESTART: Writing restart files group #48 out of 90... RESTART: Writing restart files group #49 out of 90... RESTART: Writing restart files group #50 out of 90... RESTART: Writing restart files group #51 out of 90... RESTART: Writing restart files group #52 out of 90... RESTART: Writing restart files group #53 out of 90... RESTART: Writing restart files group #54 out of 90... RESTART: Writing restart files group #55 out of 90... RESTART: Writing restart files group #56 out of 90... RESTART: Writing restart files group #57 out of 90... RESTART: Writing restart files group #58 out of 90... RESTART: Writing restart files group #59 out of 90... RESTART: Writing restart files group #60 out of 90... RESTART: Writing restart files group #61 out of 90... RESTART: Writing restart files group #62 out of 90... RESTART: Writing restart files group #63 out of 90... RESTART: Writing restart files group #64 out of 90... RESTART: Writing restart files group #65 out of 90... RESTART: Writing restart files group #66 out of 90... RESTART: Writing restart files group #67 out of 90... RESTART: Writing restart files group #68 out of 90... RESTART: Writing restart files group #69 out of 90... RESTART: Writing restart files group #70 out of 90... RESTART: Writing restart files group #71 out of 90... RESTART: Writing restart files group #72 out of 90... RESTART: Writing restart files group #73 out of 90... RESTART: Writing restart files group #74 out of 90... RESTART: Writing restart files group #75 out of 90... RESTART: Writing restart files group #76 out of 90... RESTART: Writing restart files group #77 out of 90... RESTART: Writing restart files group #78 out of 90... RESTART: Writing restart files group #79 out of 90... RESTART: Writing restart files group #80 out of 90... RESTART: Writing restart files group #81 out of 90... RESTART: Writing restart files group #82 out of 90... RESTART: Writing restart files group #83 out of 90... RESTART: Writing restart files group #84 out of 90... RESTART: Writing restart files group #85 out of 90... RESTART: Writing restart files group #86 out of 90... RESTART: Writing restart files group #87 out of 90... RESTART: Writing restart files group #88 out of 90... RESTART: Writing restart files group #89 out of 90... RESTART: Writing restart files group #90 out of 90... RESTART: done. load/save took 996.739 sec, total size 352287 MB, corresponds to effective I/O rate of 353.439 MB/sec endrun called, calling MPI_Finalize() bye!