耗时长任务分析./application_1786676452536_0002/container_1786676452536_0002_01_000412/syslog#cat./application_1786676452536_0002/container_1786676452536_0002_01_000412/syslog2026-08-1411:10:31,193INFO[main]org.apache.hadoop.security.SecurityUtil:Updating Configuration2026-08-1411:10:31,252INFO[main]org.apache.hadoop.metrics2.impl.MetricsConfig:Loaded properties from hadoop-metrics2.properties2026-08-1411:10:31,328INFO[main]org.apache.hadoop.metrics2.impl.MetricsSystemImpl:Scheduled Metric snapshot period at10second(s).2026-08-1411:10:31,328INFO[main]org.apache.hadoop.metrics2.impl.MetricsSystemImpl:MapTask metrics system started2026-08-1411:10:31,368INFO[main]org.apache.hadoop.mapred.YarnChild:Executing with tokens:[Kind:mapreduce.job,Service:job_1786676452536_0002,Ident:(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier479d31f3)]2026-08-1411:10:31,391INFO[main]org.apache.hadoop.mapred.YarnChild:Sleepingfor0ms before retrying again.Got null now.2026-08-1411:10:31,606INFO[main]org.apache.hadoop.mapred.YarnChild:mapreduce.cluster.local.dirforchild:/dev/shm/yarn/local/usercache/root/appcache/application_1786676452536_0002,/run/yarn/local/usercache/root/appcache/application_1786676452536_00022026-08-1411:10:31,863INFO[main]org.apache.hadoop.mapred.YarnChild:/************************************************************ [system properties] os.name: Linux os.version: 5.10.0-200.0.0.157.39.oe2203sp3.bclinux.x86_64 java.home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-0.bclinux.21.10U4.x86_64/jre java.runtime.version: 1.8.0_432-b06 java.vendor: BiSheng java.version: 1.8.0_432 java.vm.name: OpenJDK 64-Bit Server VM java.class.path: /dev/shm/yarn/local/usercache/root/appcache/application_1786676452536_0002/container_1786676452536_0002_01_000412:/usr/local/hadoop/etc/hadoop:/usr/ ... user.dir: /dev/shm/yarn/local/usercache/root/appcache/application_1786676452536_0002/container_1786676452536_0002_01_000412 user.name: hdfs ************************************************************/2026-08-1411:10:31,864INFO[main]org.apache.hadoop.conf.Configuration.deprecation:session.id is deprecated.Instead,use dfs.metrics.session-id2026-08-1411:10:32,215INFO[main]org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:File Output Committer Algorithm version is22026-08-1411:10:32,215INFO[main]org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter:FileOutputCommitter skip cleanup _temporary folders under output directory:false,ignore cleanup failures:false2026-08-1411:10:32,347INFO[main]org.apache.hadoop.mapred.Task:Using ResourceCalculatorProcessTree:[]2026-08-1411:10:32,634INFO[main]org.apache.hadoop.mapred.MapTask:Processing split:hdfs://hadoop00:9000/terasort/terasort-input/part-m-01139:010485760002026-08-1411:10:32,650INFO[main]org.apache.hadoop.mapred.nativetask.HadoopPlatform:Hadoop platform inited2026-08-1411:10:32,653INFO[main]org.apache.hadoop.mapred.nativetask.NativeRuntime:Nativetask JNI library loaded.2026-08-1411:10:32,684INFO[main]org.apache.hadoop.mapred.nativetask.NativeBatchProcessor:NativeHandler:direct buffer size:10485762026-08-1411:10:32,695INFO[main]org.apache.hadoop.mapred.nativetask.util.OutputUtil:nativetask.output.managerorg.apache.hadoop.mapred.nativetask.util.NativeTaskOutputFiles2026-08-1411:10:32,696INFO[main]org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator:Native output collector can be successfully enabled!2026-08-1411:10:32,696INFO[main]org.apache.hadoop.mapred.MapTask:Map output collectorclassorg.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator2026-08-1411:12:30,822INFO[main]org.apache.hadoop.conf.Configuration.deprecation:mapred.local.dir is deprecated.Instead,use mapreduce.cluster.local.dir2026-08-1411:12:35,935INFO[main]org.apache.hadoop.mapred.Task:Task:attempt_1786676452536_0002_m_000408_0 is done.And is in the process of committing2026-08-1411:12:36,020INFO[main]org.apache.hadoop.mapred.Task:Task attempt_1786676452536_0002_m_000408_0done.2026-08-1411:12:36,024INFO[main]org.apache.hadoop.mapred.Task:Final Countersforattempt_1786676452536_0002_m_000408_0:Counters:29File System Counters FILE:Number of bytes read12859FILE:Number of bytes written281237FILE:Number of read operations0FILE:Number of large read operations0FILE:Number of write operations0HDFS:Number of bytes read1048576122HDFS:Number of bytes written0HDFS:Number of read operations3HDFS:Number of large read operations0HDFS:Number of write operations0HDFS:Number of bytes read erasure-coded0Map-Reduce Framework Map input records10485760Map output records10485760Map output bytes1048576000Map output materialized bytes463866508Input split bytes122Combine input records0Combine output records0Spilled Records10485760Failed Shuffles0Merged Map outputs0GC timeelapsed(ms)68CPU timespent(ms)13990Physicalmemory(bytes)snapshot1058443264Virtualmemory(bytes)snapshot3344220160Total committed heapusage(bytes)1503264768Peak Map Physicalmemory(bytes)2193334272Peak Map Virtualmemory(bytes)4686401536File Input Format Counters Bytes Read10485760002026-08-1411:12:36,025INFO[main]org.apache.hadoop.metrics2.impl.MetricsSystemImpl:Stopping MapTask metrics system...2026-08-1411:12:36,025INFO[main]org.apache.hadoop.metrics2.impl.MetricsSystemImpl:MapTask metrics system stopped.2026-08-1411:12:36,025INFO[main]org.apache.hadoop.metrics2.impl.MetricsSystemImpl:MapTask metrics system shutdown complete.AM