珠宝公司网站模板,做徽标哪个网站素材多,wordpress主題,上海网站建设的网站文章目录yarn命令根据状态查看Yarn全部运行应用程序根据提交程序代码提交类型查看运行程序yarn top 查看正在运行的状态yarn top整体资源使用查看Yarn web页面工具脚本根据yarn应用名称kill进程根据yarn应用名称查看日志yarn命令
根据状态查看Yarn全部运行应用程序
# 查看全部…
文章目录yarn命令根据状态查看Yarn全部运行应用程序根据提交程序代码提交类型查看运行程序yarn top 查看正在运行的状态yarn top整体资源使用查看Yarn web页面工具脚本根据yarn应用名称kill进程根据yarn应用名称查看日志yarn命令
根据状态查看Yarn全部运行应用程序
# 查看全部运行过的yarn程序
yarn application -list -appStates ALL
# 查看正在运行的yarn程序等同于yarn application -list
yarn application -list -appStates RUNNING-appStates
与-list一起使用可根据输入的逗号分隔的应用程序状态列表来过滤应用程序。有效的应用程序状态可以是以下之一ALLNEWNEW_SAVINGSUBMITTEDACCEPTEDRUNNINGFINISHEDFAILEDKILLED 根据提交程序代码提交类型查看运行程序
# 查看Flink提交到yarn的程序
# yarn application -list -appTypes Apache FlinkApplication-Id Application-Name Application-Type User Queue State Final-State Progress Tracking-URL
application_1651044751782_0093 avris-profile-platform Apache Flink hdfs root.users.hdfs RUNNING UNDEFINED 100% http://dev-bigdata-24-149:4681
-appTypes #与-list一起使用可以根据输入的逗号分隔的应用程序类型列表来过滤应用程序。
yarn top 查看正在运行的状态
YARN top - 17:03:12, up 13d, 6:24, 0 active users, queue(s): root
NodeManager(s): 3 total, 3 active, 0 unhealthy, 0 decommissioned, 0 lost, 0 rebooted
Queue(s) Applications: 7 running, 119 submitted, 0 pending, 69 completed, 43 killed, 0 failed
Queue(s) Mem(GB): 16 available, 70 allocated, 0 pending, 0 reserved
Queue(s) VCores: 67 available, 29 allocated, 0 pending, 0 reserved
Queue(s) Containers: 29 allocated, 0 pending, 0 reservedAPPLICATIONID USER TYPE QUEUE PRIOR #CONT #RCONT VCORES RVCORES MEM RMEM VCORESECS MEMSECS %PROGR TIME NAME application_1655951936605_0067 hadoop apache flink default 0 9 0 9 0 26G 0G 1636659 4728125 100.00 02:02:31 avris-clue-ruleapplication_1655951936605_0120 hadoop apache flink default 0 6 0 6 0 12G 0G 509589 1019188 100.00 00:23:35 avris-profile-platformapplication_1655951936605_0122 hadoop apache flink default 0 4 0 4 0 11G 0G 4945 13599 100.00 00:00:20 avris-strategy-ruleapplication_1655951936605_0048 hadoop apache flink default 0 3 0 3 0 9G 0G 1287268 3861784 100.00 04:23:11 avris-scEvent-toCDPapplication_1655951936605_0121 hadoop apache flink default 0 3 0 3 0 5G 0G 253043 421733 100.00 00:23:25 avris-behavior-labelRegineapplication_1655951936605_0003 hadoop apache flink default 0 2 0 2 0 3G 0G 2290410 3435610 100.00 13:06:06 avris-userinfo-changeapplication_1655951936605_0002 hadoop apache flink default 0 2 0 2 0 4G 0G 2290768 4581525 100.00 13:06:09 avris-event-hbase说明
参数说明#RCONT使用的容器container个数RVCORES使用的cpu核数RMEM使用的内存大小APPLICATIONIDyarn任务IDUSER提交任务用户TYPE任务类型如apache flinkQUEUE提交任务所在队列
yarn top整体资源使用查看
YARN top - 17:08:52, up 13d, 6:29, 0 active users, queue(s): root
NodeManager(s): 3 total, 3 active, 0 unhealthy, 0 decommissioned, 0 lost, 0 rebooted
Queue(s) Applications: 7 running, 119 submitted, 0 pending, 69 completed, 43 killed, 0 failed
Queue(s) Mem(GB): 16 available, 70 allocated, 0 pending, 0 reserved
Queue(s) VCores: 67 available, 29 allocated, 0 pending, 0 reserved
Queue(s) Containers: 29 allocated, 0 pending, 0 reserved参数说明available剩余可用的资源allocated已经使用的资源reserved已经申请正在分配的资源pending等待申请的资源available allocatedYarn的总资源
Yarn web页面 工具脚本
根据yarn应用名称kill进程
[hadoop10 /data]$ cat kill.sh
applicationIdyarn application -list | grep 提交程序在Yarn名称 |awk {print $1}
yarn application -kill $applicationId
yarn application -list根据yarn应用名称查看日志
applicationIdyarn application -list | grep 提交程序在Yarn名称 |awk {print $1}
yarn logs -applicationId $applicationId
