Oracle MySQL DB培训与企服
电话同微信
: 13718043309
首页
就业课程
专题课程
认证课程
师资团队
团队博客
猎头服务
企业技术服务
关于博森瑞
当前位置:
首页
>
技术团队博客
>
大数据开发
相关链接
·
为什么Python的64位安装包文件名
·
Zookeeper安装与配置
·
Kafka的安装与配置
·
Azkaban安装实录
·
Flume安装使用实录
Azkaban安装实录
## 创建目录 ```sql [root@bosenrui ~]# mkdir /usr/local/azkaban ``` ## 上传介质 ```sql [root@bosenrui ~]# cd /usr/local/azkaban/ [root@bosenrui azkaban]# ll total 22612 -rw-r--r-- 1 root root 11157302 Mar 29 2017 azkaban-executor-server-2.5.0.tar.gz -rw-r--r-- 1 root root 1928 Mar 29 2017 azkaban-sql-script-2.5.0.tar.gz -rw-r--r-- 1 root root 11989669 Mar 29 2017 azkaban-web-server-2.5.0.tar.gz ``` ## 解压 ```sql [root@bosenrui azkaban]# tar -zxvf azkaban-executor-server-2.5.0.tar.gz azkaban-executor-2.5.0/bin/azkaban-executor-shutdown.sh azkaban-executor-2.5.0/bin/azkaban-executor-start.sh .......解压输出省略................. azkaban-web-2.5.0/web/js/moment.min.js azkaban-web-2.5.0/web/js/morris.min.js azkaban-web-2.5.0/web/js/raphael.min.js azkaban-web-2.5.0/web/js/underscore-1.4.4-min.js ``` ## 重命名文件夹 ```sql [root@bosenrui azkaban]# mv azkaban-2.5.0/ sql [root@bosenrui azkaban]# mv azkaban-web-2.5.0/ server [root@bosenrui azkaban]# mv azkaban-executor-2.5.0/ executor ``` ## 修改环境变量并使之生效 ```sql [root@bosenrui azkaban]# vi /etc/profile # /etc/profile # System wide environment and startup programs, for login setup # Functions and aliases go in /etc/bashrc # It's NOT a good idea to change this file unless you know what you # are doing. It's much better to create a custom.sh shell script in # /etc/profile.d/ to make custom changes to your environment, as this # will prevent the need for merging in future updates. pathmunge () { case ":${PATH}:" in *:"$1":*) ;; *) if [ "$2" = "after" ] ; then PATH=$PATH:$1 else PATH=$1:$PATH fi esac } if [ -x /usr/bin/id ]; then if [ -z "$EUID" ]; then # ksh workaround EUID=`id -u` UID=`id -ru` fi USER="`id -un`" LOGNAME=$USER MAIL="/var/spool/mail/$USER" fi # Path manipulation if [ "$EUID" = "0" ]; then pathmunge /sbin pathmunge /usr/sbin pathmunge /usr/local/sbin "/etc/profile" 117L, 3332C export JRE_HOME=/usr/java/jre export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib export PATH=$PATH:$JAVA_HOME/bin ## 此处以下为新加入内容 export HADOOP_HOME=/usr/local/hadoop #export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native" export LD_LIBRARY_PATH=$HADOOP_HOME/lib/native export HADOOP_COMMON_LIB_NATIVE_DIR=/usr/local/hadoop/lib/native export HADOOP_OPTS="-Djava.library.path=/usr/local/hadoop/lib" #export HADOOP_ROOT_LOGGER=DEBUG,console export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin ## 以下为ZOOKEEPER部分新加入内容 export ZOOKEEPER_HOME=/usr/local/zookeeper export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin ## 以下为Hive部分新加入内容 export HIVE_HOME=/usr/local/hive export PATH=$JAVA_HOME/bin:$PATH:$HADOOP_HOME/bin:$HIVE_HOME/bin export MYSQL_HOME=/usr/local/mysql ## 以下部分为Hbase新加内容 export HBASE_HOME=/usr/local/hbase export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin ## 以下部分为Sqoop部分增加 export SQOOP_HOME=/usr/local/sqoop export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin:$SQOOP_HOME/bin ## 以下部分为flume部分增加 export FLUME_HOME=/usr/local/flume export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin:$SQOOP_HOME/bin:$FLUME_HOME/bin ## 以下部分为azkaban部分增加 export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin:$SQOOP_HOME/bin:$FLUME_HOME/bin:/usr/local/azkaban/server/bin:/usr/local/azkaban/executor/bin/ "/etc/profile" 120L, 3569C written [root@bosenrui azkaban]# clear [root@bosenrui azkaban]# cat /etc/profile # /etc/profile # System wide environment and startup programs, for login setup # Functions and aliases go in /etc/bashrc # It's NOT a good idea to change this file unless you know what you # are doing. It's much better to create a custom.sh shell script in # /etc/profile.d/ to make custom changes to your environment, as this # will prevent the need for merging in future updates. pathmunge () { case ":${PATH}:" in *:"$1":*) ;; *) if [ "$2" = "after" ] ; then PATH=$PATH:$1 else PATH=$1:$PATH fi esac } if [ -x /usr/bin/id ]; then if [ -z "$EUID" ]; then # ksh workaround EUID=`id -u` UID=`id -ru` fi USER="`id -un`" LOGNAME=$USER MAIL="/var/spool/mail/$USER" fi # Path manipulation if [ "$EUID" = "0" ]; then pathmunge /sbin pathmunge /usr/sbin pathmunge /usr/local/sbin else pathmunge /usr/local/sbin after pathmunge /usr/sbin after pathmunge /sbin after fi HOSTNAME=`/bin/hostname 2>/dev/null` HISTSIZE=1000 if [ "$HISTCONTROL" = "ignorespace" ] ; then export HISTCONTROL=ignoreboth else export HISTCONTROL=ignoredups fi export PATH USER LOGNAME MAIL HOSTNAME HISTSIZE HISTCONTROL # By default, we want umask to get set. This sets it for login shell # Current threshold for system reserved uid/gids is 200 # You could check uidgid reservation validity in # /usr/share/doc/setup-*/uidgid file if [ $UID -gt 199 ] && [ "`id -gn`" = "`id -un`" ]; then umask 002 else umask 022 fi for i in /etc/profile.d/*.sh ; do if [ -r "$i" ]; then if [ "${-#*i}" != "$-" ]; then . "$i" else . "$i" >/dev/null 2>&1 fi fi done ## 此处以下为新加入内容 export JAVA_HOME=/usr/java export JRE_HOME=/usr/java/jre export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib export PATH=$PATH:$JAVA_HOME/bin ## 此处以下为新加入内容 export HADOOP_HOME=/usr/local/hadoop #export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native" export LD_LIBRARY_PATH=$HADOOP_HOME/lib/native export HADOOP_COMMON_LIB_NATIVE_DIR=/usr/local/hadoop/lib/native export HADOOP_OPTS="-Djava.library.path=/usr/local/hadoop/lib" #export HADOOP_ROOT_LOGGER=DEBUG,console export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin ## 以下为ZOOKEEPER部分新加入内容 export ZOOKEEPER_HOME=/usr/local/zookeeper export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin ## 以下为Hive部分新加入内容 export HIVE_HOME=/usr/local/hive export PATH=$JAVA_HOME/bin:$PATH:$HADOOP_HOME/bin:$HIVE_HOME/bin export MYSQL_HOME=/usr/local/mysql ## 以下部分为Hbase新加内容 export HBASE_HOME=/usr/local/hbase export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin ## 以下部分为Sqoop部分增加 export SQOOP_HOME=/usr/local/sqoop export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin:$SQOOP_HOME/bin ## 以下部分为flume部分增加 export FLUME_HOME=/usr/local/flume export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin:$SQOOP_HOME/bin:$FLUME_HOME/bin ## 以下部分为azkaban部分增加 export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$HADOOP_HOME/bin:$REDIS_HOME/bin:$HBASE_HOME/bin:$SQOOP_HOME/bin:$FLUME_HOME/bin:/usr/local/azkaban/server/bin:/usr/local/azkaban/executor/bin/ unset i unset -f pathmunge [root@bosenrui ~]# source /etc/profile ``` ## 导入脚本 ```sql [root@bosenrui ~]# mysql -uroot -proot Warning: Using a password on the command line interface can be insecure. Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 1 Server version: 5.6.29 MySQL Community Server (GPL) Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> create user azkaban identified by "azkaban" ; Query OK, 0 rows affected (0.00 sec) mysql> grant all privileges on *.* to 'azkaban'@'%' ; Query OK, 0 rows affected (0.00 sec) mysql> flush privileges ; Query OK, 0 rows affected (0.00 sec) mysql> create database azkaban; Query OK, 1 row affected (0.00 sec) mysql> use azkaban; Database changed mysql> source /usr/local/azkaban/sql/create-all-sql-2.5.0.sql Query OK, 0 rows affected (0.05 sec) Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.03 sec) Query OK, 0 rows affected (0.01 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.01 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.01 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.01 sec) Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.01 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.01 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.03 sec) Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.01 sec) Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.02 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.03 sec) Query OK, 0 rows affected (0.03 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.02 sec) Query OK, 0 rows affected (0.01 sec) Records: 0 Duplicates: 0 Warnings: 0 Query OK, 0 rows affected (0.03 sec) ``` ## 生成azkaban的keystore文件 ```sql root@bosenrui ~]# keytool -keystore keystore -alias jetty -genkey -keyalg RSA Enter keystore password: Re-enter new password: What is your first and last name? [Unknown]: dao What is the name of your organizational unit? [Unknown]: bosenrui.com What is the name of your organization? [Unknown]: bosenrui What is the name of your City or Locality? [Unknown]: beijing What is the name of your State or Province? [Unknown]: beijing What is the two-letter country code for this unit? [Unknown]: cn Is CN=dao, OU=bosenrui.com, O=bosenrui, L=beijing, ST=beijing, C=cn correct? [no]: yes Enter key password for
(RETURN if same as keystore password): Re-enter new password: ``` ## 将密钥文件放到指定位置 ```sql [root@bosenrui ~]# cp keystore /usr/local/azkaban/server/bin/ [root@bosenrui ~]# cp keystore /usr/local/azkaban/server/web/ [root@bosenrui ~]# cp keystore /usr/local/azkaban/server/ [root@bosenrui ~]# ls /usr/local/azkaban/server/bin/ azkaban-web-shutdown.sh azkaban-web-start.sh keystore schedule2trigger.sh start-web.sh [root@bosenrui ~]# ls /usr/local/azkaban/server/web/ css favicon.ico fonts images js keystore [root@bosenrui ~]# ls /usr/local/azkaban/server/ azkaban.version bin conf currentpid extlib keystore lib plugins web ``` ## 修改配置文件 ### azkaban.properties ```sql [root@bosenrui ~]# cat /usr/local/azkaban/server/conf/azkaban.properties #Azkaban Personalization Settings azkaban.name=Test azkaban.label=My Local Azkaban azkaban.color=#FF3601 azkaban.default.servlet.path=/index web.resource.dir=/usr/local/azkaban/server/web/ default.timezone.id=Asia/Shanghai #Azkaban UserManager class user.manager.class=azkaban.user.XmlUserManager user.manager.xml.file=/usr/local/azkaban/server/conf/azkaban-users.xml #Loader for projects executor.global.properties=conf/global.properties azkaban.project.dir=projects database.type=mysql mysql.port=3306 mysql.host=192.168.2.80 mysql.database=azkaban mysql.user=azkaban mysql.password=azkaban mysql.numconnections=100 # Velocity dev mode velocity.dev.mode=false # Azkaban Jetty server properties. jetty.maxThreads=25 jetty.ssl.port=8443 jetty.port=8081 jetty.keystore=/usr/local/azkaban/server/keystore jetty.password=123456 jetty.keypassword=123456 jetty.truststore=/usr/local/azkaban/server/keystore jetty.trustpassword=123456 # Azkaban Executor settings executor.port=12321 # mail settings mail.sender= mail.host= job.failure.email= job.success.email= lockdown.create.projects=false cache.directory=cache ``` ### /azkaban-users.xml ```sql [root@bosenrui ~]# cat /usr/local/azkaban/server/conf/azkaban-users.xml
``` ### executor下azkaban.properties ```sql [root@bosenrui ~]# cat /usr/local/azkaban/executor/conf/azkaban.properties #Azkaban default.timezone.id=Asia/Shanghai # Azkaban JobTypes Plugins azkaban.jobtype.plugin.dir=/usr/local/azkaban/executor/plugins/jobtypes #Loader for projects executor.global.properties=/usr/local/azkaban/executor/conf/global.properties azkaban.project.dir=projects database.type=mysql mysql.port=3306 mysql.host=127.0.0.1 mysql.database=azkaban mysql.user=azkanban mysql.password=azkanban mysql.numconnections=100 # Azkaban Executor settings executor.maxThreads=50 executor.port=12321 executor.flow.threads=30 ``` ## 启动测试 ### 启动web server ```sql [root@bosenrui conf]# /usr/local/azkaban/server/bin/azkaban-web-start.sh Using Hadoop from /usr/local/hadoop Using Hive from /usr/local/hive /usr/local/azkaban/server/bin/.. .:/usr/java/lib/dt.jar:/usr/java/lib/tools.jar:/usr/java/jre/lib:/usr/local/azkaban/server/bin/../lib/azkaban-2.5.0.jar:/usr/local/azkaban/server/bin/../lib/commons-collections-3.2.1.jar:/usr/local/azkaban/server/bin/../lib/commons-configuration-1.8.jar:/usr/local/azkaban/server/bin/../lib/commons-dbcp-1.4.jar:/usr/local/azkaban/server/bin/../lib/commons-dbutils-1.5.jar:/usr/local/azkaban/server/bin/../lib/commons-email-1.2.jar:/usr/local/azkaban/server/bin/../lib/commons-fileupload-1.2.1.jar:/usr/local/azkaban/server/bin/../lib/commons-io-2.4.jar:/usr/local/azkaban/server/bin/../lib/commons-jexl-2.1.1.jar:/usr/local/azkaban/server/bin/../lib/commons-lang-2.6.jar:/usr/local/azkaban/server/bin/../lib/commons-logging-1.1.1.jar:/usr/local/azkaban/server/bin/../lib/commons-pool-1.6.jar:/usr/local/azkaban/server/bin/../lib/guava-13.0.1.jar:/usr/local/azkaban/server/bin/../lib/h2-1.3.170.jar:/usr/local/azkaban/server/bin/../lib/httpclient-4.2.1.jar:/usr/local/azkaban/server/bin/../lib/httpcore-4.2.1.jar:/usr/local/azkaban/server/bin/../lib/jackson-core-asl-1.9.5.jar:/usr/local/azkaban/server/bin/../lib/jackson-mapper-asl-1.9.5.jar:/usr/local/azkaban/server/bin/../lib/jetty-6.1.26.jar:/usr/local/azkaban/server/bin/../lib/jetty-util-6.1.26.jar:/usr/local/azkaban/server/bin/../lib/joda-time-2.0.jar:/usr/local/azkaban/server/bin/../lib/jopt-simple-4.3.jar:/usr/local/azkaban/server/bin/../lib/junit-4.8.jar:/usr/local/azkaban/server/bin/../lib/log4j-1.2.16.jar:/usr/local/azkaban/server/bin/../lib/mail-1.4.5.jar:/usr/local/azkaban/server/bin/../lib/mysql-connector-java-5.1.28.jar:/usr/local/azkaban/server/bin/../lib/servlet-api-2.5.jar:/usr/local/azkaban/server/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/azkaban/server/bin/../lib/slf4j-log4j12-1.6.4.jar:/usr/local/azkaban/server/bin/../lib/velocity-1.7.jar:/usr/local/azkaban/server/bin/../lib/velocity-tools-2.0.jar:/usr/local/azkaban/server/bin/../extlib/*.jar:/usr/local/azkaban/server/bin/../plugins/*/*.jar:/usr/local/hadoop/conf:/usr/local/hadoop/*:/usr/local/hive/conf:/usr/local/hive/lib/* [root@bosenrui conf]# 2018/03/16 05:02:22.724 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor... 2018/03/16 05:02:22.763 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from /usr/local/azkaban/server/bin/../conf 2018/03/16 05:02:22.769 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file 2018/03/16 05:02:22.797 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25 2018/03/16 05:02:22.834 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2018/03/16 05:02:22.878 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager 2018/03/16 05:02:22.922 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban 2018/03/16 05:02:22.925 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics 2018/03/16 05:02:22.925 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin 2018/03/16 05:02:23.587 +0800 INFO [AzkabanWebServer] [Azkaban] Loading JDBC for project management 2018/03/16 05:02:23.591 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old logs from execution_logs 2018/03/16 05:02:23.594 +0800 INFO [ProjectManager] [Azkaban] Project version retention is set to 3 2018/03/16 05:02:23.739 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old log files before 2017-12-22T05:02:23.609+08:00 2018/03/16 05:02:23.746 +0800 INFO [ExecutorManager] [Azkaban] Cleaned up 0 log entries. 2018/03/16 05:02:23.786 +0800 INFO [TriggerManager] [Azkaban] TriggerManager loaded. 2018/03/16 05:02:23.786 +0800 INFO [AzkabanWebServer] [Azkaban] Loading built-in checker and action types 2018/03/16 05:02:23.792 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker BasicTimeChecker 2018/03/16 05:02:23.792 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker SlaChecker 2018/03/16 05:02:23.792 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker ExecutionChecker 2018/03/16 05:02:23.792 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action ExecuteFlowAction 2018/03/16 05:02:23.792 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action KillExecutionAction 2018/03/16 05:02:23.792 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action AlertAction 2018/03/16 05:02:23.792 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action CreateTriggerAction 2018/03/16 05:02:23.792 +0800 INFO [AzkabanWebServer] [Azkaban] Loading trigger based scheduler 2018/03/16 05:02:23.796 +0800 INFO [AzkabanWebServer] [Azkaban] Loading plug-in checker and action types 2018/03/16 05:02:23.797 +0800 ERROR [AzkabanWebServer] [Azkaban] plugin path plugins/triggers doesn't exist! 2018/03/16 05:02:23.797 +0800 INFO [AzkabanWebServer] [Azkaban] Setting timezone to Asia/Shanghai 2018/03/16 05:02:23.798 +0800 INFO [AzkabanWebServer] [Azkaban] Registering MBeans... 2018/03/16 05:02:23.817 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered. 2018/03/16 05:02:23.822 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxTriggerManager registered. 2018/03/16 05:02:23.825 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxExecutorManager registered. 2018/03/16 05:02:23.828 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up web resource dir /usr/local/azkaban/server/web/ 2018/03/16 05:02:23.914 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db. 2018/03/16 05:02:23.942 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers. 2018/03/16 05:02:23.943 +0800 INFO [log] [Azkaban] jetty-6.1.26 2018/03/16 05:02:28.793 +0800 INFO [log] [Azkaban] Started SslSocketConnector@0.0.0.0:8443 2018/03/16 05:02:28.797 +0800 INFO [AzkabanWebServer] [Azkaban] Server running on ssl port 8443. ``` ## 启动 executor ```sql [root@bosenrui bin]# sh azkaban-executor-start.sh Using Hadoop from /usr/local/hadoop Using Hive from /usr/local/hive ./.. .:/usr/java/lib/dt.jar:/usr/java/lib/tools.jar:/usr/java/jre/lib:./../lib/azkaban-2.5.0.jar:./../lib/commons-collections-3.2.1.jar:./../lib/commons-configuration-1.8.jar:./../lib/commons-dbcp-1.4.jar:./../lib/commons-dbutils-1.5.jar:./../lib/commons-email-1.2.jar:./../lib/commons-fileupload-1.2.1.jar:./../lib/commons-io-2.4.jar:./../lib/commons-jexl-2.1.1.jar:./../lib/commons-lang-2.6.jar:./../lib/commons-logging-1.1.1.jar:./../lib/commons-pool-1.6.jar:./../lib/guava-13.0.1.jar:./../lib/h2-1.3.170.jar:./../lib/httpclient-4.2.1.jar:./../lib/httpcore-4.2.1.jar:./../lib/jackson-core-asl-1.9.5.jar:./../lib/jackson-mapper-asl-1.9.5.jar:./../lib/jetty-6.1.26.jar:./../lib/jetty-util-6.1.26.jar:./../lib/joda-time-2.0.jar:./../lib/jopt-simple-4.3.jar:./../lib/junit-4.8.jar:./../lib/log4j-1.2.16.jar:./../lib/mail-1.4.5.jar:./../lib/mysql-connector-java-5.1.28.jar:./../lib/servlet-api-2.5.jar:./../lib/slf4j-api-1.6.1.jar:./../lib/slf4j-log4j12-1.6.4.jar:./../lib/velocity-1.7.jar:./../lib/velocity-tools-2.0.jar:./../extlib/*.jar:./../plugins/*/*.jar:/usr/local/hadoop/conf:/usr/local/hadoop/*:/usr/local/hive/conf:/usr/local/hive/lib/* Starting AzkabanExecutorServer on port 12321 ... [root@bosenrui bin]# 2018/03/16 05:12:49.050 +0800 ERROR [AzkabanExecutorServer] [Azkaban] Starting Jetty Azkaban Executor... 2018/03/16 05:12:49.108 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from ./../conf 2018/03/16 05:12:49.110 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban private properties file 2018/03/16 05:12:49.114 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file 2018/03/16 05:12:49.153 +0800 INFO [AzkabanExecutorServer] [Azkaban] Setting timezone to Asia/Shanghai 2018/03/16 05:12:49.192 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2018/03/16 05:12:49.435 +0800 INFO [FlowRunnerManager] [Azkaban] Execution dir retention set to 86400000 ms 2018/03/16 05:12:49.452 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished 2018/03/16 05:12:49.452 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects 2018/03/16 05:12:49.456 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs 2018/03/16 05:12:49.470 +0800 INFO [AzkabanExecutorServer] [Azkaban] Registering MBeans... 2018/03/16 05:12:49.501 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered. 2018/03/16 05:12:49.514 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxFlowRunnerManager registered. 2018/03/16 05:12:49.514 +0800 INFO [log] [Azkaban] jetty-6.1.26 2018/03/16 05:12:49.610 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321 2018/03/16 05:12:49.610 +0800 INFO [AzkabanExecutorServer] [Azkaban] Azkaban Executor Server started on port 12321 ``` ## 登录 
上一篇:
Kafka的安装与配置
|
下一篇:
Flume安装使用实录
aiaiDBA
加微信获取免费职业规划+学习资料,
了解年薪50万的DBA是如何练成的
13718043309
010-86462881