Deployment Checklist¶
This document provides a sample checklist to help prepare for a Kylo deployment.
Edge Node Resource Requirements¶
- Kylo and Apache NiFi can be installed on a single edge node, however it is recommended that they run on separate edge nodes.
- Minimum production recommendation is 4 cores CPU, 16 GB RAM.
- Preferred production recommendation is 8 cores CPU, 32 GB RAM.
Dependencies¶
Red Hat Enterprise Linux or other GNU/Linux Distributions (CentOS, Fedora). |
RPM (for install) |
Java 1.8+ |
Hadoop 2.4+ cluster |
Spark 1.5.2+ |
Apache NiFi 1.x+ (or HDF 2.x) |
Hive 1.2.x+ |
MySQL 5.x+ |
Linux User/Group Creation¶
There are three Linux user accounts that need to be created before installing the Kylo stack. If an external user management tool is used, these user accounts need to be created ahead of time. If not, there are instructions in the Manual Deployment Guide (see Step 2: Create Linux Users and Groups) on how to create the users and groups.
- kylo
- nifi
- activemq
Please create the above users and groups with the same names.
Edge Node Ports¶
The following ports are required to be open for browser access unless using a web proxy server:
- Kylo UI – 8400
- NiFi – 8079
- ActiveMQ JMS – 61616 (only if on a different edge node than NiFi or Kylo)
The following is optional:
- ActiveMQ Admin – 8161
Cluster Host Names, User Names, and Ports¶
Collect the following information to speed up configuration of Kylo:
- Hive Hostname/IP Address:
- Ambari IP Hostname/IP Address (if used):
- Ambari “kylo” user username/password (if used):
- KDC Hostname/IP Address (if used):
- MySQL Metastore Hostname/IP Address:
- Kylo Edge Hostname/IP Address:
- NiFi Edge Hostname/IP Address:
- Kylo MySQL Installation User username/password (Create Schema Required):
- Kylo MySQL application username/password (For the kylo-services application and Hive metadata access):
Kerberos Principals (if using Kerberos)¶
Note the following Kerberos principals after the step of creating the Keytabs:
- Kerberos Principal for “kylo”:
- Kerberos Principal for “nifi”:
- Kerberos Principal for “hive” on the Hive Server2 Host: