Release 0.9.1.1 (July 6, 2018)

Highlights

Upgrade Instructions from v0.9.1

  1. Backup any Kylo plugins
When Kylo is uninstalled it will backup configuration files, but not the /plugin jar files. If you have any custom plugins in either kylo-services/plugin or kylo-ui/plugin then you will want to manually back them up to a different location.
  1. Stop and uninstall Kylo

    2.1 Stop Kylo

    /opt/kylo/stop-kylo-apps.sh
    

    2.2 Uninstall Kylo

    /opt/kylo/remove-kylo.sh
    
  2. Install the new RPM:

rpm –ivh <RPM_FILE>
  1. Restore previous application.properties files. If you have customized the the application.properties, copy the backup from the 0.9.1 install.

    4.1 Find the /bkup-config/TIMESTAMP/kylo-services/application.properties file

    • Kylo will backup the application.properties file to the following location, /opt/kylo/bkup-config/YYYY_MM_DD_HH_MM_millis/kylo-services/application.properties, replacing the “YYYY_MM_DD_HH_MM_millis” with a valid time:

    4.2 Copy the backup file over to the /opt/kylo/kylo-services/conf folder

    ### move the application.properties shipped with the .rpm to a backup file
    mv /opt/kylo/kylo-services/conf/application.properties /opt/kylo/kylo-services/conf/application.properties.0_9_1_1_template
    ### copy the backup properties  (Replace the YYYY_MM_DD_HH_MM_millis  with the valid timestamp)
    cp /opt/kylo/bkup-config/YYYY_MM_DD_HH_MM_millis/kylo-services/application.properties /opt/kylo/kylo-services/conf
    

    4.3 If you copied the backup version of application.properties in step 4.2 you will need to make the below changes based on the 0.9.1.1 version of the properties file

    vi /opt/kylo/kylo-services/conf/application.properties
    
    # protocol for absolute hdfs url's (change to s3 or azure specific if needed)
    config.hdfs.protocol=hdfs
    

    4.4 Copy the /bkup-config/TIMESTAMP/kylo-ui/application.properties file to /opt/kylo/kylo-ui/conf

    ### move the application.properties shipped with the .rpm to a backup file
    mv /opt/kylo/kylo-ui/conf/application.properties /opt/kylo/kylo-ui/conf/application.properties.0_9_1_1_template
    ### copy the backup properties  (Replace the YYYY_MM_DD_HH_MM_millis  with the valid timestamp)
    cp /opt/kylo/bkup-config/YYYY_MM_DD_HH_MM_millis/kylo-ui/application.properties /opt/kylo/kylo-ui/conf
    

    4.5 Ensure the property security.jwt.key in both kylo-services and kylo-ui application.properties file match. The property below needs to match in both of these files:

    • /opt/kylo/kylo-ui/conf/application.properties

    • /opt/kylo/kylo-services/conf/application.properties

      security.jwt.key=
      
  2. NOTE: Kylo no longer ships with the default dladmin user. You will need to re-add this user only if you’re using the default authentication configuration:

  • Uncomment the following line in /opt/kylo/kylo-services/conf/application.properties and /opt/kylo/kylo-ui/conf/application.properties :
security.auth.file.users=file:///opt/kylo/users.properties
security.auth.file.groups=file:///opt/kylo/groups.properties
  • Create a file called users.properties file that is owned by kylo and replace dladmin with a new username and thinkbig with a new password:
echo "dladmin=thinkbig" > /opt/kylo/users.properties
chown kylo:users /opt/kylo/users.properties
chmod 600 /opt/kylo/users.properties
  • Create a file called groups.properties file that is owned by kylo and set the default groups:
vi /opt/kylo/groups.properties
dladmin=admin,user
analyst=analyst,user
designer=designer,user
operator=operations,user
chown kylo:users /opt/kylo/groups.properties
chmod 600 /opt/kylo/groups.properties
  1. To enable reindexing of a feed’s historical data:

    1. Verify option in /opt/kylo/kylo-services/conf/application.properties for Kylo services. This is true by default.

      search.history.data.reindexing.enabled=true
      
    2. If using Solr instead of Elasticsearch as the search engine, add one property to /opt/kylo/kylo-services/conf/solrsearch.properties file.

      config.http.solr.url=http://${search.host}:${search.port}
      
  2. Update the NiFi nars.

    Stop NiFi

    service nifi stop
    

    Run the following shell script to copy over the new NiFi nars/jars to get new changes to NiFi processors and services.

    /opt/kylo/setup/nifi/update-nars-jars.sh <NIFI_HOME> <KYLO_SETUP_FOLDER> <NIFI_LINUX_USER> <NIFI_LINUX_GROUP>
    
    Example:  /opt/kylo/setup/nifi/update-nars-jars.sh /opt/nifi /opt/kylo/setup nifi users
    

    Start NiFi

    service nifi start
    
  3. Start Kylo

/opt/kylo/start-kylo-apps.sh