Release 0.6.1 (Jan. 26, 2017)

Highlights

  • Improved NiFi provenance reporting performance
  • Added timeout option to the NiFi ExecuteSparkJob processor
  • Fixed missing Cloudera dependency
    • To build for Cloudera, substitute “thinkbig-service-monitor-ambari” with “thinkbig-service-monitor-cloudera-service” in services/service-app/pom.xml

Potential Impacts

Upon upgrading the ExecuteSparkJob processors will be marked as invalid saying: “Max wait time is invalid property”.  You will need to stop these processors and delete the “Max wait time” property.

Upgrade Instructions from v0.6.0

Build or download the RPM:

  1. Shut down NiFi:
service nifi stop
  1. To uninstall the RPM, run:
/opt/thinkbig/remove-thinkbig.sh
  1. Install the new RPM:
rpm –ivh <RPM_FILE>
  1. Run:
/opt/thinkbig/setup/nifi/update-nars-jars.sh
  1. Start NiFi: (wait to start)
service nifi start
  1. Update, using your custom configuration, the configuration files at:
/opt/thinkbig/thinkbig-ui/conf/
/opt/thinkbig/thinkbig-services/conf/
/opt/thinkbig/thinkbig-spark-shell/conf/
A backup of the previous version’s configuration is available from /opt/thinkbig/bkup-config/.
  1. If using NiFi v0.7 or earlier, modify /opt/thinkbig/thinkbig-services/conf/application.properties by changing spring.profiles.active from nifi-v1 to nifi-v0.
  2. Start thinkbig apps: -
/opt/thinkbig/start-thinkbig-apps.sh
  1. Update the ExecuteSparkJob processors (Validate and Profile processors) fixing the error: “Max wait time is invalid property” by removing that property.
  2. Ensure the reporting task is configured A ReportingTask is now used for communication between NiFi and Operations Manager.  In order to see Jobs and Steps in Ops Manager you will need to configure this following the instructions found here:

NiFi & Kylo Reporting Task (deprecated)