Overview

In Fire Insights, you can write your own processor in Apache Spark and plug them into Fire Insights. Once these processors are made available to Fire Insights via a jar file and field definitions captured in a JSON file, they appear within the Fire Insights Workflow Editor.

Users can use these new processors like any other processor within Fire Insights. This repository contains a few sample processors to get you started.

Repository Structure

The layout of this Repository is defined here:

• Repository Structure

Steps for Building & Executing the Examples here

• Checkout Code, Install Fire Core Jar
• Build and Execute Examples
• Executing Workflow JSON With Spark Submit

Writing new Processors in Java/Scala

• Using an IDE
• Writing New Processors in Java/Scala
• Processors Class Hierarchy
• Writing Machine Learning Processors

Reference Docs

• Processor/Node JSON & Widgets
• JobContext and Workflow
• Workflow Parameters & Node Variables

Writing new PySpark Nodes

• Writing new PySpark Nodes

Workflow