What’s new in logisland ?

v0.9.7

  • add HDFS burner feature processor #89
  • add ExtractJsonPath processor #90
  • check compatibility with HDP 2.5 #112
  • sometimes the drivers fails with status SUCCEEDED which prevents YARN to resubmit the job automatically #105
  • logisland crashes when starting with wrong offsets #111
  • add type checking for SplitText component enhancement #46
  • add optional regex to SplitText #106
  • add record schema management with ConvertFieldsType processor #75
  • add field auto extractor processor : SplitTextWithProperties #49
  • add a new RemoveFields processor
  • add a NormalizeFields processor #88
  • Add notion of asserting the asserted fields in MockRecord

v0.9.6

  • add a Documentation generator for plugins feature #69
  • add SQL aggregator plugin feature #74
  • #66 merge elasticsearch-shaded and elasticsearch-plugin enhancement
  • #73 add metric aggregator processor feature
  • #57 add sampling processor enhancement
  • #72 integrate OutlierDetection plugin feature
  • #34 integrate QueryMatcherProcessor bug

v0.9.5

  • generify API from Event to Records
  • add docker container for demo
  • add topic auto-creation parameters
  • add Record validators
  • add processor chaining that works globally on an input/output topic and pipe in-memory contexts into sub-processors
  • better error handling for SplitText
  • testRunner API
  • migrate LogParser to LogProcessor Interface
  • reporting metrics to know where are exactly the processors on the topics
  • add an HDFSBurner Engine
  • yarn stability improvements
  • more spark parameters handling
  • driver failover through Zookeper offset checkpointing
  • add raw_content to event if regex matching failed in SplitText
  • integration testing with embedded Kafka/Spark
  • processor chaining