Integrating Nifi with Graylog

Integrating Nifi with Graylog

Graylog is gaining popularity as a log exploration tool.  So this begs the question, how do you intelligently route your logs to the tool?  The answer is nifi.

Recently for a client I explored integrating nifi with Graylog. There is an AWS EC2 image for a full graylog install with the documentation for this to be found here https://docs.graylog.org/en/1.3/pages/installation/aws.html

  • Configure a GELF HTTP connector to these settings

    https://docs.graylog.org/en/1.3/pages/sending_data.html

  • Execute script of a a Python Script generating Dummy JSONS '{"short_message":"CHRIS HERE", "host":"example.org", "facility":"test", "_foo":"bar"}'
  • Have a nifi HTTP post processor pointed at the Graylog input
  • Confirm messages have been received by graylog
Julien Laurenceau

Senior Solutions Architect | Performance Specialist | Audit :// Data | AI | Distributed Systems | Cloud | Datacenter

6 年
回复

要查看或添加评论,请登录

Chris Gambino的更多文章

  • NiFi and Retrieval Augmented Generation

    NiFi and Retrieval Augmented Generation

    Phase 1 – “Basic Knowledge” We built a real time slackbot to help answer NiFi questions. To build and host this…

    1 条评论
  • Cloud First IoT with Syft

    Cloud First IoT with Syft

    Introduction Syft Technologies is a leading scientific equipment manufacturer specializing in chemical analysis. To…

  • A Crash Course for Amazon Natural Language Processing

    A Crash Course for Amazon Natural Language Processing

    Over the past few years we have seen a rise in cloud native “machine learning” models. These general use models are…

  • What I Learned from 2.75 Million Bike Rides

    What I Learned from 2.75 Million Bike Rides

    What do you think is the most popular bicycle spot is in San Francisco? I’ll give you a hint, over 129,000 people…

  • Moving Data to the Cloud - A Practical Guide

    Moving Data to the Cloud - A Practical Guide

    Moving data to the cloud is one of the cornerstones of any cloud migration. Having worked with both on-premise and…

    2 条评论
  • Automated Data Collection with NiFi

    Automated Data Collection with NiFi

    Introduction Manufacturing is a field that is undergoing a complete transformation in the era of faster and more…

    2 条评论
  • Create A Restful API for Nifi, Walmart Case Study

    Create A Restful API for Nifi, Walmart Case Study

    I was recently tinkering with the walmart rest-api. This is publicly available interface and can be used for a quick…

  • Windows Share + Nifi + HDFS – A Practical Guide

    Windows Share + Nifi + HDFS – A Practical Guide

    Recently I had a client ask about how would we go about connecting a windows share to Nifi to HDFS, or if it was even…

    1 条评论
  • Parsing XML Logs With Nifi – Part 1 of 3

    Parsing XML Logs With Nifi – Part 1 of 3

    I have a plan to write a 3 part “intro” series as to how to handle your XML files. The subjects will be: Basic XML and…

    1 条评论
  • Building a Smarter Home with Nifi and Spark

    Building a Smarter Home with Nifi and Spark

    I submitted an abstract for the hadoop world summit. Check it out and vote for it here Join us as we discuss what life…

    2 条评论

社区洞察

其他会员也浏览了