Create Custom Sink For Flume Sources

Steps To write Azure Sink

1.   Create plugins.d Dir in Flume_HOME(usr/lib/flume)

2     In plugins.d  dir create sink(any name  like azuresink)

3.    In azuresink dir create  three directories

a)lib ----it includes sink class ,one which you have written for custom sink

b)libext ---it includes dependencies of Sink class (all jar needed to run sink class)

c)native  contains dependencies .iso file.

     4. copy the sink jar in /usr/hdp/2.2.6.0-2800/flume/lib    (In HDP 2.2)

          In cloudera there is no need to paste it here.