filter_lua: allow to return an array of messages.

[manuelluis]

No description provided.

[manuelluis]

To allow to split a message in multiple messages in the lua filter, the result can be a map or an array of maps.

$ cat test.conf 
[Input]
	Name stdin

[Filter]
	Name lua
	Match *
	script  test.lua
	call    cb_print

[Output]
	Name stdout
	Match *

$ cat test.lua 
function cb_print(tag, timestamp, record)
   if record["x"] ~= nil then
      return 1, timestamp, record["x"]
   else 
      return 1, timestamp, record
   end 
end

$ cat test.json 
{"x": [ {"a1":"aa", "z1": "zz"}, {"b1":"bb", "x1": "xx"}, {"c1":"cc"}]}
{"x": [ {"a2":"aa", "z2": "zz"}, {"b2":"bb", "x2": "xx"}, {"c2":"cc"}]}
{"a3":"aa", "z3": "zz", "b3":"bb", "x3": "xx", "c3":"cc"}

$ cat test.json | ./fluent-bit -f1 -c test.conf -q
[0] stdin.0: [1538435928.310583591, {"a1"=>"aa", "z1"=>"zz"}]
[1] stdin.0: [1538435928.310583591, {"x1"=>"xx", "b1"=>"bb"}]
[2] stdin.0: [1538435928.310583591, {"c1"=>"cc"}]
[3] stdin.0: [1538435928.310588359, {"z2"=>"zz", "a2"=>"aa"}]
[4] stdin.0: [1538435928.310588359, {"b2"=>"bb", "x2"=>"xx"}]
[5] stdin.0: [1538435928.310588359, {"c2"=>"cc"}]
[6] stdin.0: [1538435928.310589790, {"z3"=>"zz", "x3"=>"xx", "c3"=>"cc", "a3"=>"aa", "b3"=>"bb"}]

[edsiper]

thanks

[liweitianux]

Awesome! This is just what I want. I've looked the Fluent Bit docs but found nothing about this feature. Google search also returned nothing.

Thank you for the nice work. By the way, I'll make a patch to update the lua filter doc.

[geisbruch]

Hi guys ! one question, Which take will take on each emitted record ? I am trying to return a table where the records should match different tags, is it possible ?