Is the expected behavior on an HDFSFileSink buffer flush that the new buffer would overwrite the existing file contents (from prior buffer writes), unless you are using a "%FILENUM" or some other in-filename parameter?
For example, if I have a Beacon --> Punctor --> HDFSFileSink, and I'm writing to the HDFS file "foo.txt" (no %FILENUM), would you expect the "foo.txt" to only have one row (the most recent, since the Punctor punctuation causes the HDFSFileSink to flush), or one row for each of the Beacon pulses?
With my testing, it's resulting in only one row in the file, and previous rows are overwritten... is this the expected behavior?
I'd like to confirm this is the expected behavior, or if I'm misunderstanding what I am seeing.
thanks in advance,