Usable space used up in the tray using the file channel

Question

Im working on Flume with the Spool directory as the source, HDFS as the shell, and the file as the channel. When performing work with crowbar. I get below problems. The memory channel is working fine. But we need to implement the same using the File Channel. Using the file channel Im getting below the problem.

I set the JVM memory size to 3GB in the flume.env.sh file. Please let me know any other settings we need to make.

January 20, 2016 20: 05: 27,099 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.SinkRunner $ PollingRunner.run: 160) - Unable to deliver the event. An exception. java.lang.IllegalStateException: channel closed [channel = Artiva-memory-channel]. Due to java.io.IOException: usable space has been exhausted, only 427515904 bytes remaining, 524288000 bytes required.

Answer 1

The file channel has nothing to do with memory, but with the HDD (disk). Such a channel uses a file system to store data. Thus, check how much free space is available on the disks where the checkpoint file and data files are recorded (please see the FileChannel options).