How to make Luigi task generate a list in memory as a target

Question

I am trying to write an etl pipeline using luigi . As far as I understand from the documentation, a task in luigi can generate a target, which can be either a type of file storage or a database. To reduce processing time, I would like to have a list in memory as output. Is it possible? Do I need to create a custom goal?

Answer 1

I found out that I can use MockFile as a target. Good example:

http://gouthamanbalaraman.com/blog/building-luigi-task-pipeline.html