Commit a877262c authored by Magnus Runesson's avatar Magnus Runesson Committed by Tao Feng

Task stop prematurely if transformer return None (#179)

When transformer returned null no more records is processed, this means a transformer cannot filter out data. It also mean the task silently skip process rest of the records.
parent d736adb4
......@@ -60,6 +60,7 @@ class DefaultTask(Task):
while record:
record = self.transformer.transform(record)
if not record:
record = self.extractor.extract()
continue
self.loader.load(record)
record = self.extractor.extract()
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment