What is RECONCILE_WITH_FILE_SYSTEM in FlowTracer?

FlowTracer keeps track of job success based in job exit status, timestamps and status of inputs and outputs.

Sometimes users are not interested in running the whole flow within FlowTracer or they already have
some result files available from elsewhere. In this case they can initiallize a FlowTracer session by calling
RECONCILE_WITH_FILE_SYSTEM. Here, the job status is computed based in the timestamps of existing
input and output files alone. Also, jobs are only valid when all jobs in their upcone are valid. 
The command assigns a fictitious hostname _reconciled_ to all reconciled jobs.
In addition jobs are marked as 'unsafe', to show that they were never run within the FlowTracer
infrastructure, there is no history available, and results may therefore be unreliable.


 

Did you find this article helpful?