I believe that the building of the general job dotfile was added to Crunch
before the default disabling of the other dotfiles was added, and so it is
always created to maintain backwards compatibility.
Please feel free to log a ticket (or even better, provide a patch) to have
have this changed at https://issues.apache.org/jira/browse/CRUNCH
By the way, if exceptions like the one you mentioned ("Problem creating
debug dotfile: Input source Avro(…) does not exist!”) are being logged,
doesn't this mean that your pipeline execution is also failing?
2017-06-21 14:41 GMT+02:00 Giovanni GATTI PINHEIRO <