Changed runcheckdir so that failure and success only trigger once per change