Tony Allen had an unfortunate return after missing four games