Injuries derailed Robert Swift’s career, leaving Ray Allen impatient with the young center’s lack of progress.