Time for the Devil's Advocate. Notice that the "colonel" is that in name only - no uniform - he's really a plantation owner. Plantation owners frequently had that title in some militia. (And, in fact, when the confederate armies were being formed, they often did end up with the rank.) Like it or not, many African Americans viewed the figure as a symbol of past slavery and repression. In addition, it was hurting their recruiting and had been for many years. All that being said, the connection to football is pretty marginal - it's really a political issue, so, off to NonSports...