Overall, Patton may be just too small for a team like LSU or Alabama, who are more powerhouse teams
Don't count out LSU by any stretch. They have ground it out lately, but Crowton is a spread guy who wants to air it out, and if he can get the personnel he will do just that. Personnel limitations and injuries -- Flynn's ankle / shoulder injury in 2007, and the horrid QB play in 2008 -- have kept him from really doing that, but make no mistake that is what he wants to do. Moreover, I imagine that LSU will try to sell him on using him in a role similar to Trindon Holliday, who will be a senior this season. They'll use him in the return game and as a gimmick guy on offense.
Furthermore, do you really think Miles would be able to pass on Patton if he really wanted LSU? I think Hell would freeze over before Miles would pass on a chance to go into a hotbed recruiting area, plus Nick Saban territory, and "steal" one away from the ol' Nicktator. If Patton wants LSU, I'd bet the farm they will snap him up immediately.
If he won't even be in attendance at A-Day, that's a good sign that our staff has pulled back on contacting him considerably. I mean we have guys flying in from Michigan all excited for A-Day

I was really hoping we would land this kid after watching his film, but I must admit he fits into UF's offense much better than our own. C'est la vie in the recruiting game, you can only sign so many.
Again, don't underestimate the A-Day deal. As you mentioned, we literally have kids who are considered locks for other schools coming in from across the country, on their own dime, to see Tuscaloosa and the A-Day game. And now this in-state kid is going to instead go to Baton Rouge to watch 20,000 people show up to see some bad QB play and a bunch of drunk Cajuns eating mudbugs by the bushel? Again, that ought to tell you all you need to know.
As for Florida, I'm not sure Patton is a huge priority for them either. He clearly fits well into their scheme, and of course Meyer would love getting another kid out of Mobile, but they already have a plethora of similar guys. Andre Debose was a five-star last year who was recruited for that role, and they still have guys like Rainey and Demps to play that role. Moreover, Jaylen Watkins just committed in the 2010 class a couple of days ago, and he is largely going to play that same role.
All told, I'm just not sure he's a big priority for the Gators. They may take him, but I really do not see him being "the" guy for them. The Harvin role in that offense moving forward, I think, will be dominated by Rainey, Demps, Debose, and Watkins. Patton would probably have a hard time just getting on the field in Gainesville.
Personally, I think the smart money is probably on LSU right now.