Yes, it could be a very charming little downtown with a little fixing up. Also I bet if it was fixed up similar to the examples I had links to, you would see a increase in new business that might want to open up there.
Just because your little and not the county seat, doesn't mean you can't have a booming little town.