Manufactured homes are far more common in the areas of WI than you seem to realize....It is true that those in the Midwestern cities...Milwaukee, Chicago and a few others have old wives tails for impressions of manufactured homes...My own mother still lives in Chicago area and she cannot get the idea out of her head that all manufactured home owners are gypsies...
My only experience with in the area you are talking about was a trip last March from Chicago to Grand Forks, ND on the Amtrak...I made a special effort to observe the manufactured homes on the way..and saw many well appointed manufactured homes in the area you are mentioning...I was much more surprised at how many I saw between Chicago and Milwaukee..
I would suspect that when you get out into the areas you are looking in..you are seeing many manufactured homes that you do not even know are manufactured homes...Many of those I observed were set on ground level foundations with attached garages built on...Most really looked good..
The most important thing is to locate the home well...for your needs and for future resale....first thing to do is to learn a little about the area you want to move to...go there..drive around..spend the day...think about your needs...schools, job, churches, visits back to the city...do you want trees or open land...Check out the classifieds...call local real estate persons...ask folks in the area...talk to folks at work..
For mortgage info..go here and bookmark the site..
http://www.mtgprofessor.com/
Most important..you are doing the right thing...getting up to speed...learning and asking questions...
One thing that bothered me a little..you said.."let alone buying a house that I'm afraid will have problems down the road"...Everything you buy will require care and maintenence...if you buy that older brick home..you will be buying perpetual care...problems come with every home...actually manufactured homeowners are very satisfied in general...well over 85% never have any problems with their homes....
Stop back here often..