It depends I guess on your level of understanding. Honestly, it would be up to each individual
Regardless of knowledge, some people would be bothered by it and some wouldn't. It would obviously hurt someone who doesn't know the geography more than someone that does - hence why I found it difficult.
And I do have some knowledge...I'm not ignorant to the US layout - but state lines were lost on the map to me. The issue for me was particularly place names. I knew where Richmond "would be roughly", Washington, Baton Rouge, Montgomery. But other places too some time to search for. I can't remember the name of the place, but it took me at least 15 minutes to find it.
One last thing about the map was the central states. I found that confusing because they really were not distinguished on the map.
So the map was a block. Beautiful - but not overly helpful with regard to definition.
But lets not just blame the map for me boxing it back up. I was almost through the 20 page manual and I was lost. I don't think that was a problem with the manual but more about grand strategy games. I just didn't really know what I was doing.
I'm not selling it yet. I do want to get it back on the table and give it a go - but like I said, grand strategy might not be for me (so Empire of the Sun might join it if I do sell!)