I think the problem is that it is recessed. If you look at any of the third party adapters you can see the issue.
For instance, the bit between the metal and the gray plastic of this belkin adapter... all of that light colored bit is apparently recessed.
Here's another example in chrome...
BTW, the size of the jack is 3.5 mm. (images from ilounge reviews)