Penny isn’t thrown by Walky’s line in that last panel.  She’s just wondering why he has Joyce-style eyes.