Heat the oven to 350°F. Line two baking sheets with parchment paper.
Whisk the flour, baking powder, 1/2 teaspoon nutmeg and salt in a medium bowl.
Beat the butter and sugar with an electric mixer until light and fluffy, about 2 minutes. Beat in the egg, then the 1/3 cup eggnog and vanilla; the mixture may look slightly curdled.
Add the dry ingredients in two additions and mix on low just until no dry streaks remain. The dough will be soft.
Drop rounded tablespoons of dough 2 inches apart on the prepared sheets and sprinkle lightly with nutmeg. Bake 10 to 12 minutes, rotating the sheets halfway through, until the edges are set and the bottoms are lightly golden. Cool on the sheets 5 minutes, then transfer to a wire rack.
Whisk the powdered sugar with 2 tablespoons eggnog until smooth, adding up to 1 tablespoon more for a thick drizzle. Drizzle over the cooled cookies and let set about 10 minutes.