Preheat the oven to 350°F and line a muffin pan with 12 paper liners.
Whisk together the almond flour, 5 tablespoons powdered erythritol, cinnamon, baking soda, and salt in a medium mixing bowl.
In a separate bowl, whisk together the butter, cream cheese, eggs, and 1 teaspoon vanilla until smooth.
Stir the wet ingredients into the dry until just combined.
Spoon the batter into the prepared pan then bake for 14 to 17 minutes until a knife inserted in the center comes out clean.
Cool the cupcakes in the pan for 5 minutes then remove to a wire rack and cool completely.
Whisk together the almond milk, coconut oil, and the remaining vanilla extract in a small bowl.
Add the remaining erythritol a tablespoon at a time, whisking until you have a nice glaze.
Drizzle the glaze over the cooled cupcakes and set aside to set.