In a saucepan, combine the water, tea bags and spices. Bring to a boil, then simmer gently for 5 minutes.
Meanwhile, warm up the coconut milk and vanilla until hot. If you have a frother (or even an immersion blender), use it to froth the hot coconut milk.
Strain the tea to remove the tea bags and spices.
Divide the tea between 2 large mugs or 4 small coffee cups, then top with the frothed coconut milk. Garnish with cinnamon sticks, star anise and a sprinkling of ground vanilla bean powder.
Sweeten as desired with honey, maple syrup, sugar, or another sweetener of your choice.