In a medium pot, stir together all the ingredients except the milk and vanilla.
Add in the milk and vanilla and bring to a boil over high heat.
Once boiling, reduce the heat to medium and simmer until it just begins to thicken, about 1 - 1 1/2 minutes. It will thicken a lot as it cools so don't over cook.