Preheat the oven to 400 degrees Fahrenheit
Add the goat cheese to a mixing bowl, then stir in salt and black pepper to taste.
Place the pickled cherry peppers on an aluminum covered baking sheet, then fill each chili pepper with the goat cheese mix.
Place the baking sheet in the oven and bake the cherry peppers for 12 to 15 minutes, until the cheese has very lightly browned.
Remove the baking sheet from the oven and allow the peppers to cool for 5 minutes, then serve.