Sweet Potato Fudge

2 cups granulated sugar
1/2 cup whole milk
1/4 teaspoon pumpkin pie spice
1/4 cup mashed cold sweet potato or canned pumpkin
1/2 cup (1 stick) butter, cut up (no substitutions)
1 cup Marshmallow Cr