Milk Duds Dessert

6 egg yolks
1 cup granulated sugar
1 cup Rusk crumbs (9 biscuits)
1/2 cup chopped walnuts
1 teaspoon baking powder
1 teaspoon vanilla extract
6 egg whites
4 (1 ounce) packages Milk Duds