Place sweet potatoes in a large saucepan and cover with water. Bring to a boil. Reduce heat; cover and simmer for 12-18 minutes or until tender. Drain. Mash the sweet potatoes with the sugar, milk, butter, ginger, cinnamon and nutmeg.
Transfer to a greased 2-qt. baking dish. Cover and bake at 350° for 20 minutes or until heated through.
Combine the topping ingredients; sprinkle over potatoes. Bake, uncovered, for 5-10 minutes or until topping is lightly browned.