In a bowl, combine brown sugar and flour. Cut in butter until crumbly. Stir in pecans; set aside.
In a large bowl, combine the flour, sugar, baking powder, nutmeg, allspice and salt. In another bowl, whisk the egg, orange juice, butter and orange zest. Stir into dry ingredients just until moistened. Fold in cranberries and raisins.
Transfer half of the batter to a greased 9x5-in. loaf pan. Sprinkle with half of the streusel; repeat layers.
Bake at 350° for 65-70 minutes or until a toothpick inserted in the center comes out clean. Cool for 10 minutes before removing from pan to a wire rack.