Preheat the oven to 350 degrees. Grease a loaf pan.
In a large mixing bowl, mix the butter, sugars, eggs, sour cream, milk and vanilla.
Slowly mix in the flour, baking soda, baking powder, nutmeg and salt.
Next mix in the mashed bananas and pineapple.
Pour the batter into a greased loaf pan.
Bake for 60 to 70 minutes or until the sides are golden brown and a toothpick inserted in the center comes out clean.
Cool on a rack before slicing.