Place the sweetened condensed milk in a large bowl. Use a hand mixer to mix in the vanilla extract and peanut butter. Fold in the Cool Whip and the brownie chunks.Place ice cream mixture in an airtight container. Freeze for at least 4 hours or overnight.Serve alone, or as a brownie sundae!