Cut each potato into eight pieces and cook in boiling water until tender. Drain and set aside to cool slightly. Mix the milk, mustard, vinegar and sugar together in a small bowl to make a dressing. When the potatoes have cooled, pour over enough dressing to coat the potatoes. Add mayonaise to taste. Chill in the fridge for a couple of hours before serving.