If you're into wine, then Humble Grape (Battersea Rise) is definitely worth a visit either for a tasting or to try whatever you fancy. They sometimes have pianists there downstairs too which is good for a date night.
And also Vagabond (Northcote Rd) which is really fun as you get a card and top up your own tab to help yourself to wines. Either a taste, small or large glass sizes I think. Food too.
The new Little Bird Cocktail place def does good food and non-alcoholic cocktails that I've sampled but bet the other real cocktails are excellent too (breastfeeding I can't sample them yet