Luke Ronchi top-scored on 99, contributing to a New Zealand record 10th-wicket partnership of 74 with Trent Boult (21) after the Black Caps lost the toss and were sent in to bat.
South Africa's attack shared the honours, with Vernon Philander, Morne Morkel, Imran Tahir and Ryan McLaren all taking two wickets apiece.