Mahela Jayawardene was batting on 53 and skipper Angelo Mathews was yet to open his account.
South Africa won the opening Test in Galle by 153 runs to go 1-0 up in the two-Test series.