Khurram Manzoor was the batsman out in the last over of the morning session, edging spinner Rangana Herath to the wicket-keeper after making 23.
Ahmed Shehzad was unbeaten on 21 and Azhar Ali had yet to score.
Earlier, Sri Lanka were dismissed for 320 in their first innings 45 minutes before lunch after the last two wickets added 59 runs to the overnight score of 261-8.
Number 11 batsman Chanaka Welegedara returned unbeaten on 27.
Opener Upul Tharanga top-scored for Sri Lanka with 92. Left-arm seamers Junaid Khan (five for 87) and Wahab Riaz (3-88) shared eight wickets.
Sri Lanka lead 1-0 in the two-match series after winning the first Test in Galle by seven wickets.