A full house of around 7,000 was in attendance at the P. Sara Oval to watch the fifth-highest run-getter in Test history play for the last time as Sri Lanka chased a tough victory target of 413.
Sangakkara did not have to wait long in the dressing room after Sri Lanka lost opener Kaushal Silva in the third over, tapping a full toss from Ravichandran Ashwin to the short mid-wicket fielder.
The crowd applauded warmly as Sangakkara was welcomed to the crease by two guards of honour -- one formed by young children with raised bats near the boundary and another by Indian fielders.
The left-hander began by flicking the first ball from Ashwin for two runs and then clipped seamer Ishant Sharma off the pads for his first boundary.
Sangakkara hit two more fours but fell to Ashwin for the fourth time in as many innings in the series when he edged a catch to Murali Vijay off the 18th ball he faced.
The Indian fielders shook hands with Sangakkara as he walked off for one last time to a standing ovation from the stands.
Sangakkara finished with 12,400 runs from 134 Tests at an average of 57.40. He scored 38 centuries including a best of 319 against Bangladesh in Chittagong last year.
Sangakkara follows Sachin Tendulkar of India, Ricky Ponting of Australia, Jacques Kallis of South Africa and Rahul Dravid of India in the all-time list of leading Test scorers.