Thursday's data on US jobless claims and first-quarter gross domestic product growth also helped extend Treasury yields. Both reports showed the US economy was on a stable path to recovery from the pandemic.
Investors are also awaiting the Treasury's sale of $62 billion in 7-year debt later on Thursday, after strong 2-year and 5-year note auctions on Tuesday and Wednesday.
"Right now it's month-end rebalancing," said Ian Lyngen, head of US rates strategy at BMO Capital Markets in New York, noting the next major market catalyst will be next Friday's jobs report for April.
The yields fell back down in the afternoon, however, and are now trading in the middle of their recent range.