Fast bowler Chris Woakes, who was deemed a possible close contact of Moeen, was among those who tested negative but will continue to isolate in his room as a precaution.
Sri Lanka Cricket said the visitors will now be driven to their hotel, which will be off-limits to outsiders as part of strict local quarantine regulations.