The Nikkei was down 3.19 percent, or 668.69 points, at 20,319.23 in late afternoon trade, while the broader Topix index dropped 2.59 percent, or 40.37 points, at 1,515.78.