Violence between Buddhists and Muslims in southern Sri Lanka has left three people dead and at least another 78 seriously injured, the justice minister said Monday.