South Sudan's government and rebels have finally begun formal peace talks in Addis Ababa aimed at ending more than three weeks of unrest, Ethiopia's government spokesman said Monday.