The incident on Wednesday is one of the deadliest disasters this year among migrants trying to make the perilous journey to Europe.
The boat carrying at least 150 people had been low on fuel while approaching Mauritania, the International Organization for Migration said in a statement.
The UN agency said 83 people swam to shore, with survivors being helped by Mauritanian authorities in the northern city of Nouadhibou.