"There have been tensions which targeted both refugees and members of the humanitarian community," said Katerina Kitidi, a Greece-based communications officer for the United Nations refugee agency (UNHCR).
Clashes first broke out in the camp on Thursday due to rising anger over the Greek government's asylum application process, which has moved at a snail's pace and left more than 8,400 refugees and migrants stuck waiting on Greek islands.
On Saturday, with the internal tensions in the camp sparking fear, a group of around 150 mostly Iraqi Yezidis decided to leave the camp and head to the island's main port in Lakki.
Once in the village, they were confronted and attacked by a group of Greek men, she recalled, adding that police only intervened to force the refugees to walk back to the camp. While driving back to the camp, she then received a phone call and was told to leave the island.
Once near the camp's entrance, a group of about 50 locals with shovels and sticks blocked the road. "They stopped our car and started hitting it," she said.
"They told us to get off the island. They said if we didn't get the first boat off the island something terrible would happen. It was scary. The only reason we left the island was because the police weren't moving at all to help."