Cacao Fruit, along with Comrade Emblems, are needed for the Legion Storage Slot Expansion Hidden quest.
This quest is used to unlock Legion Storage slots for storing Legion mercenaries. You can earn Cacao Fruit via daily quests from NPC Mr. Camaraderie in Rome.