With four goods

yes for 2 agents with general valuations, no for 3 agents with general valuations, no for 4 agents, even with additive valuations.

Open the “Competitive equilibrium for almost all incomes” section on Wikipedia →

Source: List of unsolved problems in fair division (CC BY-SA 4.0)