Well, Feanor and the elves managed to leave, and Morgoth before them, so as far as I understand leaving is not only possible but also permitted by the Valar. It's just that only immortals and ring-bearers aren't allowed to enter by the Third Age.

@DanDaSolo thank you!

Yeah I’m so confused about the Undying Lands