Hello Petar,
Unfortunately, this customization isn’t possible at the moment. I am really sorry!
I’ve added this idea to the Wishlist and if it gets more votes, we’ll try to consider it in the future updates: Make Phone field optional when form completion is required before agent's response