Will GNGAN fail when modern activation funcitons like GELU are used in discriminator ?

[laodar]

"All the activation functions of network f are piecewise linear"
It appears that this restriction could significantly limit the method's ability to utilize advanced network architectures.