Zoe Garifallou wore a tight brown dress during her trip to Japan