To reduce computational efforts, surrogate models have been developed for dune erosion prediction. Current surrogate models can describe the relationship between the XBeach input and output (Athanasiou, 2022) and provides a prediction of a morphological indicator based on a parameterized input (profile shape parameters and hydrodynamics). In this research, first steps are taken to set-up a surrogate model that is able to deal with spatial input and the prediction of actual profile shapes along the Holland Coast. Using a convolutional neural network structure (U-Net), several model set-ups are explored and scaled-up to a realistic storm scenario along the Holland Coast.