I have tried to change my account image to the default one, but the default image is located in the hidden folder
C:\ProgramData\Microsoft\Default Account Pictures
I have changed the settings and I can see this folder from Windows Explorer but not in the modern UI. So it was not possible to change the picture to the default.