You have a shovel. You could be shoveling more dirt out of the hole, you could be shoveling dirt back into the hole, or you could just be standing there leaning on the shovel.

If you are shoveling dirt out of the hole and then stop, are you now filling the hole back in?