Yes, you can turn public document sharing on or off any document at any time. Public documents that are turned off will become immedaitely unavailable to anyone via the public URL.