Yeah, kind of. Other people can fight them off, but they'll just keep coming back somewhere else if you don't use a Keyblade.

[roxas barely understands how it works too, let's be real here.]