I've always wanted do 'delete" them for years, as far as I ever knew, you can't delete them. Just move them to unused keys. Even if you change the config file, it'll default it out if something isn't conflicting anyway.
You can delete them by right clicking it, but it'll default when you restart graal.