Yes, you can retract it from a being a wiki 
but as @feyfayer found out if that was your first edit of a wiki to get the wiki editor badge, if you then remove it you also lose the wiki badge, it’s seem to know and keeps tabs which wiki it was and not just a case of give the badge out and that it, badge collected, done and dusted!