While it MAY work out, the odds are vastly against you.

You are no longer "loyal", you have already extorted money from them, you will never be trusted again. Your boss' job (no matter how "nice" he is) is to transfer your responsibilities to someone else and then cause you enough pain to make you want to leave.

Do NOT leave on his terms, leave on yours.