Clemency board had second thoughts about releasing 'The Phantom'