Instead of creation of a new format, a possibility might be to extend OpenEXR to handle layers. LetterRip