Catalogic Software Inc. is selling off its flagship business to IBM Corp. to concentrate its resources on what it believes is a bigger opportunity in the cloud.