CELL-E 2: Translating proteins to pictures and back with a bidirectional text-to-image transformer Conference Paper


Authors: Khwaja, E.; Song, Y. S.; Agarunov, A.; Huang, B.
Title: CELL-E 2: Translating proteins to pictures and back with a bidirectional text-to-image transformer
Conference Title: 2023 Conference on Neural Information Processing Systems (NeurIPS)
Abstract: We present CELL-E 2, a novel bidirectional transformer that can generate images depicting protein subcellular localization from the amino acid sequences (and vice versa). Protein localization is a challenging problem that requires integrating sequence and image information, which most existing methods ignore. CELL-E 2 extends the work of CELL-E, not only capturing the spatial complexity of protein localization and produce probability estimates of localization atop a nucleus image, but also being able to generate sequences from images, enabling de novo protein design. We train and finetune CELL-E 2 on two large-scale datasets of human proteins. We also demonstrate how to use CELL-E 2 to create hundreds of novel nuclear localization signals (NLS). Results and interactive demos are featured at https://bohuanglab.github.io/CELL-E_2/. © 2023 Neural information processing systems foundation. All rights reserved.
Journal Title Advances in Neural Information Processing Systems
Volume: 36
Conference Dates: 2023 Dec 10-16
Conference Location: New Orleans, LA
ISBN: 1049-5258
Publisher: Neural Information Processing Systems Foundation  
Date Published: 2023-01-01
Language: English
PROVIDER: scopus
DOI/URL:
Notes: Conference paper -- Source: Scopus