{"title":"A survey on multimodal large language models.","authors":"Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, Enhong Chen","doi":"10.1093/nsr/nwae403","DOIUrl":"10.1093/nsr/nwae403","url":null,"abstract":"<p><p>Recently, the multimodal large language model (MLLM) represented by GPT-4V has been a new rising research hotspot, which uses powerful large language models (LLMs) as a brain to perform multimodal tasks. The surprising emergent capabilities of the MLLM, such as writing stories based on images and optical character recognition-free math reasoning, are rare in traditional multimodal methods, suggesting a potential path to artificial general intelligence. To this end, both academia and industry have endeavored to develop MLLMs that can compete with or even outperform GPT-4V, pushing the limit of research at a surprising speed. In this paper, we aim to trace and summarize the recent progress of MLLMs. First, we present the basic formulation of the MLLM and delineate its related concepts, including architecture, training strategy and data, as well as evaluation. Then, we introduce research topics about how MLLMs can be extended to support more granularity, modalities, languages and scenarios. We continue with multimodal hallucination and extended techniques, including multimodal in-context learning, multimodal chain of thought and LLM-aided visual reasoning. To conclude the paper, we discuss existing challenges and point out promising research directions.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"11 12","pages":"nwae403"},"PeriodicalIF":16.3,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11645129/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142828958","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
National Science ReviewPub Date : 2024-11-12eCollection Date: 2024-12-01DOI: 10.1093/nsr/nwae390
Ze He, Michael De Volder
{"title":"MoO<sub>2.8</sub>F<sub>0.2</sub>/MoO<sub>2.4</sub>F<sub>0.6</sub> heterostructures for high-rate magnesium-ion battery cathodes.","authors":"Ze He, Michael De Volder","doi":"10.1093/nsr/nwae390","DOIUrl":"10.1093/nsr/nwae390","url":null,"abstract":"","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"11 12","pages":"nwae390"},"PeriodicalIF":16.3,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11630285/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142807299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Building electrode/electrolyte interphases in aqueous zinc batteries via self-polymerization of electrolyte additives.","authors":"Yaheng Geng, Wenli Xin, Lei Zhang, Yu Han, Huiling Peng, Min Yang, Hui Zhang, Xilin Xiao, Junwei Li, Zichao Yan, Zhiqiang Zhu, Fangyi Cheng","doi":"10.1093/nsr/nwae397","DOIUrl":"10.1093/nsr/nwae397","url":null,"abstract":"<p><p>Aqueous zinc batteries offer promising prospects for large-scale energy storage, yet their application is limited by undesired side reactions at the electrode/electrolyte interface. Here, we report a universal approach for the <i>in situ</i> building of an electrode/electrolyte interphase (EEI) layer on both the cathode and the anode through the self-polymerization of electrolyte additives. In an exemplified Zn||V<sub>2</sub>O<sub>5</sub>·nH<sub>2</sub>O cell, we reveal that the glutamate additive undergoes radical-initiated electro-polymerization on the cathode and polycondensation on the anode, yielding polyglutamic acid-dominated EEI layers on both electrodes. These EEI layers effectively mitigate undesired interfacial side reactions while enhancing reaction kinetics, enabling Zn||V<sub>2</sub>O<sub>5</sub>·nH<sub>2</sub>O cells to achieve a high capacity of 387 mAh g<sup>-1</sup> at 0.2 A g<sup>-1</sup> and maintain >96.3% capacity retention after 1500 cycles at 1 A g<sup>-1</sup>. Moreover, this interphase-forming additive exhibits broad applicability to varied cathode materials, encompassing VS<sub>2</sub>, VS<sub>4</sub>, VO<sub>2</sub>, α-MnO<sub>2</sub>, β-MnO<sub>2</sub> and δ-MnO<sub>2</sub>. The methodology of utilizing self-polymerizable electrolyte additives to construct robust EEI layers opens a novel pathway in interphase engineering for electrode stabilization in aqueous batteries.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"12 1","pages":"nwae397"},"PeriodicalIF":16.3,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11740509/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143008574","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
National Science ReviewPub Date : 2024-11-08eCollection Date: 2024-11-01DOI: 10.1093/nsr/nwae381
Li Wang, Bo Zhang, Xiqian Lu, Ruidi Wang, Jian Ma, Yujie Chen, Yuan Zhou, Ji Dai, Yi Jiang
{"title":"Genetic and neuronal basis for facial emotion perception in humans and macaques.","authors":"Li Wang, Bo Zhang, Xiqian Lu, Ruidi Wang, Jian Ma, Yujie Chen, Yuan Zhou, Ji Dai, Yi Jiang","doi":"10.1093/nsr/nwae381","DOIUrl":"10.1093/nsr/nwae381","url":null,"abstract":"<p><p>The ability to rapidly recognize basic facial emotions (e.g. fear) is crucial for social interactions and adaptive functioning. To date, the origin of facial-emotion-recognition ability remains equivocal. Using a classical twin design in humans, we found a clear dissection of low and high spatial frequencies (LSF and HSF) in facial emotion perception: whereas genetic factors contributed to individual variation in LSF processing, HSF processing is largely shaped by environmental effects. Furthermore, the ability to recognize facial emotions of LSF content genetically correlated with the function of the amygdala. Crucially, single-unit recording of the amygdala in macaques further revealed the dissociation between LSF and HSF processing in facial emotion perception, indicating the existence of an evolutionarily conserved mechanism. This cross-species study enhances insights into the neurobiological dual-route model (subcortical vs. cortical) of emotion perception and illuminates the origin and the functional development of the emotional brain in primates.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"11 11","pages":"nwae381"},"PeriodicalIF":16.3,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11614104/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142770583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bio-inspired carbon-based artificial muscle with precise and continuous morphing capabilities.","authors":"Xiaodong Li, Meiping Li, Mingjia Zhang, Qin Liu, Deyi Zhang, Wenjing Liu, Xingru Yan, Changshui Huang","doi":"10.1093/nsr/nwae400","DOIUrl":"10.1093/nsr/nwae400","url":null,"abstract":"<p><p>In the face of advancements in microrobotics, intelligent control and precision medicine, artificial muscle actuation systems must meet demands for precise control, high stability, environmental adaptability and high integration miniaturization. Carbon materials, being lightweight, strong and highly conductive and flexible, show great potential for artificial muscles. Inspired by the butterfly's proboscis, we have developed a carbon-based artificial muscle, hydrogen-substituted graphdiyne muscle (HsGDY-M), fabricated efficiently using an emerging hydrogen-substituted graphdiyne (HsGDY) film with an asymmetrical surface structure. This muscle features reversible, rapid and continuously adjustable deformation capabilities similar to the butterfly's proboscis, triggered by the conversion of carbon bonds. The size of the HsGDY-M can be tuned by changing the HsGDY film width from ∼1 cm to 100 μm. Our research demonstrates HsGDY-M's stability and adaptability, maintaining performance at temperatures as low as -25°C. This artificial muscle was successfully integrated into a robotic mechanical arm, allowing it to swiftly adjust its posture and lift objects up to 11 times its own weight. Its beneficial responsiveness is transferable, enabling the transformation of 'inert' objects like copper foil into actuators via surface bonding. Because of its super sensitive and rapid deformation, HsGDY-M was applied to create a real-time tracking system for human finger bending movements, achieving real-time simulation and large-hand-to-small-hand control. Our study indicates that HsGDY-M holds significant promise for advancing smart robotics and precision medicine.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"12 1","pages":"nwae400"},"PeriodicalIF":16.3,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11702649/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143008571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Integrative study of lung cancer adeno-to-squamous transition in EGFR TKI resistance identifies RAPGEF3 as a therapeutic target.","authors":"Hua Wang, Shijie Tang, Qibiao Wu, Yayi He, Weikang Zhu, Xinyun Xie, Zhen Qin, Xue Wang, Shiyu Zhou, Shun Yao, Xiaoling Xu, Chenchen Guo, Xinyuan Tong, Shuo Han, Yueh-Hung Chou, Yong Wang, Kwok-Kin Wong, Cai-Guang Yang, Luonan Chen, Liang Hu, Hongbin Ji","doi":"10.1093/nsr/nwae392","DOIUrl":"10.1093/nsr/nwae392","url":null,"abstract":"<p><p>Although adeno-to-squamous transition (AST) has been observed in association with resistance to epidermal growth factor receptor (EGFR) tyrosine kinase inhibitor (TKI) in clinic, its causality, molecular mechanism and overcoming strategies remain largely unclear. We here demonstrate that squamous transition occurs concomitantly with TKI resistance in PC9-derived xenograft tumors. Perturbation of squamous transition via DNp63 overexpression or knockdown leads to significant changes in TKI responses, indicative of a direct causal link between squamous transition and TKI resistance. Integrative RNA-seq, ATAC-seq analyses and functional studies reveal that FOXA1 plays an important role in maintaining adenomatous lineage and contributes to TKI sensitivity. FOXM1 overexpression together with FOXA1 knockout fully recapitulates squamous transition and TKI resistance in both PC9 xenografts and patient-derived xenograft (PDX) models. Importantly, pharmacological inhibition of RAPGEF3 combined with EGFR TKI efficiently overcomes TKI resistance, especially in RAPGEF3<sup>high</sup> PDXs. Our findings provide novel mechanistic insights into squamous transition and therapeutic strategy to overcome EGFR TKI resistance in lung cancer.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"11 12","pages":"nwae392"},"PeriodicalIF":16.3,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11647589/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142837807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
National Science ReviewPub Date : 2024-11-07eCollection Date: 2024-12-01DOI: 10.1093/nsr/nwae398
Ismael Torres-Romero, Bertrand Légeret, Marie Bertrand, Damien Sorigue, Alicia Damm, Stéphan Cuiné, Florian Veillet, Carla Blot, Sabine Brugière, Yohann Couté, Matthew G Garneau, Hari K Kotapati, Yi Xin, Jian Xu, Philip D Bates, Abdou R Thiam, Fred Beisson, Yonghua Li-Beisson
{"title":"α/β hydrolase domain-containing protein 1 acts as a lysolipid lipase and is involved in lipid droplet formation.","authors":"Ismael Torres-Romero, Bertrand Légeret, Marie Bertrand, Damien Sorigue, Alicia Damm, Stéphan Cuiné, Florian Veillet, Carla Blot, Sabine Brugière, Yohann Couté, Matthew G Garneau, Hari K Kotapati, Yi Xin, Jian Xu, Philip D Bates, Abdou R Thiam, Fred Beisson, Yonghua Li-Beisson","doi":"10.1093/nsr/nwae398","DOIUrl":"10.1093/nsr/nwae398","url":null,"abstract":"<p><p>Lipid droplets (LDs) are the major sites of lipid and energy homeostasis. However, few LD biogenesis proteins have been identified. Using model microalga <i>Chlamydomonas</i>, we show that ABHD1, an α/β-hydrolase domain-containing protein, is localized to the LD surface and stimulates LD formation through two actions: one enzymatic and one structural. The knockout mutants contained similar amounts of triacylglycerols (TAG) but their LDs showed a higher content of lyso-derivatives of betaine lipid diacylglyceryl-<i>N,N,N</i>-trimethylhomoserine (DGTS). Over-expression of <i>ABHD1</i> increased LD abundance and boosted TAG content. Purified recombinant ABHD1 hydrolyzed lyso-DGTS, producing a free fatty acid and a glyceryltrimethylhomoserine. <i>In vitro</i> droplet-embedded vesicles showed that ABHD1 promoted LD emergence. Taken together, these results identify ABHD1 as a new player in LD formation by its lipase activity on lyso-DGTS and by its distinct biophysical property. This study further suggests that lipases targeted to LDs and able to act on their polar lipid coat may be interesting tools to promote LD assembly in eukaryotic cells.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"11 12","pages":"nwae398"},"PeriodicalIF":16.3,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11711679/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142951057","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robust dioxin-linked metallophthalocyanine tbo topology covalent organic frameworks and their photocatalytic properties.","authors":"Yucheng Jin, Qianjun Zhi, Hailong Wang, Xiaoning Zhan, Dongdong Qi, Baoqiu Yu, Xu Ding, Tianying Wang, Heyuan Liu, Mingxue Tang, Jie Liu, Jianzhuang Jiang","doi":"10.1093/nsr/nwae396","DOIUrl":"10.1093/nsr/nwae396","url":null,"abstract":"<p><p>Constructing 3D functional covalent organic frameworks (COFs) with both robust linkage and planar macrocycle building blocks still remains a challenge due to the difficulty in adjusting both the crystallinity and the dominant 2D structures. In addition, it is also challenging to selectively convert inert C(sp<sup>3</sup>)-H bonds into value-added chemicals. Herein, robust 3D COFs, USTB-28-M (M=Co, Ni, Cu), have been polymerized from the nucleophilic aromatic substitution reaction of <i>D</i> <sub>3h</sub>-symmetric 2,3,6,7,14,15-hexahydroxyltriptycene with <i>D</i> <sub>4h</sub>-symmetric hexadecafluorophthalocyanine (MPcF<sub>16</sub>) under solvothermal conditions. These chemically stable dioxin-linked COFs show isostructural <b>tbo</b> topology made up of three kinds of polyhedron subunits, exhibiting high Brunauer-Emmett-Teller surface areas of ≤1477 m<sup>2</sup> g<sup>-1</sup>. In particular, the multiple polyhedron subunits in USTB-28-M could trap <i>N</i>-hydroxyphthalimide at their corners for easily forming stable phthalimide-<i>N</i>-oxyl radicals under visible-light irradiation. The generated radicals efficiently promote the aerobic oxidation of alkyl benzenes with an inert C(sp<sup>3</sup>)-H bond into various ketones. Among the three investigated COFs, the USTB-28-Co radical initiator exhibits the best photocatalytic oxidation activity, converting ethylbenzene into acetophenone with a turnover frequency of 63 h<sup>-1</sup>, which is much higher than those of the monomer CoPcF<sub>16</sub> (8 h<sup>-1</sup>) and 2D dioxin-linked counterparts (13 h<sup>-1</sup>). This is due to the much prolonged lifetime of the excited state for USTB-28-Co based on the femtosecond transient absorption result. The present work not only presents 3D functional COFs with robust connection and permanent porosity, but also illustrates the uniqueness of porous structures of 3D COFs for high-performance photocatalysis.</p>","PeriodicalId":18842,"journal":{"name":"National Science Review","volume":"12 1","pages":"nwae396"},"PeriodicalIF":16.3,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11740510/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143008611","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}