{"title":"Genetic Bottleneck and the Emergence of High Intelligence by Scaling-out and High Throughput","authors":"Arifa Khan, Saravanan P, Venkatesan S. K.","doi":"arxiv-2407.08743","DOIUrl":null,"url":null,"abstract":"We study the biological evolution of low-latency natural neural networks for\nshort-term survival, and its parallels in the development of low latency\nhigh-performance Central Processing Unit in computer design and architecture.\nThe necessity of accurate high-quality display of motion picture led to the\nspecial processing units known as the GPU, just as how special visual cortex\nregions of animals produced such low-latency computational capacity. The human\nbrain, especially considered as nothing but a scaled-up version of a primate\nbrain evolved in response to genomic bottleneck, producing a brain that is\ntrainable and prunable by society, and as a further extension, invents\nlanguage, writing and storage of narratives displaced in time and space. We\nconclude that this modern digital invention of social media and the archived\ncollective common corpus has further evolved from just simple CPU-based\nlow-latency fast retrieval to high-throughput parallel processing of data using\nGPUs to train Attention based Deep Learning Neural Networks producing\nGenerative AI with aspects like toxicity, bias, memorization, hallucination,\nwith intriguing close parallels in humans and their society. We show how this\npaves the way for constructive approaches to eliminating such drawbacks from\nhuman society and its proxy and collective large-scale mirror, the Generative\nAI of the LLMs.","PeriodicalId":501310,"journal":{"name":"arXiv - CS - Other Computer Science","volume":"47 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Other Computer Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.08743","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
We study the biological evolution of low-latency natural neural networks for
short-term survival, and its parallels in the development of low latency
high-performance Central Processing Unit in computer design and architecture.
The necessity of accurate high-quality display of motion picture led to the
special processing units known as the GPU, just as how special visual cortex
regions of animals produced such low-latency computational capacity. The human
brain, especially considered as nothing but a scaled-up version of a primate
brain evolved in response to genomic bottleneck, producing a brain that is
trainable and prunable by society, and as a further extension, invents
language, writing and storage of narratives displaced in time and space. We
conclude that this modern digital invention of social media and the archived
collective common corpus has further evolved from just simple CPU-based
low-latency fast retrieval to high-throughput parallel processing of data using
GPUs to train Attention based Deep Learning Neural Networks producing
Generative AI with aspects like toxicity, bias, memorization, hallucination,
with intriguing close parallels in humans and their society. We show how this
paves the way for constructive approaches to eliminating such drawbacks from
human society and its proxy and collective large-scale mirror, the Generative
AI of the LLMs.