Timothy Rupprecht, Sung-En Chang, Yushu Wu, Lei Lu, Enfu Nan, Chih-hsiang Li, Caiyue Lai, Zhimin Li, Zhijun Hu, Yumei He, David Kaeli, Yanzhi Wang
{"title":"数字头像:框架开发及其评估","authors":"Timothy Rupprecht, Sung-En Chang, Yushu Wu, Lei Lu, Enfu Nan, Chih-hsiang Li, Caiyue Lai, Zhimin Li, Zhijun Hu, Yumei He, David Kaeli, Yanzhi Wang","doi":"arxiv-2408.04068","DOIUrl":null,"url":null,"abstract":"We present a novel prompting strategy for artificial intelligence driven\ndigital avatars. To better quantify how our prompting strategy affects\nanthropomorphic features like humor, authenticity, and favorability we present\nCrowd Vote - an adaptation of Crowd Score that allows for judges to elect a\nlarge language model (LLM) candidate over competitors answering the same or\nsimilar prompts. To visualize the responses of our LLM, and the effectiveness\nof our prompting strategy we propose an end-to-end framework for creating\nhigh-fidelity artificial intelligence (AI) driven digital avatars. This\npipeline effectively captures an individual's essence for interaction and our\nstreaming algorithm delivers a high-quality digital avatar with real-time\naudio-video streaming from server to mobile device. Both our visualization\ntool, and our Crowd Vote metrics demonstrate our AI driven digital avatars have\nstate-of-the-art humor, authenticity, and favorability outperforming all\ncompetitors and baselines. In the case of our Donald Trump and Joe Biden\navatars, their authenticity and favorability are rated higher than even their\nreal-world equivalents.","PeriodicalId":501479,"journal":{"name":"arXiv - CS - Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Digital Avatars: Framework Development and Their Evaluation\",\"authors\":\"Timothy Rupprecht, Sung-En Chang, Yushu Wu, Lei Lu, Enfu Nan, Chih-hsiang Li, Caiyue Lai, Zhimin Li, Zhijun Hu, Yumei He, David Kaeli, Yanzhi Wang\",\"doi\":\"arxiv-2408.04068\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We present a novel prompting strategy for artificial intelligence driven\\ndigital avatars. To better quantify how our prompting strategy affects\\nanthropomorphic features like humor, authenticity, and favorability we present\\nCrowd Vote - an adaptation of Crowd Score that allows for judges to elect a\\nlarge language model (LLM) candidate over competitors answering the same or\\nsimilar prompts. To visualize the responses of our LLM, and the effectiveness\\nof our prompting strategy we propose an end-to-end framework for creating\\nhigh-fidelity artificial intelligence (AI) driven digital avatars. This\\npipeline effectively captures an individual's essence for interaction and our\\nstreaming algorithm delivers a high-quality digital avatar with real-time\\naudio-video streaming from server to mobile device. Both our visualization\\ntool, and our Crowd Vote metrics demonstrate our AI driven digital avatars have\\nstate-of-the-art humor, authenticity, and favorability outperforming all\\ncompetitors and baselines. In the case of our Donald Trump and Joe Biden\\navatars, their authenticity and favorability are rated higher than even their\\nreal-world equivalents.\",\"PeriodicalId\":501479,\"journal\":{\"name\":\"arXiv - CS - Artificial Intelligence\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.04068\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.04068","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Digital Avatars: Framework Development and Their Evaluation
We present a novel prompting strategy for artificial intelligence driven
digital avatars. To better quantify how our prompting strategy affects
anthropomorphic features like humor, authenticity, and favorability we present
Crowd Vote - an adaptation of Crowd Score that allows for judges to elect a
large language model (LLM) candidate over competitors answering the same or
similar prompts. To visualize the responses of our LLM, and the effectiveness
of our prompting strategy we propose an end-to-end framework for creating
high-fidelity artificial intelligence (AI) driven digital avatars. This
pipeline effectively captures an individual's essence for interaction and our
streaming algorithm delivers a high-quality digital avatar with real-time
audio-video streaming from server to mobile device. Both our visualization
tool, and our Crowd Vote metrics demonstrate our AI driven digital avatars have
state-of-the-art humor, authenticity, and favorability outperforming all
competitors and baselines. In the case of our Donald Trump and Joe Biden
avatars, their authenticity and favorability are rated higher than even their
real-world equivalents.