An AI Based Enhanced and Customized Doodler-Bot with Vector Mutation And Clustering

Ilisha Walia, Mayank Mangla, Manjula Gupta, Ankita Dixit
{"title":"An AI Based Enhanced and Customized Doodler-Bot with Vector Mutation And Clustering","authors":"Ilisha Walia, Mayank Mangla, Manjula Gupta, Ankita Dixit","doi":"10.1109/ECAI58194.2023.10194201","DOIUrl":null,"url":null,"abstract":"Currently high usage of smart phone is observed in millennials for learning, playing games or drawing. Drawing being quite popular among all age groups of people, still the most generic problem faced is the fear to draw neatly and correctly. We have tried to make drawing experience more innovative and effective by proposing a unique AI based Doodler-Bot which will help people of all age groups to improve their drawing skills. There exists some way through which the user's sketch can be improved by replacing it with the professionally drawn sketch stored in database, but by doing this the user's originality of sketch is lost. Our proposed work will help user in drawing better sketches by generating new and unique sketches which are better version of user's sketch. Whenever user draws a sketch, the application would first predict the class of sketch and then the generator model will be used to generate new sketches depending on user's sketch and display all similar suggestions to user as output. The results are improvised in comparison to existing Sketch RNN model. First, by modifying the model architecture i.e. by mutating the latent space of user sketch with similar latent space of sketches available in cluster data. Secondly, the model is also trained on improvised dataset (Quick draw dataset and Newly generated dataset). New dataset is generated by converting the SVG format images to the stroke format as required by model for training. The proposed AI based Doodler-Bot will intelligently guide and improve the drawing skills of the person.","PeriodicalId":391483,"journal":{"name":"2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ECAI58194.2023.10194201","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Currently high usage of smart phone is observed in millennials for learning, playing games or drawing. Drawing being quite popular among all age groups of people, still the most generic problem faced is the fear to draw neatly and correctly. We have tried to make drawing experience more innovative and effective by proposing a unique AI based Doodler-Bot which will help people of all age groups to improve their drawing skills. There exists some way through which the user's sketch can be improved by replacing it with the professionally drawn sketch stored in database, but by doing this the user's originality of sketch is lost. Our proposed work will help user in drawing better sketches by generating new and unique sketches which are better version of user's sketch. Whenever user draws a sketch, the application would first predict the class of sketch and then the generator model will be used to generate new sketches depending on user's sketch and display all similar suggestions to user as output. The results are improvised in comparison to existing Sketch RNN model. First, by modifying the model architecture i.e. by mutating the latent space of user sketch with similar latent space of sketches available in cluster data. Secondly, the model is also trained on improvised dataset (Quick draw dataset and Newly generated dataset). New dataset is generated by converting the SVG format images to the stroke format as required by model for training. The proposed AI based Doodler-Bot will intelligently guide and improve the drawing skills of the person.
一种基于人工智能的矢量突变和聚类增强自定义涂鸦机器人
目前,千禧一代在学习、玩游戏或画画方面使用智能手机的比例很高。绘画在各个年龄段的人中都很受欢迎,但最普遍的问题仍然是害怕画得整齐和正确。我们试图通过提出一个独特的基于人工智能的涂鸦机器人,使绘画体验更具创新性和有效性,这将帮助所有年龄段的人提高他们的绘画技能。存在一些方法可以通过将用户的草图替换为存储在数据库中的专业绘制的草图来改进用户的草图,但这样做会失去用户的草图原创性。我们提出的工作将通过生成新的和独特的草图来帮助用户绘制更好的草图,这些草图是用户草图的更好版本。当用户绘制草图时,应用程序首先预测草图的类别,然后使用生成器模型根据用户的草图生成新的草图,并将所有类似的建议作为输出显示给用户。结果与现有的Sketch RNN模型进行了比较。首先,通过修改模型架构,即将用户草图的潜在空间与聚类数据中可用草图的相似潜在空间进行突变。其次,在临时数据集(快速绘制数据集和新生成数据集)上训练模型。根据训练模型的需要,将SVG格式的图像转换为笔画格式,生成新的数据集。提出的基于人工智能的涂鸦机器人将智能地指导和提高人们的绘画技能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信