Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications最新文献

FastHebb: Scaling Hebbian Training of Deep Neural Networks to ImageNet Level FastHebb:将深度神经网络的Hebbian训练扩展到ImageNet级别

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-07-07 DOI: 10.48550/arXiv.2207.03172

Gabriele Lagani, C. Gennaro, Hannes Fassold, G. Amato

{"title":"FastHebb: Scaling Hebbian Training of Deep Neural Networks to ImageNet Level","authors":"Gabriele Lagani, C. Gennaro, Hannes Fassold, G. Amato","doi":"10.48550/arXiv.2207.03172","DOIUrl":"https://doi.org/10.48550/arXiv.2207.03172","url":null,"abstract":"Learning algorithms for Deep Neural Networks are typically based on supervised end-to-end Stochastic Gradient Descent (SGD) training with error backpropagation (backprop). Backprop algorithms require a large number of labelled training samples to achieve high performance. However, in many realistic applications, even if there is plenty of image samples, very few of them are labelled, and semi-supervised sample-efficient training strategies have to be used. Hebbian learning represents a possible approach towards sample efficient training; however, in current solutions, it does not scale well to large datasets. In this paper, we present FastHebb, an efficient and scalable solution for Hebbian learning which achieves higher efficiency by 1) merging together update computation and aggregation over a batch of inputs, and 2) leveraging efficient matrix multiplication algorithms on GPU. We validate our approach on different computer vision benchmarks, in a semi-supervised learning scenario. FastHebb outperforms previous solutions by up to 50 times in terms of training speed, and notably, for the first time, we are able to bring Hebbian algorithms to ImageNet scale.","PeriodicalId":90051,"journal":{"name":"Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications","volume":"294 1","pages":"251-264"},"PeriodicalIF":0.0,"publicationDate":"2022-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75684465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Causal Disentanglement with Network Information for Debiased Recommendations 基于网络信息的无偏见推荐因果解纠集

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-04-14 DOI: 10.48550/arXiv.2204.07221

Paras Sheth, Ruocheng Guo, Lu Cheng, Huan Liu, K. Candan

{"title":"Causal Disentanglement with Network Information for Debiased Recommendations","authors":"Paras Sheth, Ruocheng Guo, Lu Cheng, Huan Liu, K. Candan","doi":"10.48550/arXiv.2204.07221","DOIUrl":"https://doi.org/10.48550/arXiv.2204.07221","url":null,"abstract":"Recommender systems aim to recommend new items to users by learning user and item representations. In practice, these representations are highly entangled as they consist of information about multiple factors, including user's interests, item attributes along with confounding factors such as user conformity, and item popularity. Considering these entangled representations for inferring user preference may lead to biased recommendations (e.g., when the recommender model recommends popular items even if they do not align with the user's interests). Recent research proposes to debias by modeling a recommender system from a causal perspective. The exposure and the ratings are analogous to the treatment and the outcome in the causal inference framework, respectively. The critical challenge in this setting is accounting for the hidden confounders. These confounders are unobserved, making it hard to measure them. On the other hand, since these confounders affect both the exposure and the ratings, it is essential to account for them in generating debiased recommendations. To better approximate hidden confounders, we propose to leverage network information (i.e., user-social and user-item networks), which are shown to influence how users discover and interact with an item. Aside from the user conformity, aspects of confounding such as item popularity present in the network information is also captured in our method with the aid of textit{causal disentanglement} which unravels the learned representations into independent factors that are responsible for (a) modeling the exposure of an item to the user, (b) predicting the ratings, and (c) controlling the hidden confounders. Experiments on real-world datasets validate the effectiveness of the proposed model for debiasing recommender systems.","PeriodicalId":90051,"journal":{"name":"Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications","volume":"13 1","pages":"265-273"},"PeriodicalIF":0.0,"publicationDate":"2022-04-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84855699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 9

Learned Indexing in Proteins: Substituting Complex Distance Calculations with Embedding and Clustering Techniques 蛋白质的学习索引:用嵌入和聚类技术代替复杂的距离计算

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.48550/arXiv.2208.08910

Jaroslav Olha, Terézia Slanináková, Martin Gendiar, Matej Antol, Vlastislav Dohnal

{"title":"Learned Indexing in Proteins: Substituting Complex Distance Calculations with Embedding and Clustering Techniques","authors":"Jaroslav Olha, Terézia Slanináková, Martin Gendiar, Matej Antol, Vlastislav Dohnal","doi":"10.48550/arXiv.2208.08910","DOIUrl":"https://doi.org/10.48550/arXiv.2208.08910","url":null,"abstract":". Despite the constant evolution of similarity searching research, it continues to face the same challenges stemming from the complexity of the data, such as the curse of dimensionality and computationally expensive distance functions. Various machine learning techniques have proven capable of replacing elaborate mathematical models with combinations of simple linear functions, often gaining speed and sim-plicity at the cost of formal guarantees of accuracy and correctness of querying.Theauthors explore the potential of this research trend by presenting a lightweight solution for the complex problem of 3D protein structure search. The solution consists of three steps – (i) transformation of 3D protein structural information into very compact vectors, (ii) use of a probabilistic model to group these vectors and respond to queries by returning a given number of similar objects, and (iii) a ﬁnal ﬁltering step which applies basic vector distance functions to reﬁne the result.","PeriodicalId":90051,"journal":{"name":"Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications","volume":"19 1","pages":"274-282"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82534773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Self-supervised Information Retrieval Trained from Self-generated Sets of Queries and Relevant Documents 自生成查询集和相关文档训练的自监督信息检索

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_23

G. Moro, Lorenzo Valgimigli, Alex Rossi, Cristiano Casadei, Andrea Montefiori

引用次数: 1

Visual Recommendation and Visual Search for Fashion E-Commerce 面向时尚电子商务的视觉推荐与视觉搜索

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_25

Alessandro Abluton

引用次数: 0

On the Expected Exclusion Power of Binary Partitions for Metric Search 度量搜索中二元分区的期望排除能力

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_9

Lucia Vadicamo, A. Dearle, R. Connor

引用次数: 0

Concept of Relational Similarity Search 关系相似性搜索的概念

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_8

Vladimir Mic, P. Zezula

引用次数: 0

Approximate Nearest Neighbor Search on Standard Search Engines 标准搜索引擎上的近似近邻搜索

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_17

F. Carrara, Lucia Vadicamo, C. Gennaro, G. Amato

引用次数: 3

Graph Edit Distance Compacted Search Tree 图编辑距离压缩搜索树

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_14

Ibrahim Chegrane, Imane Hocine, Saïd Yahiaoui, A. Bendjoudi, Nadia Nouali-Taboudjemat

引用次数: 0

Deep Vision-Language Model for Efficient Multi-modal Similarity Search in Fashion Retrieval 时尚检索中高效多模态相似度搜索的深度视觉语言模型

Similarity search and applications : proceedings of the ... International Conference on Similarity Search and Applications Pub Date : 2022-01-01 DOI: 10.1007/978-3-031-17849-8_4

G. Moro, S. Salvatori

引用次数: 3