リケラボ論文検索は、全国の大学リポジトリにある学位論文・教授論文を一括検索できる論文検索サービスです。

リケラボ 全国の大学リポジトリにある学位論文・教授論文を一括検索するならリケラボ論文検索大学・研究所にある論文を検索できる

リケラボ 全国の大学リポジトリにある学位論文・教授論文を一括検索するならリケラボ論文検索大学・研究所にある論文を検索できる

大学・研究所にある論文を検索できる 「Multiplicative Sparse Tensor Factorization for Multi-View Multi-Task Learning」の論文概要。リケラボ論文検索は、全国の大学リポジトリにある学位論文・教授論文を一括検索できる論文検索サービスです。

コピーが完了しました

URLをコピーしました

論文の公開元へ論文の公開元へ
書き出し

Multiplicative Sparse Tensor Factorization for Multi-View Multi-Task Learning

Wang, Xinyi Sun, Lu Nguyen, Canh Hao Mamitsuka, Hiroshi 京都大学 DOI:10.3233/faia230561

2023

概要

Multi-View Multi-Task Learning (MVMTL) aims to make predictions on dual-heterogeneous data. Such data contains features from multiple views, and multiple tasks in the data are related with each other through common views. Existing MVMTL methods usually face two major challenges: 1) to save the predictive information from full-order interactions between views efficiently. 2) to learn a parsimonious and highly interpretable model such that the target is related to the features through a subset of interactions. To deal with the challenges, we propose a novel MVMTL method based on multiplicative sparse tensor factorization. For 1), we represent full-order interactions between views as a tensor, that enables to capture the complex correlations in dual-heterogeneous data by a concise model. For 2), we decompose the interaction tensor into a product of two components: one being shared with all tasks and the other being specific to individual tasks. Moreover, tensor factorization is applied to control the model complexity and learn a consensus latent representation shared by multiple tasks. Theoretical analysis reveals the equivalence between our method and a family of models with a joint but more general form of regularizers. Experiments on both synthetic and real-world datasets prove its effectiveness.

この論文で使われている画像

参考文献

[1] Aviad Barzilai and Koby Crammer, ‘Convex multi-task learning by

clustering’, in Artificial Intelligence and Statistics, pp. 65–73. PMLR,

(2015).

[2] Wei Chang, Feiping Nie, Rong Wang, and Xuelong Li, ‘New tight relaxations of rank minimization for multi-task learning’, in Proceedings

of the 30th ACM International Conference on Information & Knowledge Management, pp. 2910–2914, (2021).

[3] Qiang Cui, Shu Wu, Qiang Liu, Wen Zhong, and Liang Wang, ‘Mv-rnn:

A multi-view recurrent neural network for sequential recommendation’,

IEEE Transactions on Knowledge and Data Engineering, 32(2), 317–

331, (2018).

[4] Pinghua Gong, Jieping Ye, and Chang-shui Zhang, ‘Multi-stage multitask feature learning’, Advances in neural information processing systems, 25, (2012).

[5] Pinghua Gong, Jieping Ye, and Changshui Zhang, ‘Robust multi-task

feature learning’, in Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 895–

903, (2012).

[6] Jingrui He and Rick Lawrence, ‘A graphbased framework for multi-task

multi-view learning’, in ICML, (2011).

[7] Feiran Huang, Xiaoming Zhang, Zhonghua Zhao, Zhoujun Li, and

Yueying He, ‘Deep multi-view representation learning for social images’, Applied Soft Computing, 73, 106–118, (2018).

[8] Ali Jalali, Sujay Sanghavi, Chao Ruan, and Pradeep Ravikumar, ‘A

dirty model for multi-task learning’, Advances in neural information

processing systems, 23, (2010).

[9] Jun-Yong Jeong and Chi-Hyuck Jun, ‘Variable selection and task

grouping for multi-task learning’, in Proceedings of the 24th ACM

SIGKDD International Conference on Knowledge Discovery & Data

Mining, pp. 1589–1598, (2018).

[10] Xin Jin, Fuzhen Zhuang, Shuhui Wang, Qing He, and Zhongzhi Shi,

‘Shared structure learning for multiple tasks with multiple views’, in

Joint European conference on machine learning and knowledge discovery in databases, pp. 353–368. Springer, (2013).

[11] Xin Jin, Fuzhen Zhuang, Hui Xiong, Changying Du, Ping Luo, and

Qing He, ‘Multi-task multi-view learning for heterogeneous tasks’, in

Proceedings of the 23rd ACM international conference on information

and knowledge management, pp. 441–450, (2014).

[12] Henk AL Kiers, ‘Towards a standardized notation and terminology in

multiway analysis’, Journal of Chemometrics: A Journal of the Chemometrics Society, 14(3), 105–122, (2000).

[13] Tamara G Kolda and Brett W Bader, ‘Tensor decompositions and applications’, SIAM review, 51(3), 455–500, (2009).

[14] Xiaoli Li and Jun Huan, ‘aptmtvl: Nailing interactions in multi-task

multi-view multi-label learning using adaptive-basis multilinear factor analyzers’, in Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pp. 1171–1180,

(2016).

[15] Xiaoli Li and Jun Huan, ‘Interactions modeling in multi-task multiview learning with consistent task diversity’, in Proceedings of the 27th

ACM International Conference on Information and Knowledge Management, pp. 853–861, (2018).

[16] Han Liu, Mark Palatucci, and Jian Zhang, ‘Blockwise coordinate descent procedures for the multi-task lasso, with applications to neural

semantic basis discovery’, in Proceedings of the 26th annual international conference on machine learning, pp. 649–656, (2009).

[17] Shengchao Liu, Meng Qu, Zuobai Zhang, Huiyu Cai, and Jian Tang,

‘Structured multi-task learning for molecular property prediction’, in

International Conference on Artificial Intelligence and Statistics, pp.

8906–8920. PMLR, (2022).

[18] Aurelie C Lozano and Grzegorz Swirszcz, ‘Multi-level lasso for sparse

multi-task regression’, in Proceedings of the 29th International Coference on International Conference on Machine Learning, pp. 595–602,

(2012).

2567

[19] Chun-Ta Lu, Lifang He, Weixiang Shao, Bokai Cao, and Philip S Yu,

‘Multilinear factorization machines for multi-task multi-view learning’, in Proceedings of the tenth ACM international conference on web

search and data mining, pp. 701–709, (2017).

[20] Run-kun Lu, Jian-wei Liu, Si-ming Lian, and Xin Zuo, ‘Multi-view representation learning in multi-task scene’, Neural Computing and Applications, 32(14), 10403–10422, (2020).

[21] Yurii Nesterov, Introductory lectures on convex optimization: A basic

course, volume 87, Springer Science & Business Media, 2013.

[22] Ting Kei Pong, Paul Tseng, Shuiwang Ji, and Jieping Ye, ‘Trace norm

regularization: Reformulations, algorithms, and multi-task learning’,

SIAM Journal on Optimization, 20(6), 3465–3489, (2010).

[23] Vikas Sindhwani and David S Rosenberg, ‘An rkhs for multi-view

learning and manifold co-regularization’, in Proceedings of the 25th

international conference on Machine learning, pp. 976–983, (2008).

[24] Lu Sun, Canh Hao Nguyen, and Hiroshi Mamitsuka, ‘Multiplicative

sparse feature decomposition for efficient multi-view multi-task learning.’, in IJCAI, pp. 3506–3512, (2019).

[25] Sebastian Thrun and Joseph O’Sullivan, ‘Discovering structure in multiple learning tasks: The tc algorithm’, in ICML, volume 96, pp. 489–

497, (1996).

[26] Robert Tibshirani, ‘Regression shrinkage and selection via the lasso’,

Journal of the Royal Statistical Society: Series B (Methodological),

58(1), 267–288, (1996).

[27] Ledyard R Tucker, ‘Some mathematical notes on three-mode factor

analysis’, Psychometrika, 31(3), 279–311, (1966).

[28] Xin Wang, Jinbo Bi, Shipeng Yu, Jiangwen Sun, and Minghu Song,

‘Multiplicative multitask feature learning’, Journal of Machine Learning Research, 17(80), 1–30, (2016).

[29] Li Xiao, Julia M Stephen, Tony W Wilson, Vince D Calhoun, and YuPing Wang, ‘A manifold regularized multi-task learning model for iq

prediction from two fmri paradigms’, IEEE Transactions on Biomedical Engineering, 67(3), 796–806, (2019).

[30] Zhiyong Yang, Qianqian Xu, Yangbangyan Jiang, Xiaochun Cao,

and Qingming Huang, ‘Generalized block-diagonal structure pursuit:

Learning soft latent task assignment against negative transfer’, Advances in Neural Information Processing Systems, 32, (2019).

[31] Jintao Zhang and Jun Huan, ‘Inductive multi-task learning with multiple view data’, in Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 543–

551, (2012).

[32] Yu Zhang and Qiang Yang, ‘A survey on multi-task learning’, IEEE

Transactions on Knowledge and Data Engineering, (2021).

[33] Lecheng Zheng, Yu Cheng, and Jingrui He, ‘Deep multimodality model

for multi-task multi-view learning’, in Proceedings of the 2019 SIAM

International Conference on Data Mining, pp. 10–18. SIAM, (2019).

...

参考文献をもっと見る

全国の大学の
卒論・修論・学位論文

一発検索!

この論文の関連論文を見る