@唐小sin 我想请问下有没有multi-task learning的相关学习资料呢？博士论文和小论文都可以

haoawesome commented 10 years ago

keywords multi-task learning

overview and survey

http://en.wikipedia.org/wiki/Multi-task_learning

https://sites.google.com/site/deeplearningcvpr2014/DL-Multimodal_multitask_learning.pdf Multimodal learning and multitask learning (2014)

http://www.siam.org/meetings/sdm12/zhou_chen_ye.pdf Multi-Task Learning: Theory, Algorithms, and Applications (2012, SDM tutorial)

http://jcse.kiise.org/files/JCSE-V5N3-09.pdf A Survey of Transfer and Multitask Learning in Bioinformatics (2009, JCSE)

classic paper

http://www.eecs.berkeley.edu/~russell/classes/cs294/f05/papers/caruana-1997.pdf Caruana, R. (1997). Multitask learning: A knowledge-based source of inductive bias. Machine Learning

current

http://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/download/8486/8820 Encoding Tree Sparsity in Multi-Task Learning: A Probabilistic Framework (2014) AAAI

http://machinelearning.wustl.edu/mlpapers/paper_files/icml2014c2_lic14.pdf Bayesian Max-margin Multi-Task Learning with Data Augmentation , (2014) ICML

http://link.springer.com/chapter/10.1007/978-3-642-37331-2_1 Beyond Dataset Bias: Multi-task Unaligned Shared Knowledge Transfer (2013)

thesis

http://eprints.fri.uni-lj.si/2486/ Lan Žagar (2014) Ranking by Multitask Learning. PhD thesis.

http://gogoshen.org/ml/Research%20Paper%20Library/caruana97multitask2.pdf Caruana, (1997) Multitask Learning, PhD Thesis

唐小sin：补充下吧，刚自己也找了一遍classic paper里面的Caruana的博士论文就是Multitask Learning，他是Tom Mitchell的学生。

问: @唐小sin 有没有multi-task learning的相关学习资料呢？答: 维基百科上有不少经典文献。AAAI和ICML都有论文(北大/清华)。找到今年Honglak Lee (U Michigan 教授)的短教程。Lan Žagar 博士论文(2014) Ranking by Multitask Learning. 问答追踪: https://github.com/memect/hao/issues/93 求补充

http://www.weibo.com/5220650532/BiZl47k80?ref=

haoawesome commented 10 years ago

王威廉：今年SIGKDD最佳博士论文颁给了CMU计算机系金光熹同学的论文 Reconstruction and Applications of Collective Storylines from Web Photo Collections http://t.cn/RPNmgEw 还有一个优胜奖也由CMU的multitask learning论文（Mladen Kolar，现芝大教授）获得。 http://weibo.com/1657470871/BhG9eDbcm

黄厝海滨：可以说说他的导师啊，因为这两者的导师都是Eric Xing (8月10日 22:42)

haoawesome commented 10 years ago

李航博士：#WSDM2014# Best paper award: Amr Ahmed, Abhimanyu Das, Alex Smola, Hierarchical multitask learning: scalable algorithms and an application to conversion optimization in display advertising http://weibo.com/2060750830/AyJKFeZmQ

李沐M ：恭喜小伙伴和老板。这篇文章先被拒了一次，然后狠下心好好改了改写作。然后就happy ending了。老板然后眨着眼说，你懂了吗？我问懂神码？一呢，写作很重要，二呢，我写作很糟糕，你不能太依靠了。。。 (2月28日 03:53)

haoawesome commented 10 years ago

Copper_PKU：six NLP Task from Ronan Collobert, Jason Weston. A Unified Architecture for Natural Language Processing:Deep Neural Networks with Multitask Learning. ICML. 2008....畅读版 http://t.cn/8FOioh1
http://weibo.com/1758509357/AwFYMa0ot

haoawesome commented 10 years ago

复旦李斌：最右说的应该就是vowpal wabbit中使用的feature hash方法，Ping Li每篇论文都会提到这个，Smola在ICML-09把这个方法用multitask learning，我也把这个方法用于graph控制特征维度。//@鲁东东胖: 有没有具体一点的描述啊 //@夏粉_百度: 在那次Adworkshop上，yahoo介绍了另外一种降维方法，通过hash的方法 http://weibo.com/2303649634/A83kaktRT

haoawesome commented 10 years ago

eeyangc：从生物角度，你可以说是共同的遗传作用；从machine learning角度看，你可以看成multitask learning；从统计学角度看，你可以说是random-effects and hierarchical structures。横看成岭侧成峰，远近高低各不同。 http://weibo.com/2107700352/A4CuScVmV

haoawesome commented 10 years ago

李晗littlefool：deep learning造冗余特征的思路不错，boosted decision tree 和 kernel svm 现在有用但是有其局限性。坚持我的观点基于deep learning的无监督特征工程，和现有的非线性模型。配以online learning的实时特征抽取和模型更新，并借用multitask和transfer learning的知识来进行信息扩展和加强问题适用性。

http://weibo.com/1489962750/zp3daxlC6

haoawesome commented 10 years ago

李亚超NLP：A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning http://t.cn/aued1i http://weibo.com/1732906091/zjTJ94IaH

haoawesome commented 10 years ago

lby9：1) Deep learning在文本中的应用比较有意思的是这篇《A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning》。基本上网络结构是底层的low level features是共享的，上层的任务（POS, Chunking, NER等）共享部分的底层feature。网络结构如图。 http://weibo.com/1873273890/zhvrbkS8c

haoawesome commented 10 years ago

https://github.com/memect/hao/blob/master/awesome/multitask-learning.md

haoawesome commented 10 years ago

［资源整理］MultiTask Learning 资源合集。传送： 2014KDD最佳博士论文提名，#WSDM2014# 最佳论文，如何与深度学习的结合。传送大量优秀中文评论 @唐小sin @王威廉 @黄厝海滨 @李航博士 @李沐M@Copper_PKU @复旦李斌 @eeyangc @李晗littlefool @李亚超NLP @lby9 http://www.weibo.com/5220650532/BjgwRvPbW?mod=weibotime －－－忘了加坐标，删除－－－

[资源整理] MultiTask Learning资源合集 http://memect.co/3QnMdqk 2014KDD最佳博士论文提名, WSDM2014最佳论文, 及与深度学习的结合。传送来自微博的优秀中文评论 @唐小sin @王威廉 @黄厝海滨 @李航博士 @李沐M@Copper_PKU @复旦李斌 @eeyangc @李晗littlefool @李亚超NLP @lby9 http://t.cn/RPnTj0v

http://www.weibo.com/5220650532/Bjgysd9gF#_rnd1408580251800

memect / hao