Is the bot learning?

[ChaiBapchya]

So having monitored the activity of the labelbot (manually) as much as I could I have tried to go through all the issues in the month of Jan 2019, and found out that in the following issues - LabelBot has recommended a set of labels which are either a. Incorrect b. Incomplete

Metric used here - Edit distance Basically number of delete, append needed to go from predict to groud-truth

Assumption - Ground-truth is correct. ( i.e. Labels given by community are correct)

	Bot prediction	Human (groundtruth)	Edit Distance	Date
https://github.com/apache/incubator-mxnet/issues/14010	Build	docker, build	1	29 Jan
https://github.com/apache/incubator-mxnet/issues/14019	Feature	question, operator	3	29 Jan
https://github.com/apache/incubator-mxnet/issues/14009	performance	performance, cuda, operator	2	28 Jan
https://github.com/apache/incubator-mxnet/issues/14008	installation	R, installation	1	28 Jan
https://github.com/apache/incubator-mxnet/issues/14004	installation	build, R	3	28 Jan
https://github.com/apache/incubator-mxnet/issues/13999	Installation, C++, Build	build, Windows, cuda	2	27 Jan
https://github.com/apache/incubator-mxnet/issues/13991	Installation, Build	build, question	2	25 jan
https://github.com/apache/incubator-mxnet/issues/13987	doc	build, question	3	25 jan
https://github.com/apache/incubator-mxnet/issues/13976	Performance	gluon	2	23 jan
https://github.com/apache/incubator-mxnet/issues/13968	empty	Gluon, operator	2	22 jan
https://github.com/apache/incubator-mxnet/issues/13967	empty	gluon	1	22 jan
https://github.com/apache/incubator-mxnet/issues/13958	empty	Build, ci, cmake, windows	4	22 jan
https://github.com/apache/incubator-mxnet/issues/13956	bug	Bug, c api	2	22 Jan
https://github.com/apache/incubator-mxnet/issues/13954	bug	Feature-request, Julia	3	21 jan
https://github.com/apache/incubator-mxnet/issues/13953	empty	Bug, good first issue, python	4	20 jan
https://github.com/apache/incubator-mxnet/issues/13949	onnx	Onnx, bug	1	20 jan
https://github.com/apache/incubator-mxnet/issues/13919	empty	Question, gluon	2	17 jan
https://github.com/apache/incubator-mxnet/issues/13879	empty	Gluon, good first issue, call for contribution	4	14 jan
https://github.com/apache/incubator-mxnet/issues/13870	C++, bug	C++,build	2	14 jan
https://github.com/apache/incubator-mxnet/issues/13854	empty	Website, docs	2	11 jan
https://github.com/apache/incubator-mxnet/issues/13846	bug	Backend bug osx test	3	11 jan
https://github.com/apache/incubator-mxnet/issues/13801	installation	Docs, installation	1	8 jan
https://github.com/apache/incubator-mxnet/issues/13800	test	CI	2	8 jan
https://github.com/apache/incubator-mxnet/issues/13798	C++, test	C++, bug	2	7 jan
https://github.com/apache/incubator-mxnet/issues/13792	bug	Bug,data-loadinng, gluon, python	3	7 jan
https://github.com/apache/incubator-mxnet/issues/13790	build	Build, edge devices	1	7 jan
https://github.com/apache/incubator-mxnet/issues/13789	feature	Kvstore, julia	2	7 jan
https://github.com/apache/incubator-mxnet/issues/13788	feature	Optimizer, julia	2	7 jan
https://github.com/apache/incubator-mxnet/issues/13787	feature	Example, julia	2	7 jan
https://github.com/apache/incubator-mxnet/issues/13785	Build, installation	Build, cuda	2	7 jan
https://github.com/apache/incubator-mxnet/issues/13781	feature	Arm, question	2	6 jan
https://github.com/apache/incubator-mxnet/issues/13722	feature	ndarray	2	4 jan
https://github.com/apache/incubator-mxnet/issues/13765	Build, installation	Build, installation, scala, clojure	2	3 jan
https://github.com/apache/incubator-mxnet/issues/13753	empty	Optimizer, fp16, feature request, cuda	4	1 jan
https://github.com/apache/incubator-mxnet/issues/13750	Performance, bug	Feature request	3	1 jan

I feel there is a lot of common trend here and hence was wondering if the errors are getting repeated, does this mean the bot isn't learning as expected?

[aaronmarkham]

Hi @ChaiBapchya This is interesting... how does it look now that a few more months have passed?