on the efficacy of knowledge distillation

Keyword Analysis

Keyword	CPC	PCC	Volume	Score	Length of keyword
on the efficacy of knowledge distillation	0.52	1	7030	3	41
on	2	0.1	1363	55	2
the	0.44	0.2	4673	19	3
efficacy	1.56	0.8	1274	91	8
of	0.99	0.1	6889	19	2
knowledge	0.48	0.7	4393	80	9
distillation	1.16	1	2496	71	12

Keyword	CPC	PCC	Volume	Score
on the efficacy of knowledge distillation	0.36	0.7	8823	6
does knowledge distillation really work	0.56	0.8	1434	18
towards understanding knowledge distillation	0.91	0.8	4858	49
what is knowledge distillation	1.91	0.5	2822	30
knowledge distillation self distillation	1.8	0.8	7181	92
multi-level knowledge distillation	1.87	0.6	4203	69
knowledge distillation loss function	0.44	0.2	1233	1
feature based knowledge distillation	0.11	1	3811	84
parameter efficient knowledge distillation	0.06	0.8	7970	99
a survey of knowledge distillation	1.6	0.1	1562	21
knowledge distillation continual learning	1.04	1	810	7
knowledge distillation-based	1.99	0.3	2086	32
a fast knowledge distillation framework	1.54	0.3	9396	23
data free knowledge distillation	0.89	0.8	260	33
distilling knowledge via knowledge review	0.49	0.9	937	38
multi-scale knowledge distillation	0.1	0.4	6686	18
benefits and challenges of distillation	0.03	0.1	7343	4
knowledge distillation original paper	0.74	1	9989	63
knowledge distillation via instance	1.24	0.6	5062	14
knowledge distillation teacher student	1.93	0.6	9593	3
few sample knowledge distillation	1.35	0.5	1360	65
knowledge distillation in cnn	1.96	0.6	7164	13
self-training and knowledge distillation	1.54	0.3	4550	65
knowledge distillation machine learning	1.69	0.7	436	3
class-wise knowledge distillation	0.53	0.1	5198	21
student-friendly knowledge distillation	0.34	0.8	2120	68
knowledge distillation from a strong teacher	0.88	0.4	8331	2
knowledge distillation with no labels	1.3	0.3	280	8