knowledge distillation based

Keyword Analysis

Keyword	CPC	PCC	Volume	Score	Length of keyword
knowledge distillation based	1.71	0.4	1911	14	28
knowledge	0.72	0.7	8913	100	9
distillation	0.71	0.6	5534	40	12
based	0.73	0.9	8608	62	5

Keyword	CPC	PCC	Volume	Score
knowledge distillation based	2	0.7	6484	13
relation based knowledge distillation	1.07	0.1	9572	53
response based knowledge distillation	1.53	0.6	5289	3
feature based knowledge distillation	1.98	0.9	6420	24
attention based knowledge distillation	1.9	0.1	2260	9
response-based knowledge distillation	0.32	0.1	1124	41
knowledge distillation-based	1.25	0.1	3803	28
relation-based distillation	1.85	0.2	9822	29
towards understanding knowledge distillation	1.4	0.1	2774	80
what is knowledge distillation	1.77	0.9	3096	86
graph-based knowledge distillation	0.41	0.2	5816	12
knowledge distillation via instance	0.04	0.6	1113	13
residual error based knowledge distillation	0.64	0.5	6397	97
knowledge distillation self distillation	1.72	0.7	330	68
similarity preserving knowledge distillation	1.24	0.8	2685	94
knowledge distillation language model	0.94	0.5	1146	87
few sample knowledge distillation	1.57	0.5	9669	75
knowledge distillation for sequence model	1.89	0.1	5019	22
data free knowledge distillation	0.89	0.4	803	55
does knowledge distillation really work	1.21	0.8	7133	44
on the efficacy of knowledge distillation	0.83	0.2	9284	93
distilling knowledge via knowledge review	0.66	1	235	65
class-wise knowledge distillation	0.26	0.2	7199	70