does knowledge distillation really work

Keyword Analysis

Keyword	CPC	PCC	Volume	Score	Length of keyword
does knowledge distillation really work	0.95	0.9	5131	1	39
does	1.66	0.3	5965	90	4
knowledge	0.92	1	4966	73	9
distillation	0.13	0.8	7558	91	12
really	1.52	0.6	399	43	6
work	0.49	1	1352	84	4

Keyword	CPC	PCC	Volume	Score
does knowledge distillation really work	0.16	0.2	6125	11
what is knowledge distillation	0.4	0.9	6954	15
towards understanding knowledge distillation	0.07	0.2	5721	36
on the efficacy of knowledge distillation	0.95	0.3	7222	83
knowledge distillation self distillation	1.81	0.7	1485	73
distilling knowledge via knowledge review	1.58	0.3	2885	42
knowledge distillation-based	1.43	0.7	1732	40
knowledge distillation via instance	0.31	0.3	7549	23
knowledge distillation continual learning	0.57	0.2	4723	85
knowledge distillation teacher student	1.98	0.9	5228	6
few sample knowledge distillation	1.23	0.9	4422	54
knowledge distillation in cnn	2	1	1574	23
knowledge distillation original paper	1.44	0.1	8804	25
self-training and knowledge distillation	1.55	0.7	2540	26
knowledge distillation machine learning	1.76	0.6	2079	96
knowledge distillation loss function	0.24	0.7	2911	52
data free knowledge distillation	1.64	0.2	201	82
class-wise knowledge distillation	1.51	0.5	6995	22
student-friendly knowledge distillation	1.17	0.1	1473	69
knowledge distillation from a strong teacher	1.86	0.5	3992	88
knowledge distillation with no labels	0.95	1	5976	64