knowledge distillation self distillation

Keyword Analysis

Keyword	CPC	PCC	Volume	Score	Length of keyword
knowledge distillation self distillation	0.48	0.2	5138	49	40
knowledge	1.15	0.4	4729	93	9
distillation	0.6	0.1	8793	80	12
self	0.44	1	7417	5	4
distillation	1.25	0.7	5683	26	12

Keyword	CPC	PCC	Volume	Score
knowledge distillation self distillation	0.85	1	6376	84
self-training and knowledge distillation	0.29	0.1	8535	30
towards understanding knowledge distillation	1.79	1	1604	99
what is knowledge distillation	0.75	0.2	3752	2
self-supervised knowledge distillation	0.17	0.2	5051	84
knowledge distillation meets self supervision	1.28	0.2	8331	37
few sample knowledge distillation	1.79	0.7	6928	21
knowledge distillation via instance	0.29	0.2	3832	94
self- distillation	1.47	0.8	2743	21
does knowledge distillation really work	0.42	0.7	6372	83
one-class knowledge distillation	1.06	0.4	1753	58
knowledge distillation-based	0.89	0.5	5384	48
knowledge distillation a survey	1.68	0.6	1737	25
knowledge distillation original paper	1.69	0.8	4532	79
student-friendly knowledge distillation	0.47	0.3	2633	22
on the efficacy of knowledge distillation	1.43	0.5	3004	59
self-distillation learning	1.37	0.7	2039	6
self-knowledge distillation via dropout	0.65	0.6	5474	59
self-distillation training	0.41	0.1	1040	98
what is self knowledge distillation	0.86	0.7	3132	29
knowledge distillation continual learning	1.28	0.8	168	57
knowledge distillation transfer learning	1.88	0.2	955	68
knowledge distillation in federated learning	1.28	0.8	6161	25
knowledge distillation teacher student	1.26	1	3267	78