Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall
尚未评估计划受阻指标结果claim_fig10_factual_acquisition_1b_13b

Factual acquisition stratification by teacher entropy quintile persists when using OLMo-2 1B Instruct and 13B Instruct teachers.

来源:source_paper:Figure 10, Page 29

报告指标与观测值

factual_examples_learned

fig10_factual_acq_1b_pretraining_100b_q1

论文报告 76 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_pretraining_100b_q2

论文报告 48 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_pretraining_100b_q3

论文报告 30 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_pretraining_100b_q4

论文报告 12 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_pretraining_100b_q5

论文报告 6 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_midtraining_init_4t_q1

论文报告 81 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_midtraining_init_4t_q2

论文报告 61 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_midtraining_init_4t_q3

论文报告 40 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_midtraining_init_4t_q4

论文报告 18 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_1b_midtraining_init_4t_q5

论文报告 8 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_pretraining_100b_q1

论文报告 54 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_pretraining_100b_q2

论文报告 48 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_pretraining_100b_q3

论文报告 37 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_pretraining_100b_q4

论文报告 28 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_pretraining_100b_q5

论文报告 6 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_midtraining_init_4t_q1

论文报告 66 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_midtraining_init_4t_q2

论文报告 58 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_midtraining_init_4t_q3

论文报告 43 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_midtraining_init_4t_q4

论文报告 32 percentage_points

实际观测 — percentage_points

factual_examples_learned

fig10_factual_acq_13b_midtraining_init_4t_q5

论文报告 8 percentage_points

实际观测 — percentage_points

Assessment(0)

这条 Claim 暂无已发布的不可变 Assessment。

关联运行(0)

这条 Claim 暂无关联执行。