Learning

2026

关于 ALF 中 Bias 引起的 MoE 路由翻转的简要讨论

在 Auxiliary-Loss-Free(ALF)方法中,采用 来选择 expert。 correction bias 的学习可以改善负载均衡。但是在后续的 gated output 中,仍然采用原始 score 来加权。这就会自然引入一个问题:是否会因为某个 expert 相 …
Read more

RL Note 3: Markov Decision Process

It's almost been half a year since I first decided to kick off this RL notes series. I apologize for the delay -- I've been busy with other …
Read more
2025

RL Note 2: Multi-Armed Bandits

In the last post, we introduced the basics of RL—action, reward, state, value, policy, model, etc.—so you should now have a rough picture of …
Read more

RL Note 1: Basics

It’s been a while since I last updated this blog, so I’m kicking off a new series. I’m currently taking a Reinforcement Learning (RL) course …
Read more
2024

高代选讲期末重点整理

此文为宗正宇老师在最后一节课所划六个重点的整理,权作期末预习(x) 定理 7.4 极小多项式 和特征多项式 含有完全相同的根集和不可约因子集。 一般来说考试涉及的矩阵并不复杂,维数也较小,因此可以根据定理 7.4, …
Read more

Chapter2 Using 🤗 Transformers

NLP Course of Hugging Face
Read more

Chapter1 Transformer Models

NLP Course of Hugging Face
Read more

生成对抗网络

本文是数据科学导论期末大作业展示的报告,拿来随便水一篇博客hh 生成对抗网络 (Generative Adversarial Network, GAN) 是一种十分流行的机器学习模型。自2014年Ian Goodfellow等人首次提出以来,GAN迅速在学术界和工业界引发了热烈的 …
Read more