Skip to content
Daucloud's Blog
Home
Posts
Categories
Tags
About
Learning
2026
关于 ALF 中 Bias 引起的 MoE 路由翻转的简要讨论
Aug 22
在 Auxiliary-Loss-Free(ALF)方法中,采用 来选择 expert。 correction bias 的学习可以改善负载均衡。但是在后续的 gated output 中,仍然采用原始 score 来加权。这就会自然引入一个问题:是否会因为某个 expert 相 …
LLM
MoE
ALF
Read more
RL Note 3: Markov Decision Process
Mar 26
It's almost been half a year since I first decided to kick off this RL notes series. I apologize for the delay -- I've been busy with other …
Course Notes
Reinforcement Learning
Read more
2025
RL Note 2: Multi-Armed Bandits
Nov 03
In the last post, we introduced the basics of RL—action, reward, state, value, policy, model, etc.—so you should now have a rough picture of …
Course Notes
Reinforcement Learning
Read more
RL Note 1: Basics
Oct 28
It’s been a while since I last updated this blog, so I’m kicking off a new series. I’m currently taking a Reinforcement Learning (RL) course …
Course Notes
Reinforcement Learning
Read more
2024
高代选讲期末重点整理
Jun 18
此文为宗正宇老师在最后一节课所划六个重点的整理,权作期末预习(x) 定理 7.4 极小多项式 和特征多项式 含有完全相同的根集和不可约因子集。 一般来说考试涉及的矩阵并不复杂,维数也较小,因此可以根据定理 7.4, …
Linear Algebra
Course Notes
Read more
Chapter2 Using 🤗 Transformers
May 14
NLP Course of Hugging Face
NLP
Hugging Face
Read more
Chapter1 Transformer Models
May 10
NLP Course of Hugging Face
NLP
Hugging Face
Read more
生成对抗网络
Jan 18
本文是数据科学导论期末大作业展示的报告,拿来随便水一篇博客hh 生成对抗网络 (Generative Adversarial Network, GAN) 是一种十分流行的机器学习模型。自2014年Ian Goodfellow等人首次提出以来,GAN迅速在学术界和工业界引发了热烈的 …
GAN
Machine Learning
Read more