On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent
Paper
•
2410.04870
•
Published
Bingrui Li
Bingrui
AI & ML interests
None yet
Recent Activity
authored
a paper
about 2 months ago
On the Optimization and Generalization of Two-layer Transformers with
Sign Gradient Descent
upvoted
a
paper
2 months ago
AdaSPEC: Selective Knowledge Distillation for Efficient Speculative
Decoders
authored
a paper
3 months ago
Memory Efficient Optimizers with 4-bit States
Organizations
None yet
authored
a
paper
about 2 months ago