Kryptovaluta-ticker:
technology fra Arxiv cs.ai

GRZO: Group-Relative Zeroth-Order Optimization for Large Language Model Fine-Tuning

Liyan Tan, Yequan Zhao, Yifan Yang, Ruijie Zhang, Xinling Yu, Zheng Zhang
Jun 3, 2026 at 04:00
9 Visninger
0 Kommentarer

arXiv:2606.02857v1 Announce Type: cross Abstract: Zeroth-order (ZO) optimization is a memory-efficient alternative to backpropagation for fine-tuning large language models, but its deployment is limited by the high variance of gradient estimation. We propose GRZO, a Group-Relative Zeroth-Order optimizer that draws one pseudo-independent...

Les hele artikkelen hos kilden.

Var dette nyttig?
Del:

Kommentarer (0)

Vennligst logg inn for å skrive en kommentar

Ingen kommentarer ennå. Bli den første til å kommentere!