Abdullah Abdelrhim
abdullah
AI & ML interests
None yet
Recent Activity
upvoted a collection about 21 hours ago
š FinePhrase liked a Space about 21 hours ago
Omartificial-Intelligence-Space/llm-glossary reacted to sergiopaniego's post with š„ about 21 hours ago
New post-training example: SFT on agent traces with TRL
ā A large model works as a coding agent in OpenCode, run through OpenEnv
ā The tasks it solves become the training data
ā A 2B model goes from 5.5% to 34.4% on held-out tasks
About 500 traces get most of the gain. Five times more add only 3 to 4 points, so SFT gets the agent working and RL has to do the rest
Full guide, with the models, traces and every rollout open:
https://github.com/huggingface/trl/tree/main/examples/sft_agent_traces