BigCodeArena: Judging code generations end to end with code executions
• 22
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
albertvillanova
posted an update 1 day ago
Post
100
Day-0 Mistral Large 4 support in TRL 🚀
- LoRA SFT of the 1T-A52B model on one 8xB300 node, on top of the FP8 checkpoint
- Experts split 8 ways with expert parallelism, everything else sharded with FSDP, all set at load time
- Assistant-only loss out of the box with its training chat template
- ~32.7k tokens per step in ~8 s
Script + Slurm launcher 👇
https://github.com/huggingface/trl/tree/main/examples/sft_mistral_large_4
https://huggingface.co/posts/sergiopaniego/408182860646834
- LoRA SFT of the 1T-A52B model on one 8xB300 node, on top of the FP8 checkpoint
- Experts split 8 ways with expert parallelism, everything else sharded with FSDP, all set at load time
- Assistant-only loss out of the box with its training chat template
- ~32.7k tokens per step in ~8 s
Script + Slurm launcher 👇
https://github.com/huggingface/trl/tree/main/examples/sft_mistral_large_4
https://huggingface.co/posts/sergiopaniego/408182860646834
ZennyKenny
posted an update 8 days ago
Post
92
Dropped an MCP server for managing your Yandex inbox and calendar today: https://github.com/kghamilton89/yandex-360-mcp
afaji
submitted a
paper to Daily Papers 26 days ago
ccc
#58 opened 11 months ago
by 
zhuyunqiang111
bigcode/the-stack
#57 opened 11 months ago
by zhuyunqiang111
the-stack
#56 opened 11 months ago
by zhuyunqiang111
Project
#55 opened 11 months ago
by 
needmoney4porsche
Delete data/java/train-00105-of-00285.parquet
#33 opened over 3 years ago
by 
willyninja30
Update README.md
#46 opened almost 2 years ago
by 
Tjasika
Upload 37 files
#48 opened almost 2 years ago
by 
crystalai
Delete data/c/train-00189-of-00257.parquet
#49 opened over 1 year ago
by 
AI-AIMS
unsafe so delete
#50 opened over 1 year ago
by 
jayan12k
Delate data/D
#11 opened over 1 year ago
by 
MIN12352
anton-l
updated a
dataset 3 months ago
Apply opt-out removals
#64 opened 3 months ago
by 
anton-l
LLMQuantResearch
#63 opened 4 months ago
by 
suvodeep1007
anton-l
updated 2
datasets 3 months ago