BigCodeArena: Judging code generations end to end with code executions
• 22
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
sted97
authored a
paper about 18 hours ago
Post
3,934
𝐈𝐧𝐭𝐫𝐨𝐝𝐮𝐜𝐢𝐧𝐠 🧬 𝐅𝐢𝐧𝐞𝐃𝐍𝐀: 𝐭𝐡𝐞 𝐛𝐞𝐬𝐭 𝐝𝐚𝐭𝐚𝐬𝐞𝐭 𝐭𝐨 𝐭𝐞𝐚𝐜𝐡 𝐚𝐧𝐲 𝐥𝐚𝐧𝐠𝐮𝐚𝐠𝐞 𝐦𝐨𝐝𝐞𝐥 𝐃𝐍𝐀.
Training Qwen3-14B on it produces Carbon-X, the strongest open model on DNA benchmarks, on par with GPT-6.1 Sol.
It contains:
- Midtraining: 300B+ tokens of genomic sequences, papers and web pages mixing DNA with text
- SFT: 200K samples, from variant effect prediction to sequence question answering
- RL: 98K prompts with verifiable rewards
Data, models and the full recipe are open.
HuggingFaceBio/FineDNA
Enjoy this late Halloween treat! 🎃
Training Qwen3-14B on it produces Carbon-X, the strongest open model on DNA benchmarks, on par with GPT-6.1 Sol.
It contains:
- Midtraining: 300B+ tokens of genomic sequences, papers and web pages mixing DNA with text
- SFT: 200K samples, from variant effect prediction to sequence question answering
- RL: 98K prompts with verifiable rewards
Data, models and the full recipe are open.
HuggingFaceBio/FineDNA
Enjoy this late Halloween treat! 🎃
- 4 replies
ZennyKenny
posted an update 11 days ago
Post
102
Dropped an MCP server for managing your Yandex inbox and calendar today: https://github.com/kghamilton89/yandex-360-mcp
Elfsong
submitted a
paper to Daily Papers 29 days ago
natolambert
authored 10
papers about 1 month ago
RewardBench 2: Advancing Reward Model Evaluation
Paper • 2506.01937 • Published • 7
Spurious Rewards: Rethinking Training Signals in RLVR
Paper • 2506.10947 • Published • 2
Generalizing Verifiable Instruction Following
Paper • 2507.02833 • Published • 1
Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI
Paper • 2511.01689 • Published • 5
Olmo 3
Paper • 2512.13961 • Published • 40
Meta-Reinforcement Learning with Self-Reflection for Agentic Search
Paper • 2603.11327 • Published • 12
Olmo Hybrid: From Theory to Practice and Back
Paper • 2604.03444 • Published
Tmax: A simple recipe for terminal agents
Paper • 2606.23321 • Published • 17
Learning to Solve Hard Problems in RL for LLMs by Never Giving Up
Paper • 2609.13443 • Published • 15
Context Language Models
Paper • 2609.37725 • Published • 36
Elfsong
submitted a
paper to Daily Papers about 1 month ago
ccc
#58 opened 11 months ago
by 
zhuyunqiang111
bigcode/the-stack
#57 opened 11 months ago
by zhuyunqiang111
the-stack
#56 opened 11 months ago
by zhuyunqiang111
Project
#55 opened 11 months ago
by 
needmoney4porsche
