👋 Open to Work

Fredy Rivera

FredyRivera-dev

17 29 561

https://fredy-rivera-dev-portafolio.vercel.app

AI & ML interests

None yet

Recent Activity

reacted to theirpost with 🚀 about 18 hours ago

We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen. Covers: - Hybrid architecture based on Qwen3.5 - Pre-training with 15B tokens - Cost benchmark between H200 and B200 - Post-training with SFT + LoRA - Full code and data, open source With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline. Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.

posted an update about 18 hours ago

liked a model 1 day ago

moonshotai/Kimi-K3

View all activity

Organizations

Posts 1

Post

2952

We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.

Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source

With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.

Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch

Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.