OppaAI
OppaAI
AI & ML interests
Local AI implementation, Agentic AI workflows, AI Autonomous Robot
Recent Activity
posted an update 1 day ago
Got side-tracked this week building an app for Learning and Practicing Japanese. It's not too fancy and there will some flaws here and there. But since I'm just using it to learn and practice Japanese myself, I think I will just finalize it now and move on back to review Phase 1 of the AI Agent itself.
Did not use much of the LLM to gen the vocab.
Hallucination happens sometimes causing gibberish and mistakes in the phrases. Thanks evanclan/OpenJLPT (https://github.com/evanclan/OpenJLPT) for providing the datasets for N5->N1 vocabs and grammar datasets.
My LLM server is mainly doing conversation practice, spawning extra vocabs, and for ASR/TTS voice input/output.
🔗Front-End app: https://github.com/OppaAI/Aiko-Lingo
🔗Back-End server: https://github.com/OppaAI/Aiko-chan
repliedto their post 2 days ago
Another small 4B model comes out yesterday.
NeoHorse 1 4B
https://huggingface.co/TokenRhythm/NeoHorse-1-4B
There are quite a few good smaller parameter models that are capable for Agentic tasks:
The ones from the chart, I have tried a few already in my Jetson Orin Nano,
❌Gemma4 E2B IT - cannot fit my RAM usage if use with TTS and embedder
❓Qwen3.5 4B - just barely fit my RAM usage, need to add think/no_think
❌Spark X2.5 4B - need to build the forked llama.cpp; no vision
➡️Nanbeige 4.2 3B - need to build the forked llama.cpp; slower than Ministral3-3B by 25%; no vision but good for coding; maybe run this is separate server for doing coding tasks
➡️Agents A1 4B - This one is quite interesting. Another Qwen3.5 4B base. I just learnt this right now. This model may surpassed the Ministral3-3B that I'm currently running.
➡️NeoHorse 1 4B - wait for GGUF version comes out; Qwen 3.5 4B base with vision striped
➡️Needle2 45M - need to use separately from llama.cpp server; currently testing to see if it can be used as spawning sub-agents to do parallel tasks repliedto their post 3 days ago
Another small 4B model comes out yesterday.
NeoHorse 1 4B
https://huggingface.co/TokenRhythm/NeoHorse-1-4B
There are quite a few good smaller parameter models that are capable for Agentic tasks:
The ones from the chart, I have tried a few already in my Jetson Orin Nano,
❌Gemma4 E2B IT - cannot fit my RAM usage if use with TTS and embedder
❓Qwen3.5 4B - just barely fit my RAM usage, need to add think/no_think
❌Spark X2.5 4B - need to build the forked llama.cpp; no vision
➡️Nanbeige 4.2 3B - need to build the forked llama.cpp; slower than Ministral3-3B by 25%; no vision but good for coding; maybe run this is separate server for doing coding tasks
➡️Agents A1 4B - This one is quite interesting. Another Qwen3.5 4B base. I just learnt this right now. This model may surpassed the Ministral3-3B that I'm currently running.
➡️NeoHorse 1 4B - wait for GGUF version comes out; Qwen 3.5 4B base with vision striped
➡️Needle2 45M - need to use separately from llama.cpp server; currently testing to see if it can be used as spawning sub-agents to do parallel tasksOrganizations
