Dev.to · 4 min read

Muse Spark 1.3 - A Review

Muse Spark 1.3 - A Review

In this post I'll talk about my brief experience with muse, Meta's LLM harness for developers, as well as Muse Spark 1.3, their latest frontier-level model. The Bad I'll start with the bad, just because I like to end with the positive :) Skill Usage It's not that good following skills. If the skill has disable-model-invocation, sometimes it refuses to launch it, even if you manually call it. I think it happens when you call the skill mid-sentence, but it's not consistent. It's also not as good as other models at following skill instructions. It seems to get confused more often. For example, I have one skill that will address an issue from GitHub to PR. In Claude (Opus 5) and Cursor (Grok 4.6) it works perfectly. The first step is grilling the issue, after that's finished, the next step is autonomous, plan, implement with TDD, review and open PR. With Muse Spark 1.3, sometimes the skill will not continue and I have to nudge it for the next step, just saying something like "continue" is enough, but surely is annoying. Formatting The output is not great. Sometimes it will show me raw markdown, sometimes not. It's not consistent. Sandbox Having a sandbox is good, but in this case, it's a bit too restrictive. For example, I'm working with a Firebase project and I want to use the emulators. Well, too bad. The sandbox doesn't allow you to run files outside your workspace or use external ports. That would be great if I could add exceptions or some kind of configuration, but you can't. You are basically forced into --yolo mode if you don't want to be prompted on repeat for the same things over and over. What's sad is that even if you want to give them access, the models will just get stuck asking for permissions for the same thing over and over again and eventually they will just be stuck doing nothing. The Good Not everything is bad, of course. With a bit of effort I think it's actually quite usable. Price The main reason I decided to try the model. The subscription plan is relatively generous for it's price. With the $15 plan you can code non-stop for a couple hours, in my experience around 2 to 4 hours, before you reach the 5-hour limit. But of course, it depends on your usage. If you have a lot of concurrent sessions, it will last less. Also the weekly usage is a bit low, I'd say around 4-5 times the 5 hour limit (~25h). I think compared to other plans though it's probably one of the best values. For $50 you can get ~33% more usage, which should be enough for ~11.5hs of coding a day. Quite decent for that price tag. Intelligence My biggest hurdles with the model have been in the actual development flow. When it comes to general intelligence and code, I think it's quite good. It feels around Opus 4.8 / Grok 4.6. Of course, that's totally subjective. I think the code it generates is very similar to most other frontier models. I don't think anyone can really tell what model generated what output nowadays anyway, they are all quite competent. Output Unlike Claude which speaks a weird dialect of english, called claudish by most devs, the output from this model seems to be much more readable in general. In my experience I rarely need to tell it to re-word what it just said. Speed I think the model speed is quite good. I think the time to first token is average, but after that it feels quite good. Conclusion Overall, I think this whole ecosystem is still a bit rough around the edges, but if you are willing to work around that, it's an usable model and harness. Probably it will be much better in a couple months. It's clear they are playing catch-up at this point. But they (Meta) seems to have the tools (model, data centers, engineers), so they have a real shot at creating a good product. I don't think there's a real reason to swap from, say, Codex, Claude or Cursor unless you want to try something new, or maybe are looking for a cheaper alternative. Let me know what you think in the comments, I'd love to hear other people's opinions about this model/harness!

This is a summary aggregated from Dev.to. Read the complete article on the original site:

Read full article at Dev.to

More AI & Machine Learning News