Apfel, mac local llm
Apfel is an api to your apple silicon computers local llm’s.
It wraps the foundation models that power siri and enables cli calling, an openai compatible api.
apfel "how do you use set in js"the cli supports streaming, attaching files and json output.
apfel —serverYou can start an openai compatible api running on localhost:11434.
apfel —chatIt also supports interactive chat and even mcp tool calling.
There is a list of demos shell scripts with some handy utilities.
cmd
cmd "find all .log files modified today"it will return the shell command to run.
wtd
wtd .explains the content of a directory
gitsum
gitsumsummarises the latest git commits
Actually runs reasonably quickly on my macbook pro, it has a limited context window which will limit its usefulness, would be interesting to see how well it works on a mac studio.
Links:
