llm-apple

To connect llm to apple foundation models, which run locally but with a small window size (4096 tokens), install llm-apple:

llm install llm-apple

That plugin, which uses this library by the same author to wrap Apple's FoundationModels, will let you do something like this to ask the local model how to use ffmpeg to clip a video:

$ llm -m apple "how do I use ffmpeg to trim the first 30 seconds of an mp4 file"
To trim the first 30 seconds of an MP4 file using FFmpeg, you can use its
command-line interface with a specific format for specifying the start and end
times. Here's a step-by-step guide:

I submitted a PR to add it to the llm plugin directory, but it seems like PRs are getting merged very slowly in that repo.