This post is amazing, and your title dramatically undersells/you buried the lede that
a) you've intentionally peered into the future (a world where LLMs are small enough and mobile/other devices are powerful enough that they'll live in our pockets) -- and
b) started tinkering by running local instances on your more powerful computer -- definitely going to steal your ideas and recipes here to start playing with these in more organic, direct ways!
This post is amazing, and your title dramatically undersells/you buried the lede that
a) you've intentionally peered into the future (a world where LLMs are small enough and mobile/other devices are powerful enough that they'll live in our pockets) -- and
b) started tinkering by running local instances on your more powerful computer -- definitely going to steal your ideas and recipes here to start playing with these in more organic, direct ways!
It might only be the lede for people who are the same kind of nerd as you & me ;)