This post is amazing, and your title dramatically undersells/you buried the lede that
a) you've intentionally peered into the future (a world where LLMs are small enough and mobile/other devices are powerful enough that they'll live in our pockets) -- and
b) started tinkering by running local instances on your more powerful computer -- definitely going to steal your ideas and recipes here to start playing with these in more organic, direct ways!
This post is amazing, and your title dramatically undersells/you buried the lede that
a) you've intentionally peered into the future (a world where LLMs are small enough and mobile/other devices are powerful enough that they'll live in our pockets) -- and
b) started tinkering by running local instances on your more powerful computer -- definitely going to steal your ideas and recipes here to start playing with these in more organic, direct ways!