Local LLMs … and why you might want to consider using them

I recently took part in a fun presentation at the Association of Survey Computing (ASC) one-day conference at the Kennington Oval in London in May. Andy Woods and I sparred in a 5-quick-fire rounds about new tech that we feel will impact survey research.

In one of my 5, I am predicting (and in some ways recommending) that we look to use local LLMs more often.

I feel that we all need to be much more careful about the “data” (in all senses) that we are sharing with cloud LLMs. But on the flip side, local LLMs are becoming more accessible and capable.

Here is a handful of slides and a short canned demo that talks about all that:

LocalLLMs_21may26_1