Ollama
Runs large language models locally rather than calling a hosted API, which keeps the data on your own machine.
I introduced Ollama at Bader Rutter as part of getting the agency to explore local AI, and wrote guides for integrating it into Node.js and Python.
- Age
- 3 years (since 2023)
Experience highlights
- Keep data handling simple: if the data never leaves the building, there is no question of what a cloud provider will do with it.
- Develop embedded AI solutions without depending on external model APIs.
- Run and integrate models in locally controlled environments.
From the blog
Related writing
Articles from JWS News and DEV that relate to Ollama.
My thoughts on AI
Over the past few years, I have written extensively about large language models and machine learning. Back in 2024, I even presented at DevCon Midwest on this topic. While I advocate for the smart use of AI, I have noticed an alarming trend. In late 2023 and early 2024, many app…
How to build a social media bot that can describe an image for you
Previously, we have looked at how to use Llama 3.2 Vision and Postman to describe an image and how to use Llama 3.2 Vision and Node to describe an image. In today’s post, I want to build a social media bot as a front-end for the same Llama 3.2 Vision model. In August, we looked…
How can you use Llama 3.2 Vision and Node to describe an image?
In today’s article, we look at how to use Node.js, Ollama, and Llama 3.2 Vision to describe an image. Using this, AI can generate alt-text for you.
How can you use Llama 3.2 Vision and Postman to describe an image?
I spent much of 2024 discussing how to use local artificial intelligence with your projects. My overarching goal is to show that you don’t need ChatGPT or Copilot to use AI with your projects. Mr. Scoops got the best response, but my favorite example was using LLaVA to describe…
Retrieval-Augmented Generation Questions
Back in July, we examined how to use Culver’s custard API to train llama3:8b on the flavor of the day at Milwaukee-area Culver’s locations. Earlier this week, we discussed enabling the public to query the model through a social media account. Before we move on to the next topic,…
Lets play with even more Milwaukee custard data
Last month, we looked at how to get the custard “flavor of the day” data for Culver’s and Kopp’s. We focused on those two shops because there were APIs available for them. Most custard shops won’t have that. A lot of the smaller shops barely even have a website. Back…
Finding related thoughts…