Skip to content

Running Ollama outside of Docker #1

@dardjiskien

Description

@dardjiskien

I'm not a specialist. But in the Readme.md, you suggest that ollama/mistral is very slow in docker. So I'd like to use it outside of Docker.
But I see only
ollama pull mistral
And not a command to run the model.
I tried with ollama run mistral
But when I run docker-compose --profile dev up
I get: AttributeError: 'Ollama' object has no attribute 'model_id'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions