Skip to content

ggml : add predefined list of CPU backend variants to build#10626

Merged
slaren merged 4 commits into
masterfrom
sl/dl-backend-6
Dec 4, 2024
Merged

ggml : add predefined list of CPU backend variants to build#10626
slaren merged 4 commits into
masterfrom
sl/dl-backend-6

Conversation

@slaren

@slaren slaren commented Dec 2, 2024

Copy link
Copy Markdown
Member

GGML_CPU_ALL_VARIANTS enables the build of multiple variants of the CPU backend for different intel microarchitectures.

@github-actions github-actions Bot added script Script related devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning labels Dec 2, 2024
@slaren slaren force-pushed the sl/dl-backend-6 branch 2 times, most recently from e48c2eb to 726f515 Compare December 3, 2024 00:41
@slaren

slaren commented Dec 4, 2024

Copy link
Copy Markdown
Member Author

This changes the working directory of the CPU docker images to /app (previously it was the root directory, which seems too crude, even for a container). It is possible that this may break scripts that use a relative path to load models. cc @ngxson

@ngxson

ngxson commented Dec 4, 2024

Copy link
Copy Markdown
Collaborator

Thanks for pinging. Yes it make much more sense to set workdir to /app in Dockerfile. HF endpoints should not be affected because model path is always an absolute path.

We should mention this change in the server changelog too, just in case.

@slaren slaren merged commit 59f4db1 into master Dec 4, 2024
@slaren slaren deleted the sl/dl-backend-6 branch December 4, 2024 13:45
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Dec 20, 2024
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
phibya pushed a commit to ziee-ai/llama.cpp that referenced this pull request May 29, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
AlexiAlp pushed a commit to minghaop/llama.cpp that referenced this pull request Jun 2, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
AlexiAlp pushed a commit to minghaop/llama.cpp that referenced this pull request Jun 2, 2026
…#10626)

* ggml : add predefined list of CPU backend variants to build

* update CPU dockerfiles
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning script Script related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants