| Port details | 
	
	
			
-  llama-cpp Facebook's LLaMA model in C/C++
 
 
-  6922 misc 
 =3           6374Version of this port present on the latest quarterly branch. - Maintainer: yuri@FreeBSD.org 
  - Port Added: 2024-02-15 11:27:23
 
- Last Update: 2025-11-02 07:22:21
 
- Commit Hash: 9759e20
 
- People watching this port, also watch:: autoconf, ta-lib, weberp, prestashop, irrlicht
 - License: MIT
 
- WWW: 
 - https://github.com/ggerganov/llama.cpp
 - Description:
 - The main goal of llama.cpp is to enable LLM inference with minimal setup and
state-of-the-art performance on a wide variety of hardware - locally and in
the cloud.
        ¦   ¦   ¦   ¦   
- Manual pages:
 
- FreshPorts has no man page information for this port.
 
- pkg-plist: as obtained via: 
make generate-plist - USE_RC_SUBR (Service Scripts)
 - 
 - Dependency lines:
 - 
- llama-cpp>0:misc/llama-cpp
 
  - To install the port:
 -  cd /usr/ports/misc/llama-cpp/ && make install clean
 - To add the package, run one of these commands:
 - pkg install misc/llama-cpp
 - pkg install llama-cpp
  NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.- PKGNAME: llama-cpp
 - Flavors: there is no flavor information for this port.
 - distinfo:
 - TIMESTAMP = 1762064711
SHA256 (ggerganov-llama.cpp-b6922_GH0.tar.gz) = f082dd1e28b99ceafe5e60684eadde1eb0c07e0f6d4aba5a2275a4ebaff46235
SIZE (ggerganov-llama.cpp-b6922_GH0.tar.gz) = 26136742
  
 Packages (timestamps in pop-ups are UTC): 
- Dependencies
 - NOTE: FreshPorts displays only information on required and default dependencies.  Optional dependencies are not covered.
 - Build dependencies:
 - 
- glslc : graphics/shaderc
 - vulkan-headers>0 : graphics/vulkan-headers
 - cmake : devel/cmake-core
 - ninja : devel/ninja
 
  
- Runtime dependencies:
 - 
- python3.11 : lang/python311
 
  
- Library dependencies:
 - 
- libcurl.so : ftp/curl
 - libvulkan.so : graphics/vulkan-loader
 
  
- This port is required by:
 - for Run
 
- 
					            
- devel/tabby
 
  
  
Configuration Options: 
- ===> The following configuration options are available for llama-cpp-6922:
     CURL=on: Data transfer support via cURL
     EXAMPLES=on: Build and/or install examples
     VULKAN=on: Vulkan GPU support
===> Use 'make config' to modify these settings
 - Options name:
 
- misc_llama-cpp
 - USES:
 
- cmake:testing compiler:c++11-lang python:run shebangfix localbase
 
- pkg-message:
 - For install:
 - You installed LLaMA-cpp: Facebook's LLaMA model runner.
In order to experience LLaMA-cpp please download some
AI model in the GGUF format, for example from huggingface.com,
run the script below, and open localhost:9011 in your browser
to communicate with this AI model.
$ llama-server -m $MODEL \
  --host 0.0.0.0 \
  --port 9011 \
  -ngl 15
or
you can add the following lines to /etc/rc.conf,
start the llama-server service,
and navigate to http://localhost:8080:
> llama_server_enable=YES
> llama_server_model=/path/to/models/llama-2-7b-chat.Q4_K_M.gguf
> llama_server_args="--device Vulkan0 -ngl 27"
 
 - Master Sites:
 
 
 | 
| Commit History - (may be incomplete: for full details, see links to repositories near top of page) | 
| Commit | Credits | Log message | 
4081 15 Nov 2024 09:20:28
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 4061 → 4081
Reported by:	portscout  | 
4061 10 Nov 2024 17:19:08
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 4053 → 4061
Reported by:	portscout  | 
4053 09 Nov 2024 06:06:09
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3916 → 4053
Reported by:	portscout  | 
3916 03 Nov 2024 05:25:26
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3990 → 3916
Reported by:	portscout  | 
3990 30 Oct 2024 03:54:12
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3983 → 3990  | 
3983 28 Oct 2024 07:32:16
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3982 → 3983
Reported by:	portscout  | 
3982 27 Oct 2024 20:46:57
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3974 → 3982
Reported by:	portscout  | 
3974 25 Oct 2024 03:27:39
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3952 → 3974  | 
3952 23 Oct 2024 09:44:44
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3938 → 3952
Reported by:	portscout  | 
3938 18 Oct 2024 03:25:24
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3914 → 3938  | 
3914 13 Oct 2024 21:01:41
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3902 → 3914  | 
3902 10 Oct 2024 03:36:48
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3899 → 3902  | 
3899 09 Oct 2024 03:17:34
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3889 → 3899  | 
3889 07 Oct 2024 09:42:13
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3883 → 3889
Reported by:	portscout  | 
3883 05 Oct 2024 03:09:27
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3878 → 3883  | 
3878 04 Oct 2024 04:24:52
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3868 → 3878
Reported by:	portscout  | 
3868 03 Oct 2024 09:17:09
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3837 → 3868
Reported by:	portscout  | 
3837 29 Sep 2024 09:31:02
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3829 → 3837
Reported by:	portscout  | 
3829 28 Sep 2024 08:29:01
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3828 → 3829
Reported by:	portscout  | 
3828 27 Sep 2024 08:38:49
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3821 → 3828
Reported by:	portscout  | 
3821 25 Sep 2024 08:33:29
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3813 → 3821
Reported by:	portscout  | 
3813 24 Sep 2024 07:52:10
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3804 → 3813
Reported by:	portscout  | 
3804 23 Sep 2024 09:47:28
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3799 → 3804
Reported by:	portscout  | 
3799 22 Sep 2024 05:51:21
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3798 → 3799
Reported by:	portscout  | 
3798 21 Sep 2024 05:01:16
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3787 → 3798
Reported by:	portscout  | 
3787 20 Sep 2024 09:13:20
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3785 → 3787
Reported by:	portscout  | 
3785 19 Sep 2024 03:11:44
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: Broken on i386
Reported by:	fallout  | 
3785 19 Sep 2024 03:11:42
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3779 → 3785  | 
3779 18 Sep 2024 09:15:59
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3778 → 3779
Reported by:	portscout  | 
3778 17 Sep 2024 18:26:00
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3761 → 3778  | 
3761 16 Sep 2024 07:48:23
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3751 → 3761
Reported by:	portscout  | 
3751 14 Sep 2024 17:53:53
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3749 → 3751
Reported by:	portscout  | 
3749 13 Sep 2024 08:24:46
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3735 → 3749
Reported by:	portscout  | 
3735 12 Sep 2024 09:18:10
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3725 → 3735
Reported by:	portscout  | 
3725 11 Sep 2024 06:58:59
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3716 → 3725
Reported by:	portscout  | 
3716 10 Sep 2024 03:30:31
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3707 → 3716  | 
3707 09 Sep 2024 15:04:25
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3687 → 3707
Reported by:	portscout  | 
3687 08 Sep 2024 04:10:05
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3678 → 3687  | 
3678 07 Sep 2024 06:24:52
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3671 → 3678
Reported by:	portscout  | 
3671 06 Sep 2024 02:42:49
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3668 → 3671  | 
3668 05 Sep 2024 02:53:25
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3658 → 3668  | 
3658 03 Sep 2024 08:35:50
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3651 → 3658  | 
3651 02 Sep 2024 07:54:45
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3647 → 3651  | 
3647 31 Aug 2024 07:16:15
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3631 → 3647
Reported by:	portscout  | 
3631 27 Aug 2024 05:46:27
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3622 → 3631
Reported by:	portscout  | 
3622 26 Aug 2024 08:20:19
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3620 → 3622
Reported by:	portscout  | 
3620 25 Aug 2024 08:04:54
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3617 → 3620  | 
3617 24 Aug 2024 15:03:33
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3616 → 3617
Reported by:	portscout  | 
3616 23 Aug 2024 05:40:23
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3615 → 3616
Reported by:	portscout  | 
3615 22 Aug 2024 09:45:43
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3609 → 3615  | 
3609 21 Aug 2024 05:09:31
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3604 → 3609
Reported by:	portscout  | 
3604 20 Aug 2024 08:42:28
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3600 → 3604
Reported by:	portscout  | 
3600 18 Aug 2024 17:02:47
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3593 → 3600
Reported by:	portscout  | 
3593 16 Aug 2024 08:44:27
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3581 → 3593
Reported by:	portscout  | 
3581 14 Aug 2024 21:06:55
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3567 → 3581
Reported by:	portscout  | 
3567 11 Aug 2024 20:54:13
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3565 → 3567  | 
3565 11 Aug 2024 07:48:40
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3560 → 3565  | 
3560 09 Aug 2024 20:11:43
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3542 → 3560  | 
3542 08 Aug 2024 17:18:45
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3538 → 3542
Reported by:	portscout  | 
3538 07 Aug 2024 09:09:44
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3510 → 3538
Reported by:	portscout  | 
3510 05 Aug 2024 14:37:00
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3506 → 3510
Reported by:	portscout  | 
3506 04 Aug 2024 09:07:26
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3505 → 3506
Reported by:	portscout  | 
3505 03 Aug 2024 08:27:26
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3503 → 3505
Reported by:	portscout  | 
3503 02 Aug 2024 09:28:07
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3498 → 3503
Reported by:	portscout  | 
3498 01 Aug 2024 14:38:24
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3490 → 3498
Reported by:	portscout  | 
3490 31 Jul 2024 08:04:06
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3488 → 3490
Reported by:	portscout  | 
3488 30 Jul 2024 08:11:15
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3485 → 3488  | 
3485 30 Jul 2024 02:01:55
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3482 → 3485
Reported by:	portscout  | 
3482 28 Jul 2024 21:25:26
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3467 → 3482
Reported by:	portscout  | 
3467 27 Jul 2024 20:19:16
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3465 → 3467
Reported by:	portscout  | 
3465 26 Jul 2024 08:57:59
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3452 → 3465
Reported by:	portscout  | 
3452 25 Jul 2024 16:58:58
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3449 → 3452
Reported by:	portscout  | 
3449 24 Jul 2024 07:43:49
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3441 → 3449
Reported by:	portscout  | 
3441 23 Jul 2024 09:28:18
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3428 → 3441
Reported by:	portscout  | 
3428 21 Jul 2024 08:49:16
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3408 → 3428
Reported by:	portscout  | 
3408 18 Jul 2024 13:28:13
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3405 → 3408
Reported by:	portscout  | 
3405 17 Jul 2024 15:17:16
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3389 → 3405
Reported by:	portscout  | 
3389 15 Jul 2024 07:19:23
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3386 → 3389
Reported by:	portscout  | 
3386 14 Jul 2024 18:20:48
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3384 → 3386
Reported by:	portscout  | 
3384 13 Jul 2024 06:46:10
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3369 → 3384
Reported by:	portscout  | 
3369 12 Jul 2024 03:51:21
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3358 → 3369
Reported by:	portscout  | 
3358 10 Jul 2024 16:00:56
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3347 → 3358
Reported by:	portscout  | 
3347 09 Jul 2024 08:12:38
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3306 → 3347
Reported by:	portscout  | 
3306 05 Jul 2024 23:56:03
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3291 → 3306
Reported by:	portscout  | 
3291 04 Jul 2024 16:31:50
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3285 → 3291
Reported by:	portscout  | 
3285 03 Jul 2024 08:18:55
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3243 → 3285  | 
3243 27 Jun 2024 07:19:38
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3232 → 3243
Reported by:	portscout  | 
3232 26 Jun 2024 15:16:54
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3218 → 3232
Reported by:	portscout  | 
3218 25 Jun 2024 16:43:44
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3209 → 3218
Reported by:	portscout  | 
3209 24 Jun 2024 07:49:04
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3202 → 3209
Reported by:	portscout  | 
3202 23 Jun 2024 09:33:48
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3197 → 3202
Reported by:	portscout  | 
3197 22 Jun 2024 07:22:25
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3186 → 3197
Reported by:	portscout  | 
3186 21 Jun 2024 01:53:00
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3173 → 3186
Reported by:	portscout  | 
3173 18 Jun 2024 09:25:05
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3163 → 3173
Reported by:	portscout  | 
3163 17 Jun 2024 08:18:35
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3153 → 3163
Reported by:	portscout  | 
3153 16 Jun 2024 16:56:35
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3151 → 3153  | 
3151 15 Jun 2024 09:12:46
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3145 → 3151
Reported by:	portscout  | 
3145 14 Jun 2024 09:11:39
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3135 → 3145
Reported by:	portscout  | 
3135 12 Jun 2024 15:26:15
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3091 → 3135
Reported by:	portscout  | 
3091 06 Jun 2024 08:49:01
        | 
    Yuri Victorovich (yuri)   | 
    misc/llama-cpp: update 3078 → 3091
Reported by:	portscout  |