Enables R users to run large language models locally using 'GGUF' model files
and the 'llama.cpp' inference engine. Provides a complete R interface for loading models,
generating text completions, extracting vector representations, and streaming responses in real-time.
Includes grammar-constrained generation for structured output, text classification,
and retrieval-augmented generation (RAG) pipelines. Models can also be served to many
users at once as an HTTP API compatible with the 'OpenAI' chat completions API.
Supports local inference without
requiring cloud APIs or internet connectivity, ensuring complete data privacy and
control. Based on the 'llama.cpp' project by Georgi Gerganov (2023) <https://github.com/ggml-org/llama.cpp>.
| Version: |
0.7.0 |
| Depends: |
R (≥ 4.0) |
| Imports: |
Rcpp (≥ 1.0.0), parallel, utils, tools |
| LinkingTo: |
Rcpp |
| Suggests: |
testthat (≥ 3.1.7), knitr, rmarkdown, curl, shiny, openssl, jsonlite, httr, plumber, promises, later, DBI, RSQLite, callr, ellmer, httpuv |
| Published: |
2026-11-17 |
| DOI: |
10.32614/CRAN.package.edgemodelr |
| Author: |
Pawan Rama Mali [aut, cre, cph],
Georgi Gerganov [aut, cph] (Author of llama.cpp and GGML library),
The ggml authors [cph] (llama.cpp and GGML contributors),
Jeffrey Quesnelle [ctb, cph] (YaRN RoPE implementation),
Bowen Peng [ctb, cph] (YaRN RoPE implementation),
pi6am [ctb] (DRY sampler from Koboldcpp),
Ivan Yurchenko [ctb] (Z-algorithm implementation),
Dirk Eddelbuettel [ctb, rev] |
| Maintainer: |
Pawan Rama Mali <prm at outlook.in> |
| BugReports: |
https://github.com/PawanRamaMali/edgemodelr/issues |
| License: |
MIT + file LICENSE |
| Copyright: |
see file COPYRIGHTS |
| URL: |
https://github.com/PawanRamaMali/edgemodelr |
| NeedsCompilation: |
yes |
| SystemRequirements: |
GNU make or equivalent for building |
| Citation: |
edgemodelr citation info |
| Materials: |
NEWS |
| CRAN checks: |
edgemodelr results |