hfhub

hfhub is a minimal port of huggingface_hub that allows downloading files from Hugging Face Hub and caching them with the same structure used in the original implementation.

Installation

hfhub can be installed from CRAN with:

install.packages("hfhub")

You can install the development version of hfhub like so:

remotes::install_github("mlverse/hfhub")

Example

hub_download can be used to download and cache a file from any Hugging Face Hub repository. It returns a path to the file.

library(hfhub)
path <- hub_download("gpt2", "config.json")
str(jsonlite::fromJSON(path))

Authentication

You can set the HUGGING_FACE_HUB_TOKEN environment variable with the value of a token obtained in the Access Token section of the Hugging Face account setting page. This will allow you to download private files from Hugging Face Hub.