mdneuzerling

There’s a concept in R of an analysis as a package, in which everything you need for your data analysis is contained within a custom package. When you install the package and build the vignettes, the data analysis is performed and results saved as a pretty HTML or PDF file, generated with R Markdown. I wanted to extend this concept to a machine learning model as a package.

The idea here is that, using vignettes, we can make equivalent installing a package with training a model. The functions in the package can be used in model training or for scoring new data, probably with some overlap. To demonstrate this I’ve created a simple sentiment analysis model based on review data from the UCI Machine Learning Repository.

You can check out the repository for the model/package here. I’ve also copied the output of the vignette so you can see what’s knitted when the package is installed. You can install this package with devtools::install_github("mdneuzerling/ModelAsAPackage", build_vignettes = TRUE). The package can be loaded and attached with library(ModelAsAPackage) and the training vignette opened with vignette("model-training", package = "ModelAsAPackage").

Want to see the (not-so-great) model score some text? Try giving an argument to the sentiment function. I’m happy to report that sentiment("love") == "good".

I thought this might work because of a few things:

• Vignettes are created before the source code is bundled, so in theory we can train a model before the package has finished compiling.
• R uses lazy evaluation, so if a package function refers to an object that doesn’t yet exist (because it hasn’t been created by the vignette) that’s okay.
• I like using the same functions for model training as I do for model scoring, like the map_to_dtm function in this package.
• I wanted to take full advantage of roxygen2 for documenting package functions, and testthat for unit tests. I especially like the ease with which you can test within RStudio.

However, I have my doubts:

• In order for tests to work, I have to run devtools::build_vignettes before running devtools::install. There’s something here with namespaces whereby the data objects suddenly become “unexported” after tests are attempted. I don’t know why!
• There are some relative paths in the code. I’m assuming that the working directory is <package_root>/vignettes when this vignette is knitted, so I can move up one level to obtain the root directory of the package. This should be okay if we’re following the standard package structure, but I’ve been hurt too many times by relative file paths to feel comfortable about this.
• I’m not sure how this would operate with the plumber package. I don’t know if we can integrate the expected plumber.R function in the package, except for sticking it in the inst directory and then finding it with system.file.
• This all seems like a lot of complexity for not too much benefit. Maybe doing this again would be easier now that I have a template.

These sorts of projects should be shared, even if I don’t think that this is a major success!

A quick shout out for the excellent book on R packages by Hadley Wickham. It’s well worth keeping bookmarked.