Data Science at Scale With R and Sparklyr: Architecture, Ecosystem, and Current Developments


The sparklyr package, which provides an R interface to Apache Spark, has democratized big data analytics for R users. In this session, we first provide an overview of the technical architecture that enables extensibility for implementing new features. A diverse range of use cases are showcased, including graph analysis and natural language processing. We then provide an update on current active developments by the community and preview upcoming enhancements.

Reston, Virginia