Изменить

RxHdfsFileSystem: RevoScaleR HDFS File System object generator

  • Статья

Description

This is the main generator for RxHdfsFileSystem S3 class.

Usage

    RxHdfsFileSystem( object, hostName = rxGetOption("hdfsHost"), port = rxGetOption("hdfsPort"), useWebHdfs = FALSE, oAuthParameters = NULL, verbose = FALSE )

     ## S3 method for class `RxHdfsFileSystem':
print  ( x, ... )

Arguments

object

object of class RxHdfsFileSystem. This argument is optional. If supplied, the values of the other arguments are used to replace those of object and the modified object is returned. If these arguments are not supplied, they will take their default values.

hostName

character string specifying name of host for HDFS file system.

port

integer specifying port number.

useWebHdfs

NOT YET IMPLEMENTED Optional Flag indicating whether this is a HDFS or a WebHdfs interface - default FALSE

oAuthParameters

NOT YET IMPLEMENTED Optional list of OAuth2 parameters created using rxOAuthParameters function (valid only if useWebHdfs is TRUE) - default NULL

verbose

Optional Flag indicating "verbose" mode for WebHdfs HTTP calls (valid only if useWebHdfs is TRUE) - default FALSE

x

an RxHdfsFileSystem object.

...

other arguments are passed to the underlying function.

Details

Writing to the HDFS file system can only be done using a RxHadoopMR compute context with an RxXdfData data source. The 'rxHadoop' commands, such as rxHadoopCopy, can also be used to manipulate data sets in HDFS.

Value

An RxHdfsFileSystem file system object. This object may be used to in rxSetFileSystem, rxOptions, RxTextData, or RxXdfData to set the file system.

Author(s)

Microsoft Corporation Microsoft Technical Support

See Also

RxFileSystem, RxNativeFileSystem, rxSetFileSystem, rxOptions, RxXdfData, RxTextData, rxOAuthParameters.

Examples


 # Setup to run analyses to use HDFS file system
 ## Not run:

myHdfsFileSystem <- RxHdfsFileSystem(hostName = "myHost", port = 8020)
rxSetFileSystem(fileSystem = myHdfsFileSystem )
## End(Not run)