Feedback Edit

SparkRequest Class

  • Reference

SparkRequest.

Inheritance
Model
SparkRequest

Constructor

SparkRequest(*, name: Optional[str] = None, file: Optional[str] = None, class_name: Optional[str] = None, arguments: Optional[List[str]] = None, jars: Optional[List[str]] = None, python_files: Optional[List[str]] = None, files: Optional[List[str]] = None, archives: Optional[List[str]] = None, configuration: Optional[Dict[str, str]] = None, driver_memory: Optional[str] = None, driver_cores: Optional[int] = None, executor_memory: Optional[str] = None, executor_cores: Optional[int] = None, executor_count: Optional[int] = None, **kwargs)

Parameters

name
str
Required
file
str
Required
class_name
str
Required
arguments
list[str]
Required
jars
list[str]
Required
python_files
list[str]
Required
files
list[str]
Required
archives
list[str]
Required
configuration
dict[str, str]
Required

Dictionary of <string>.

driver_memory
str
Required
driver_cores
int
Required
executor_memory
str
Required
executor_cores
int
Required
executor_count
int
Required