spark_transformations

Transformations for manipulating Spark DataFrames.

Modules

add_remove_keys	Transformations that transform dictionaries using AddRemoveKeys.
agg	Transformations for grouping and aggregating Spark DataFrames.
filter	Transformations for filtering Spark DataFrames.
groupby	Transformations for performing groupby on Spark DataFrames.
id	Add a column containing a unique id for each row in a Spark DataFrame.
join	Transformations for joining Spark DataFrames.
map	Transformations for applying user defined maps to Spark DataFrames.
nan	Transformations to drop or replace NaNs, nulls, and infs in Spark DataFrames.
partition	Transformations for partitioning Spark DataFrames.
persist	Transformations for persisting and un-persisting Spark DataFrames.
rename	Transformations for renaming Spark DataFrame columns.
select	Transformations for selecting columns from Spark DataFrames.
truncation	Transformations for truncating Spark DataFrames.