_constraint_propagation#
Defines a visitor for propagating constraints through transformations.
Functions#
Propagate a list of constraints through a transformation unmodified. |
|
Propagate a list of constraints through replacement transformations. |
|
Propagate a list of constraints through a Rename transformation. |
|
Propagate a list of constraints through a Select transformation. |
|
Propagate a list of constraints through a Map transformation. |
|
Propagate a list of constraints through a FlatMap transformation. |
|
Propagate a list of constraints through a JoinPrivate transformation. |
|
Propagate a list of constraints through a JoinPublic transformation. |
- propagate_unmodified(_expr, constraints)#
Propagate a list of constraints through a transformation unmodified.
- Parameters
_expr (Union[tmlt.analytics.query_expr.Filter, tmlt.analytics.query_expr.DropInfinity, tmlt.analytics.query_expr.DropNullAndNan]) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_replace(expr, constraints)#
Propagate a list of constraints through replacement transformations.
- Parameters
expr (Union[tmlt.analytics.query_expr.ReplaceInfinity, tmlt.analytics.query_expr.ReplaceNullAndNan]) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_rename(expr, constraints)#
Propagate a list of constraints through a Rename transformation.
- Parameters
expr (tmlt.analytics.query_expr.Rename) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_select(expr, constraints)#
Propagate a list of constraints through a Select transformation.
- Parameters
expr (tmlt.analytics.query_expr.Select) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_map(expr, constraints)#
Propagate a list of constraints through a Map transformation.
- Parameters
expr (tmlt.analytics.query_expr.Map) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_flat_map(expr, constraints)#
Propagate a list of constraints through a FlatMap transformation.
- Parameters
expr (tmlt.analytics.query_expr.FlatMap) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_join_private(join_cols, overlapping_cols, left_constraints, right_constraints)#
Propagate a list of constraints through a JoinPrivate transformation.
- Parameters
join_cols (Set[str]) –
overlapping_cols (Set[str]) –
left_constraints (List[tmlt.analytics.constraints.Constraint]) –
right_constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type
- propagate_join_public(join_cols, overlapping_cols, public_df, constraints)#
Propagate a list of constraints through a JoinPublic transformation.
- Parameters
join_cols (Set[str]) –
overlapping_cols (Set[str]) –
public_df (pyspark.sql.DataFrame) –
constraints (List[tmlt.analytics.constraints.Constraint]) –
- Return type