Skip to main content

Script

Provides a SparkSession and allows you to run custom code

Parameters

ParameterMeaningRequired
Input Dataframe(s)Input dataframe(s)False
Output Dataframe(s)Output dataframe(s)False
CodeCustom code to be executedTrue
info

To remove input/output dataframe(s), simply click icon on the left sidebar

Script - Remove inputs

Examples


Script Gem with Input and Output: Un-pivoting a Dataframe

We'll perform the unpivot operation using our custom code

Script - Unpivot


Script Gem with only Output: Generating a Dataframe

We'll use the provided SparkSession to create and return a dataframe

note

Since we removed the input port, we don't see input dataframe in the method signature

Script - Unpivot