33 docs tagged with "gems"

Aggregate

Group data and apply aggregation methods or pivot operations

Remove rows with duplicate values of specified columns

Filter your data based on a custom filter condition

Read from or write to Tables managed by a Hive metastore

Join one or more DataFrames on conditions

Reading and writing data from Apache Kafka in batch mode

Limit the number of rows

Sort your data based on one or more Columns

Select one or more columns or values using expressions and functions.

Create multiple DataFrames based on filter conditions

Add, Edit, Rename or Drop Columns

Union, Intersect and Difference

Create DataFrames based on custom SQL queries

Aggregate and transform Windowed data

Explore the basics of working with XLSX (Excel) files with Prophecy