Need perform aggregation operartion in pysaprk streaming job
I’m receiving data of multiple sensors in stream in every 1 minute interval into databricks. Need to create a new sensor name ‘PQRS’ if sensors ‘ABC’ and ‘DEF’ is available for each pyspark streaming load and the value of the sensor should average of value of ABC and DEF. Input data(1 min stream) sensor_name value … Read more