Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Adds an input option for the underlying data source.
Syntax
option(key, value)
Parameters
| Parameter | Type | Description |
|---|---|---|
key |
str | The option key. |
value |
str, int, float, or bool | The option value. |
Returns
DataStreamReader
Examples
spark.readStream.option("x", 1)
# <...streaming.readwriter.DataStreamReader object ...>
Generate 10 rows per second using the Rate source:
import time
q = spark.readStream.format(
"rate").option("rowsPerSecond", 10).load().writeStream.format("console").start()
time.sleep(3)
q.stop()