Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Adds multiple input options for the underlying data source.
Syntax
options(**options)
Parameters
| Parameter | Type | Description |
|---|---|---|
**options |
dict | Key-value pairs of options. |
Returns
DataStreamReader
Examples
spark.readStream.options(x="1", y=2)
# <...streaming.readwriter.DataStreamReader object ...>
Specify options as a dictionary:
spark.readStream.options(**{"k1": "v1", "k2": "v2"})
# <...streaming.readwriter.DataStreamReader object ...>
Generate 10 rows per second with 10 partitions using the Rate source:
import time
q = spark.readStream.format("rate").options(
rowsPerSecond=10, numPartitions=10
).load().writeStream.format("console").start()
time.sleep(3)
q.stop()