Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Adds multiple output options for the underlying data source.
Syntax
options(**options)
Parameters
| Parameter | Type | Description |
|---|---|---|
**options |
dict | Key-value pairs of options. |
Returns
DataStreamWriter
Examples
df = spark.readStream.format("rate").load()
df.writeStream.options(**{"k1": "v1", "k2": "v2"})
# <...streaming.readwriter.DataStreamWriter object ...>
Print 3 rows per batch without truncation:
import time
q = spark.readStream.format(
"rate").option("rowsPerSecond", 10).load().writeStream.format(
"console").options(numRows=3, truncate=False).start()
time.sleep(3)
q.stop()