Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Removes all cached tables from the in-memory cache.
Syntax
clearCache()
Notes
Cached data is shared across all Spark sessions on the cluster, so clearing the cache affects all sessions.
Examples
_ = spark.sql("DROP TABLE IF EXISTS tbl1")
_ = spark.sql("CREATE TABLE tbl1 (name STRING, age INT) USING parquet")
spark.catalog.clearCache()
spark.catalog.isCached("tbl1")
# False
_ = spark.sql("DROP TABLE tbl1")