3.9 resource limitations of containers

Time:2021-11-14

usedocker run --helpYou can see which resources of the container can be restricted

#The following command limits the available memory of the container to 200m
#Docker also allocates virtual memory of the same size for containers by default, so it adds up to 400m
#Run the stress pressure measurement tool and find that it can run normally below 400m, and the operation above 400m will fail
sudo docker run -it --memory 200M ubuntu-stress-tool -m 1 --vm-bytes 410M --verbose

Recommended Today

Summary of spark conf and config configuration items

1. State configuration item summary of structured streaming Config Name Description Default Value spark.sql.streaming.stateStore.rocksdb.compactOnCommit Whether we perform a range compaction of RocksDB instance for commit operation False spark.sql.streaming.stateStore.rocksdb.blockSizeKB Approximate size in KB of user data packed per block for a RocksDB BlockBasedTable, which is a RocksDB’s default SST file format. 4 spark.sql.streaming.stateStore.rocksdb.blockCacheSizeMB The size capacity […]