Golang Java Operator Spark Yarn Zookeeper
-
Zookeeper Election Mechanism Introduction
What’s zookeeper? Zookeeper is a distributed system. In most cases, zookeeper acts as a coordinator, rather than a storage or message queue. For instance, let’s say we wanna inform other systems after we have done some stuffs, in this scerario, we can create a path as a signal on zabbix, and systems which want to…
-
spark executor memory introduction
Overview Hello everyone, today I would like to introduce a problem that we often encounter in our work: “Container killed by YARN for exceeding memory limits”. What causes this problem? What is the difference between this problem and OOM? What is the relationship between this problem and the memory structure of Spark Executor? Today, let’s…
-
What’s virtual thread in JDK 19?
Recently, JDK 19 was released, which introduced several new features. One of the more notable features is the addition of virtual threads. Many people may be confused about what virtual threads are and how they differ from the platform threads we currently use. To understand virtual threads in JDK 19, we first need to understand…