Tag:Dispatch

  • Dataworks relocation scheme: Azkaban job is migrated to dataworks

    Time:2021-9-15

    Introduction:The dataworks Migration Assistant provides the function of task relocation and supports the rapid migration of tasks from open source scheduling engines oozie, Azkaban and airflow to dataworks. This paper mainly introduces how to migrate jobs from open source Azkaban workflow scheduling engine to dataworks. The dataworks Migration Assistant provides the function of task relocation […]

  • (process management) 05. Process scheduling algorithm

    Time:2021-9-15

    Process scheduling is that the process in thread state obtains the use right of CPU, and the process changes from ready state to running state. Process scheduling can be divided into: The preemptive system will schedule according to the priority of processes, and processes can jump in lineThe non preemptive system is scheduled according to […]

  • Dataworks relocation scheme: airflow job is migrated to dataworks

    Time:2021-9-14

    Introduction:Dataworks provides the function of task relocation and supports the rapid migration of tasks from open source scheduling engines oozie, Azkaban and airflow to dataworks. This paper mainly introduces how to migrate jobs from the open source airflow workflow scheduling engine to dataworks Dataworks provides the function of task relocation and supports the rapid migration […]

  • Interviewer: process and thread, I only ask these 19 questions!

    Time:2021-9-4

    The following article comes from the program meow, the author of the program meow Here is my painstaking and painstaking work completed in half a month: What is a process? Standard definition:A process is a process in which a program with certain independent functions executes dynamically on a data set in turn. A process is […]

  • React source code analysis 16. Concurrent mode

    Time:2021-8-31

    React source code analysis 16. Concurrent mode Video course (efficient learning): enter the course Course Directory: 1. Introduction and interview questions 2. Design concept of react 3. React source code architecture 4. Source directory structure and debugging 5. JSX & Core API 6. Legacy and concurrent mode entry functions 7. Fiber architecture 8. Render stage […]

  • Comparison of technology selection of spring boot timed tasks

    Time:2021-8-20

    Hello everyone, I’m grandma, a little fat man who rolls yards on the subway every day~ Today, let’s take a look at the technology selection of timed tasks in the spring boot application~ 1. General In the colorful and black demand of products, there is a kind of demand that needs to goTimed execution, you […]

  • How are threads scheduled?

    Time:2021-8-19

    How are threads scheduled in the operating system? Or what are the methods of thread scheduling? Recently, in addition to some operating system knowledge, thread scheduling is an unavoidable problem for the operating system. I feel a lot about its solution from simple to deep, which is recorded here. First come, first served For the […]

  • Practice and understanding of k8s health examination mechanism

    Time:2021-8-16

    IbackgroundRecently, Devops (integration of development, operation and maintenance) was implemented in the company, and the original docker swarm cluster was migrated to k8s cluster. In case of inconsistency between the health check of the original cluster and the health check of the existing cluster, here is a summary.IIPrinciple and necessityApplication health check, as the name […]

  • Go synergy simple learning

    Time:2021-8-15

    What is a collaborative process? A coroutine is similar to a thread, but lighter than a thread. A program startup will occupy a process, and a process can have multiple threads, and a thread can have multiple coprocedures. A process contains at least one main thread, and a main thread can have more sub threads. […]

  • Fluid: an important puzzle for big data and AI to embrace cloud Nativity

    Time:2021-8-14

    Introduction:How to drive big data and AI applications to run efficiently in the cloud native scenario is an important challenging problem with both theoretical significance and application value. In order to systematically solve relevant problems, academia and industry cooperate closely, Dr. Gu Rong, associate researcher of pasalab, Nanjing University, Che Yang, senior technical expert of […]

  • How does go zero deal with massive timed / delayed tasks?

    Time:2021-8-10

    There are a large number of scheduling tasks in a system, and the scheduling tasks have time lag. If each scheduling task uses its own scheduler to manage the task life cycle, it will waste CPU resources and be very inefficient. This article introducesgo-zeroinDelay operation, it may allow developers to schedule multiple tasks,Just focus on […]

  • The ideal technical framework for Internet companies! After reading my collection

    Time:2021-8-9

    This paper discusses the technical architecture of Internet companies, including DNS, load balancing, long connection, API gateway, push push, microservices, distributed transactions and related supporting basic services. Mainly for learning, I hope I can give you a reference. Overall architecture Callers such as app, PC and third parties obtain the IP of the load balancer […]