cd – Good strategy to deploy workers that process long-lasting tasks

I have multiple instances on the same worker that process long-lasting tasks. Usually, those tasks last about 30 minutes – 5 hours. Tasks are stored in RabbitMQ. Workers are deployed as Kubernetes single-container deployment with multiple replicas.

The problem is deploying new changes. I see two strategies here: interrupting current processing or deploying new workers and letting existing one’s exit by itself.

I chose the first strategy that lets me deploy new changes quickly. After a deploy is finished I could be ensured that all workers use the same codebase. But there are downsides. I need handling exit signal, task processing restarting, restoring state, checking for should I insert or update records, and so on.

So my question is, could I say that interrupting current processing to deploy new changes is a best-in-class solution? Are there other approaches here?

Jobs – YouTube tasks – 70 BMF | Proxies123.com

Thread starter Similar threads Forum Replies Date

Dark Lord

Jobs 40 BMF Points – Simple Youtube Task Marketplace 22

xTriesh!

Jobs 60 BMF Youtube Comment (Part 4) Marketplace 41

Tappman

Closed 65 BMF YouTube Task – Watch and like my YouTube video Marketplace 104

Kingcrabvn

Closed 50BMF – Watch and subscribe to youtube channel Marketplace 33

xTriesh!

Jobs Youtube Comment 60 BMF EASY (Part 3) Marketplace 36

smartcurrency

Jobs Subscribe to my YouTube Channel – easy 30 BMF Marketplace 128

J

Closed GET 65 BMF – JUST like and watch Youtube video Marketplace 59

Dark Lord

Closed 35 BMF for Simple Youtube Task Marketplace 32

Shuvo5

Deal I need 2k YouTube views. Marketplace 18

Dark Lord

Closed Get 30 BMF just to Subscribe this Youtube Channel Marketplace 213

S

Closed 50 BMF – Youtube task (Just Watch, like and subscribe – no comm) Marketplace 33

B

Closed 35 BMF – Like and Comment On Youtube Video – merry CHRISTmas to all my bmf brothers and sisters here Marketplace 21

Kambas

Closed 50 BMF – View and Comment on this YouTube Video Marketplace 100

azarias

Deal Easy task- listen to youtube and get 60 BMF Points Marketplace 5

J

Jobs I will do video (edit) for your product,video spot,music spot,site,youtube channel (what ever you want) Marketplace 7

S

Closed Watch YouTube video earn 40 BMF Points Marketplace 57

S

Deal I watch and comment three of your youtube videos if you do the same for ONE video. Marketplace 4

BMF

Closed Subscribe to a YouTube channel 50 BMF Marketplace 48

FutureNetJack

Closed Make 30 BMF for subscribing to my youtube channel. Marketplace 36

Marlboro

Closed Subscribe to my YouTube Channel 25 BMF (Limited Slot) Marketplace 75

Mark111

Deal Twitter and Youtube Real Followers Marketplace 0

rrodica6

Closed Alexamaster.net – BUY Website Traffic, BUY YouTube Views, BUY Facebook Visits Marketplace 2

CAMPER2030

Sell Freelance Video Editor ( YouTube Videos / Explainer Videos / YouTube Thumbnails ) Marketplace 0

C

Sell HIGH QUALITY CHEAP SMM SERVICES – FACEBOOK YOUTUBE TWITTER INSTAGRAM Marketplace 3

Scott W

Closed Subscribe to my YouTube Channel – 25 BMF Marketplace 146

Financial Release

Closed 100 BMF – Subscribe my Youtube channel Marketplace 38

Rexly

Sell Video on YouTube channel 100k subs Marketplace 5

Fidel Maloloy-on

Sell Adsense for youtube channel,with $43.52 earning not verified. Marketplace 2

HakimEl

Sell I want to sell my two youtube channels Marketplace 5

darran22

Closed 10,000 High Retention Youtube Views Cheap for $10 Marketplace 0

darran22

Closed I will add 700 Youtube Likes to video Marketplace 2

hansal

Deal Faucet Script With autofaucet & offerwalls &mining & tasks & pages Marketplace 11

M

Deal doing all small tasks for bmf coins or btc Marketplace 2

R

Deal 90 BMF by Completing Simple Tasks. Marketplace 1

Awan Cheyanne

Closed Earn 50 to 100 BMF Coins for 2 Tasks Marketplace 118

Seotaskfairy

Sell Daily SEO Maintenance Tasks Done For You Marketplace 3

niruktt

Deal Give 1.1 Usd Payeer and I will Give you 1200 bmf Marketplace 1

BTC bro

Deal I need 1$ Paypal .I can give you 1100 BMF for it. Marketplace 3

BTC bro

Closed I have 6$ BTC .I need skrill or bmf for it Marketplace 2

azarias

Closed Install app + enter code 50 BMF Marketplace 11

xTriesh!

Deal 1000 BMF for 300 Doges Marketplace 5

btcminer

Closed 50 BMF / VERY EASY Marketplace 35

S

Closed 50 bmf points for sign up Marketplace 16

kicktracer011

Closed Follow, like and share tweet (50 BMF) Marketplace 33

Voltagetherealone

Closed Mega Offer 100 BMF + 0,05 ETH Marketplace 18

xTriesh!

Jobs 60 BMF Comment YT Video (Part 2) Marketplace 32

kocicka19

Closed GET 200 BMF FOR JOB Marketplace 74

sunice

Jobs Easy Sign up for 150 bmf Marketplace 4

xTriesh!

Jobs Easy Task 60 BMF Comment YT Video Marketplace 50

higming

Deal $4.73 Worth of BAT for $4.3 in Paypal, or BMF Marketplace 7

What are most important SEO tasks in order of priority?

Hello friends,



What are most important SEO tasks in order of priority?

What Are The Important Quality Link Building Tasks In Seo..?

 

What are the important quality link building tasks in SEO..? – SEO Help (General Chat)

Link building is the practice of building one-way hyperlinks (also known as “backlinks”) to a website with the goal of improving search engine visibility. Common link building strategies include content marketing, building useful tools, email outreach, broken link building and public relations.

Develop bot for automating your bulk tasks for $5

Develop bot for automating your bulk tasks

NOTE : Please contact me first before making an order so we can discuss the details and scope of the required program.Are you looking for a programmer to create an automated applications for your bulk tasks? I will provide 5 years of expert level experience in different programming fields.


I will do:

  • Automated web scraping & data mining
  • Automated VBA macros
  • Facebook / Instagram / Twitter automations
  • and various tasks according to your requirements

Languages I use: 
Final application will be offered as an user friendly portable (.exe)  application with graphical user interface (GUI), so you can perform your actions in less time and more focused. Also you will get a full documentation about your application in final delivery.

I am always open for your support and feel free to message me anytime to get my help.

.(tagsToTranslate)python(t)Bot(t)Scraping

multithreading – What is the best way to decouple and define the orchestration (coordination) of concurrent tasks?

I have a data synchronisation concurrent algorithm. It does the following: get data and files from server, send data and files to server, save them to database / filesystem. Imagine the system like this:

  1. You have 1000 functions. Each one does some atomic operation. For instance, fetch latest objects of type X and insert them into DB; upload this file of type Y and so on. Each function is independent and can act on its own, it does not communicate with or affect other functions. On the other hand, none of them is a pure function, because they all use theese common resources (fetching data from the server, puting data on DB, saving files on filesystem)
  2. You have a single entry point for the sychronization mechanism. The outside of the sync system can start the sync, say, by doing a Sync.start() call. Also, the sync has a single exit point. The sync can finish with either success, either failure (if any of those functions from (1) fail, the whole sync will fail). The ouside of the sync system can subscribe to onSyncSuccess / onSyncError events.
  3. You have this black box in the middle of the system. This could be, for instance, a single threaded algorithm calling those 1000 functions from (1). But I made it concurrent.

Now consider this. This concurrent algorithm right now is rigid because the way in which the functions are called is hardcoded. If I want to take a bunch of functions from (1) that right now are executing sequentially, and if I want to make them execute parallel, it would be impossible without refactoring the whole class hierarchy.

I was thinking about the concept of direct acyclic graphs, and I made my own domain-specific language in Kotlin to define such task graphs. Now I could write the whole orchestration declaratively like this:

notifySyncWasStarted()
runSequentialy {
    task { doTask1() }
    runInParallel {
        task { doTask2() }
        task { doTask3() }
    }
    task { doTask4() }
}
notifySyncWasStopped()

So first task1 gets executed, then task2 and 3 in the same time, then task4. By keeping this graph in a single file, I could easily modify the way tasks are executed. For instance, I could easily swap tasks:

notifySyncWasStarted()
runSequentialy {
    runInParallel {
        task { doTask4() }
        task { doTask2() }
    }
    task { doTask3() }
    task { doTask1() }
}
notifySyncWasStopped()

Here, (task 4 and 2) gets executed, then 3, then 1. This works by using the fork-join paradigm, I create threads then join them into the parent thread.

In contrast, right now, the algorithm is spread around multiple classes, each of them was designed to run the tasks in a specific manner. Changing how tasks are ran would mean to refactor the classes and how they communicate to each other.

The question is: What is the best way to decouple and define the orchestration (coordination) of concurrent tasks? So that this orchestration could be easily changed in the future? Is my solution optimal or the way to go (direct acyclic graphs, fork-join, plus a domain specific language)? Or maybe there are some other design patterns that do the same thing?

How to read Assigned To column from SharePoint Workflow Tasks List using Powershell?

I am trying to fetch List details along with associated task columns to export into Excel using PowerShell. I am able to get all columns using following script except Assigned To column to show with which user the task is pending with from associated task list.

foreach ($item in $list.Items |  Where-Object { $_("Approval") -eq "15"})
{
   foreach($workflow in $item.workflows)`
   {
      if($item.ID -eq $workflow.ItemId)
        {
         $wfName = $wf.Name
         $wfItem = $workflow.ItemName
         $wfPendingWith = $workflow.AssignedTo
         write-host "Title: $wfName  ListItem: $wfItem PendingWith:$wfPendingWith"
        }
    }
}

Can you please point out what am I missing here? Thanks.

cluster – Tasks Scheduler Windows High Availability

What is the best way to put in place «tasks scheduler» with high availability under Windows?

Currently, the tasks are planned on a single server, which is a problem when the server reboot (for many reasons)

Is there a Cluster system to resolve that?

Typically two servers, one master, the other slave and when the master is no longer available, then the task is taken over by the slave who becomes master?

I read this link which could respond to my problem, but there is no indication of how to create the cluster.

web development – MVC design pattern – To implement common tasks of web application framework

The common tasks of web application framework(ex: Django or Laravel or .NET):

request / response abstraction 
session state 
user authentication & authorisation 
page templating 
URL mapping 
DB access 
security 
caching

To implement above common tasks, MVC design pattern handles these tasks, as shown below:

  1. URL mapping is handled by Controller of MVC. Controller routes requests to handlers. Ex: http.ServeMux is the controller from GOLang package

  2. request / response abstraction is performed by Controller by registering the handlers, written by web developer, as shown below:

    sm := http.NewServeMux()     // in GoLang
    
    sm.Handle("/", productHandler)
    
  3. session state is handled by the handler code written by web developer

  4. Page templating is handled by templating engine(view component) of MVC

  5. user authentication & authorisation is handled by the handler code written by web developer

  6. DB access is handled by model component of MVC.

  7. security and caching is handled by handler code written by web developer


Is this the right understanding on MVC design pattern to implement common tasks of web application framework?