Asynchronous and shares: how to make information about the state of the global for workerb?

I have a class that checks for new articles on the site (parses the list of URLs, finds the index of the (last) of the last article and if it is not zero - it updates your last url, writes out the URLs one by one in the file and sends it to another class that verifies that they're really new (gets into the same file and extracts the one other url (except the last one, maybe this is our url), compares pictures and makes the metric headings).
The fact that the comparison process is quite long, and tasks are assigned celery every minute. But when javlaetsa the second worker is created, it starts from the beginning and does not see the latest updates of the url (although it is saved in a class variable), while the worker won't finish. While I wrote pornfellow check, but it's probably not done. The question is how to make status information (last url) for global workarou? or how to tell celery to start a new worker until the previous is finished, and if he missed a minute (though async starts to limp, if I understand correctly)
Maybe each time I create a new instance FlowListener that it retrieves the latest file?

code here:
tasks
listener = FlowListener()

@shared_task
def check_if_new():
 listener.start()

in the toolbox, where classes are
class FlowListener():
 last = open('last_article_log.txt').readlines()[-1].strip()

 def __init__(self,
url=config_url,
log='last_article_log.txt'):
 self.log = log
 self.url = url

 def start(self):
 self.soup = BeautifulSoup(requests.get(self.url).text, 'lxml')
 links = self.soup.table.find_all('a')
 self.urls = []
 for link in links:
self.urls.append(link.get('href').strip())
try:
 num = self.urls.index(FlowListener.last)
 if num:
 FlowListener.last = self.urls[0].strip()
 for url in reversed(self.urls[:num]):
 with open(self.log, 'a') as log:
log.write(url+'\n')
Manager(url=url).manage()
 except ValueError:
 pass
June 3rd 19 at 19:14
2 answers
June 3rd 19 at 19:16
yet did, that the Tusk creates a new instance, the last url - instance variable, which each time is extracted from the file and the class Manager shall be given a url - the earliest of the new
url = urls[:num][-1]
it seems to work as expected)
June 3rd 19 at 19:18
Put redis and store everything in it!

Find more questions by tags DjangoCelery