请建议。net作业/任务队列

时间:2022-01-22 02:17:52

I need to build a network of services that will process data. Each service needs its own task queue. Preliminary I will need operations like QueueTask, CancelTask, StopTask, GetTaskStatus and GetTaskProgress.

我需要建立一个服务网络来处理数据。每个服务都需要自己的任务队列。我需要一些操作,比如QueueTask, CancelTask, StopTask, GetTaskStatus和GetTaskProgress。

I am looking for framework or fully built implementation of Task Queue.

我正在寻找任务队列的框架或完全构建的实现。

At this time I know some options:

现在我知道了一些选择:

MSMQ - It OK for my needs, but require too much coding for support.

MSMQ -它可以满足我的需要,但是需要太多的代码来支持。

Castle.Sheduling - Scheduling solution. It provides pluggable Trigger, which I could implement to achive my needs. However still too many coding.

城堡。日程安排,调度解决方案。它提供可插式触发器,我可以实现它来满足我的需要。但是仍然有太多的编码。

ServiceBUS - for example MassTransit. However, I am not sure how they support long queues and still require plumbing code.

ServiceBUS—例如massit。然而,我不确定它们如何支持长队列,并且仍然需要管道代码。

An ideal solution will be framework that will provide hosting of task queue. That will be able to restart without loosing tasks. That will be accessible from network for example as SOAP end-point.

理想的解决方案是提供任务队列托管的框架。它将能够重新启动而不会丢失任务。可以从网络(例如SOAP端点)访问它。

The question is actually what do you use, why? What do you suggest to use?

问题是你用什么,为什么?你建议用什么?

4 个解决方案

#1


1  

Hmm, it sounds as though you are going to have to write some plumbing, especially to expose the task queues to the outside world via SOAP.

嗯,听起来您似乎需要编写一些管道,特别是要通过SOAP将任务队列公开给外部世界。

I'd suggest looking at:

我建议看:

Both are open source service bus implemenations on the .NET framework and MSMQ.

两者都是。net框架和MSMQ的开源服务总线实现。

#2


0  

There's also ActiveMQ from the Apache organizations. It's got lots of good cross platform/language support and is free!

Apache组织也有ActiveMQ。它有很多好的跨平台/语言支持,而且是免费的!

In the commercial sector there's also Tibco EMS which has good Java/C# bindings

在商业领域,Tibco EMS也有很好的Java/ c#绑定

#3


0  

Maybe you're looking for something like CONTROL-M?

也许你在找像CONTROL-M这样的东西?

http://en.wikipedia.org/wiki/CONTROL-M

http://en.wikipedia.org/wiki/CONTROL-M

#4


0  

Well I am perhaps going through a similar process. Sorry, this isn't an answer as such, however maybe from a contextual perspective.

我可能正在经历一个类似的过程。对不起,这不是一个答案,但是从上下文的角度来看。

I have a situation where a web app will allow a user to upload images for a design.. the problem is I need to obviously handle the initial upload, but then queue the actual process of the images. For instance, I need to:

我有一种情况,一个web应用程序允许用户上传图片进行设计。问题是,显然我需要处理初始的上传,然后对图像的实际过程进行排队。例如,我需要:

  1. Create scaled thumbnails of the main images, along with some watermarking etc
  2. 创建主要图像的缩放缩略图,以及一些水印等。
  3. Send the actual images over to an Amazon S3 storage unit.
  4. 将实际的图像发送到Amazon S3存储单元。
  5. Update some logs/notifications etc.
  6. 更新一些日志/通知等。

Again, I instantly thought MSMQ from my old days working in finance along with IBM-MQseries, and because I am using SQL 2008 R2, I notice it too has (probably for a while!) queuing mechanisms.

同样,我立刻想到了MSMQ,它与IBM-MQseries一起在金融领域工作,而且因为我正在使用SQL 2008 R2,所以我注意到它也有(可能有一段时间!)排队机制。

So I am sort of in the same boat trying to find the correct option!

所以我在同一条船上试图找到正确的选择!

Thanks for the replies so far.. will check out some of the solutions, but again, any other ideas would be grateful

谢谢你到目前为止的答复。将会检查一些解决方案,但是,还有什么其他的想法是值得感激的吗

#1


1  

Hmm, it sounds as though you are going to have to write some plumbing, especially to expose the task queues to the outside world via SOAP.

嗯,听起来您似乎需要编写一些管道,特别是要通过SOAP将任务队列公开给外部世界。

I'd suggest looking at:

我建议看:

Both are open source service bus implemenations on the .NET framework and MSMQ.

两者都是。net框架和MSMQ的开源服务总线实现。

#2


0  

There's also ActiveMQ from the Apache organizations. It's got lots of good cross platform/language support and is free!

Apache组织也有ActiveMQ。它有很多好的跨平台/语言支持,而且是免费的!

In the commercial sector there's also Tibco EMS which has good Java/C# bindings

在商业领域,Tibco EMS也有很好的Java/ c#绑定

#3


0  

Maybe you're looking for something like CONTROL-M?

也许你在找像CONTROL-M这样的东西?

http://en.wikipedia.org/wiki/CONTROL-M

http://en.wikipedia.org/wiki/CONTROL-M

#4


0  

Well I am perhaps going through a similar process. Sorry, this isn't an answer as such, however maybe from a contextual perspective.

我可能正在经历一个类似的过程。对不起,这不是一个答案,但是从上下文的角度来看。

I have a situation where a web app will allow a user to upload images for a design.. the problem is I need to obviously handle the initial upload, but then queue the actual process of the images. For instance, I need to:

我有一种情况,一个web应用程序允许用户上传图片进行设计。问题是,显然我需要处理初始的上传,然后对图像的实际过程进行排队。例如,我需要:

  1. Create scaled thumbnails of the main images, along with some watermarking etc
  2. 创建主要图像的缩放缩略图,以及一些水印等。
  3. Send the actual images over to an Amazon S3 storage unit.
  4. 将实际的图像发送到Amazon S3存储单元。
  5. Update some logs/notifications etc.
  6. 更新一些日志/通知等。

Again, I instantly thought MSMQ from my old days working in finance along with IBM-MQseries, and because I am using SQL 2008 R2, I notice it too has (probably for a while!) queuing mechanisms.

同样,我立刻想到了MSMQ,它与IBM-MQseries一起在金融领域工作,而且因为我正在使用SQL 2008 R2,所以我注意到它也有(可能有一段时间!)排队机制。

So I am sort of in the same boat trying to find the correct option!

所以我在同一条船上试图找到正确的选择!

Thanks for the replies so far.. will check out some of the solutions, but again, any other ideas would be grateful

谢谢你到目前为止的答复。将会检查一些解决方案,但是,还有什么其他的想法是值得感激的吗