WORKLOADAUTOMATION.ORG | The Global Community: Multiple servers performance - WORKLOADAUTOMATION.ORG | The Global Community

Jump to content

Welcome

This is the workload automation community forum.

Join us now and share your experiences, knowledge and request assistance. Once registered and logged in, you will be able to create topics, post replies, share code, and speak privately with members with your own private messenger.


Come and join in...

Page 1 of 1
  • You cannot start a new topic
  • You cannot reply to this topic

Multiple servers performance

#1 User is offline   Eric Angenault Icon

  • Members

Posted 02 October 2008 - 09:28 AM

Hi all,

I would like to know if somebody did some tests about performance with multiple servers. The goal is to see if we get a "linear gain" : 2 servers allow to process double jobs without submission delay ? Do you know if it exists some graphs about the use of multiple servers (as we can see for autosys with multiple EP).

Regards,
Eric.
Communauté francophone : http://ordonnancement.net
0

#2 User is offline   Mark Mannion Icon

  • Administrators

Posted 11 October 2008 - 12:16 AM

View PostEric Angenault, on Oct 2 2008, 10:28 AM, said:

Hi all,

I would like to know if somebody did some tests about performance with multiple servers. The goal is to see if we get a "linear gain" : 2 servers allow to process double jobs without submission delay ? Do you know if it exists some graphs about the use of multiple servers (as we can see for autosys with multiple EP).

Regards,
Eric.


Hi Eric

The performance question is not an easy one to answer because it is very complex and depends on so many factors, including:
- Number of agents
- Size of job reports
- The performance of the database
- The performance of the network between the server(s) and the database
- The specification of the server(s)

A key feature of UC4 Operations Manager is that the automation engine is not bound to a physical machine and that it really makes use of every CPU (which is key for organisations that plan to virtualize their applications). So if you add a second server you double the CPUs and you will be able to handle a lot more jobs. If the system is well configured you will reach a quite linear scale up to ~10 Workprocesses. The curve consolidates at ~14 Workprocesses. If you use the latest versions from the database vendors, a limit will be found between 1,000,000 and 2,000,000 job generations in one day.

The generic UC4 OM rule-of-thumb is to define about 1 Workprocess per CPU, at least 2 Dialog Workprocesses for the User Interface and to start with 2 communication processes. You can watch the load of these processes from the system-overview and switch from workprocess to dialog workprocess and vice versa (UC4 is very flexible in that regard). Generally speaking, UC4 has a great architecture for high throughput (It's my understanding that SQL Server 2005 with MARS connection scales very well with UC4 OM).

I don't know what official stats and charts are available from the vendor. Hope this is of some help though.

Cheers

Mark
0

#3 User is offline   Eric Angenault Icon

  • Members

Posted 14 October 2008 - 07:56 PM

Hi Mark,

Firstly, I would thank you for your answer, it's quite difficult to get information about UC4 in France even this product looks like very interesting.

Your reply is very clear but when you speak about "a lot more jobs" do you think that the double is possible ? For the moment, I have some performance problem with autosys because all events to process are in the same table and even processed events and future events are splitted, it stills a lot of request in the processed event tables, this is one of the reason multiple EP are not a solution. It seems that UC4 uses a system like message queue with several queues, this must be more efficient with multiple process.

I know several client knowing performance problems with differents schedulers, this is why I'm looking for a scheduler with an efficient mecanism.

Regards,
Eric.
Communauté francophone : http://ordonnancement.net
0

#4 Guest_Eric_*

  • Guests

Posted 27 October 2008 - 02:28 AM

View PostEric Angenault, on Oct 14 2008, 08:56 PM, said:

Hi Mark,

Firstly, I would thank you for your answer, it's quite difficult to get information about UC4 in France even this product looks like very interesting.

Your reply is very clear but when you speak about "a lot more jobs" do you think that the double is possible ? For the moment, I have some performance problem with autosys because all events to process are in the same table and even processed events and future events are splitted, it stills a lot of request in the processed event tables, this is one of the reason multiple EP are not a solution. It seems that UC4 uses a system like message queue with several queues, this must be more efficient with multiple process.

I know several client knowing performance problems with differents schedulers, this is why I'm looking for a scheduler with an efficient mecanism.

Regards,
Eric.


I think that UC4's reputation for fantastic parallel processing is well known in the WA world but ultimately the only way to compare schedulers is to est them with the same tasks on the same equipment. I'm a big fan of Proof-Of-Concept testing; nothing beats a test where you get to run 5,000 jobs in parallel and test for the latency between the first job starting and the last job starting :)
0

#5 User is offline   Eric Angenault Icon

  • Members

Posted 01 November 2008 - 09:57 AM

Hi and thank you for the answers,

I guess the real answer is "nobody did the test".

Regards,
Eric.
Communauté francophone : http://ordonnancement.net
0

Page 1 of 1
  • You cannot start a new topic
  • You cannot reply to this topic