Quantcast

Running 2 backup jobs simultaneously

classic Classic list List threaded Threaded
12 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Running 2 backup jobs simultaneously

Jan Stefanovic

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Dimitri Maziuk
On 03/07/2017 12:06 PM, Jan Stefanovic wrote:

> And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

> 10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

Note "Storage" above.

> So, pay attention when editing the configs and make sure you've enabled
> concurrency in 4 places:
> - Storage stanza in bacula-sd.conf
> - Device stanza in bacula-sd.conf
> - Storage stanza in bacula-dir.conf
> - Director stanza in bacula-dir.conf
>
> Specifically, "Storage" is in both config files.

--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

signature.asc (197 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Jan Stefanovic
In reply to this post by Jan Stefanovic

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Wanderlei Huttel
Bacula treats "Maximum Concurrent Job" by Resource.

Sou you need to change as your need

I suggest increase this value in Director, and Storage, and in the Client let only 2.

Be careful with possible bottlenecks of disk writes


Best regards

Wanderlei Hüttel

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Jan Stefanovic

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Mike Fröhner
In reply to this post by Jan Stefanovic
Actually as far as I know the director can just mount one volume from on pool simultaneously. If jobs use the same volume from the pool they would write and run at the same time. But in your case both jobs have different pools.
--
Diese Nachricht wurde von meinem Android Mobiltelefon mit GMX Mail gesendet.
Am 07.03.17, 20:04, Jan Stefanovic <[hidden email]> schrieb:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 

------------------------------------------------------------------------------ Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford_______________________________________________ Bacula-users mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Josh Fisher
In reply to this post by Jan Stefanovic

On 3/7/2017 1:06 PM, Jan Stefanovic wrote:

>
> Good morning, Bacula gurus!
>
> I have another question:
>
> How do I run 2 backup jobs simultaneously?
>
> I have 2 pools :
>
> ITServersPool-A
>
> ITServersPool-B
>

If the two jobs write to volumes from different pools, then two volumes
must be mounted in order for those two jobs to run concurrently. In
order to mount two volumes, there must be at least two Device resources
in bacula-sd.conf. A Device resource can have only one volume at a time
mounted.

> And I’ve changed bacula-dir.conf: *Maximum Concurrent Jobs = 2*
>
> Now I’ve started 2 backup jobs manually for servers in each pool
>
> Zabbix server is a member of ITServersPool-A and OTRS is a member of
> ITServersPool-B
>
> However, I can see only 1 backup is running, while second backup is
> waiting.
>
> What’s the trick, please?
>
> Running Jobs:
>
> Console connected at 07-Mar-17 09:53
>
> JobId  Type Level     Files     Bytes Name              Status
>
> ======================================================================
>
> 10889  Back Incr          0         0 Zabbix             is running
>
> 10890  Back Incr          0         0 OTRS              is waiting on
> max Storage jobs
>
> ====
>
> Many thanks in advance, would appreciate any input from you guys!!!
>
> Thanks, take care
>
> Jan Stefanovic
>
> IT Systems Administrator
>
>
>
> ------------------------------------------------------------------------------
> Announcing the Oxford Dictionaries API! The API offers world-renowned
> dictionary content that is easy and intuitive to access. Sign up for an
> account today to start using our lexical data to power your apps and
> projects. Get started today and enter our developer competition.
> http://sdm.link/oxford
>
>
> _______________________________________________
> Bacula-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Jan Stefanovic
RE: If the two jobs write to volumes from different pools, then two volumes must be mounted in order for those two jobs to run concurrently. In order to mount two volumes, there must be at least two Device resources in bacula-sd.conf.
A Device resource can have only one volume at a time mounted.

Thanks Josh!!!

Going to try...


Thanks, take care

Jan Stefanovic
IT Systems Administrator

p | (604) 299-0458 x268
e | [hidden email]
u | www.tantalus.com


CONFIDENTIALITY NOTICE.  This documentation, including any attachments, transmitted by electronic mail is intended for the use of the individual to whom or the entity to which it is addressed, and may contain information which is proprietary, confidential, privileged and/or protected from disclosure by applicable laws. Confidentiality and privilege are not lost by this documentation having been sent to the wrong electronic mail address. If you are not the intended recipient (or the person responsible for delivering thereto) please immediately notify the sender and destroy this documentation and all copies (in any form and media); and note that any distribution, reproduction or other use of this documentation is strictly prohibited and may violate public and intellectual property laws.  Thank you.

-----Original Message-----
From: Josh Fisher [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 12:51 PM
To: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously


On 3/7/2017 1:06 PM, Jan Stefanovic wrote:

>
> Good morning, Bacula gurus!
>
> I have another question:
>
> How do I run 2 backup jobs simultaneously?
>
> I have 2 pools :
>
> ITServersPool-A
>
> ITServersPool-B
>

If the two jobs write to volumes from different pools, then two volumes must be mounted in order for those two jobs to run concurrently. In order to mount two volumes, there must be at least two Device resources in bacula-sd.conf. A Device resource can have only one volume at a time mounted.

> And I’ve changed bacula-dir.conf: *Maximum Concurrent Jobs = 2*
>
> Now I’ve started 2 backup jobs manually for servers in each pool
>
> Zabbix server is a member of ITServersPool-A and OTRS is a member of
> ITServersPool-B
>
> However, I can see only 1 backup is running, while second backup is
> waiting.
>
> What’s the trick, please?
>
> Running Jobs:
>
> Console connected at 07-Mar-17 09:53
>
> JobId  Type Level     Files     Bytes Name              Status
>
> ======================================================================
>
> 10889  Back Incr          0         0 Zabbix             is running
>
> 10890  Back Incr          0         0 OTRS              is waiting on
> max Storage jobs
>
> ====
>
> Many thanks in advance, would appreciate any input from you guys!!!
>
> Thanks, take care
>
> Jan Stefanovic
>
> IT Systems Administrator
>
>
>
> ----------------------------------------------------------------------
> -------- Announcing the Oxford Dictionaries API! The API offers
> world-renowned dictionary content that is easy and intuitive to
> access. Sign up for an account today to start using our lexical data
> to power your apps and projects. Get started today and enter our
> developer competition.
> http://sdm.link/oxford
>
>
> _______________________________________________
> Bacula-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Kern Sibbald
In reply to this post by Jan Stefanovic
Hello Jan,

This is not a good configuration.  In general, for your situation, you should set Maximum Concurrent Jobs = 20 everywhere.  Only if your schedule tries to start more than two jobs at a time, or if there is some critical reason to severely limit the number of simultaneous jobs, should you then set one of those maximum's to something smaller.

Best regards,
Kern

On 03/07/2017 08:04 PM, Jan Stefanovic wrote:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford


_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Jan Stefanovic

Thank you, Kern!!!

 

So I’ll change to Max jobs back to 20, but will that start 2 jobs simultaneously?

My boss really wants to backups finish before Monday morning!

Still don’t know what’s the trick.

 

BTW, I love your Bacula! Unbelievable stable and friendly… except for setting up 2 backups running at the same time! ; )

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Kern Sibbald [mailto:[hidden email]]
Sent: Wednesday, March 08, 2017 12:18 AM
To: Jan Stefanovic; Wanderlei Huttel; Dimitri Maziuk
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan,

This is not a good configuration.  In general, for your situation, you should set Maximum Concurrent Jobs = 20 everywhere.  Only if your schedule tries to start more than two jobs at a time, or if there is some critical reason to severely limit the number of simultaneous jobs, should you then set one of those maximum's to something smaller.

Best regards,
Kern

On 03/07/2017 08:04 PM, Jan Stefanovic wrote:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 




------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford




_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Kern Sibbald
Hello Jan,

No, just setting the maximum concurrent jobs will not start any jobs.

It is either you manually, with the bconsole run command, or more commonly the Schedule for your Job(s) that will determine when a job starts.  Basically just setup a Schedule where two jobs start either at the same time or within a few minutes of each other.

By the way, the older versions did not have Maximum Concurrent Jobs set to a big number because it was not in the initial feature set, but any current version such as 7.4.x will have default values that are somewhere between 20 and 100.

Normally a job, even a full, should run in a few hours.  If you find any that are taking more than about 10 hours, you have probably done something wrong or have a *very* big filesystem (probably more than 20 Million files).

Good luck,
Kern

On 03/08/2017 05:32 PM, Jan Stefanovic wrote:

Thank you, Kern!!!

 

So I’ll change to Max jobs back to 20, but will that start 2 jobs simultaneously?

My boss really wants to backups finish before Monday morning!

Still don’t know what’s the trick.

 

BTW, I love your Bacula! Unbelievable stable and friendly… except for setting up 2 backups running at the same time! ; )

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Kern Sibbald [[hidden email]]
Sent: Wednesday, March 08, 2017 12:18 AM
To: Jan Stefanovic; Wanderlei Huttel; Dimitri Maziuk
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan,

This is not a good configuration.  In general, for your situation, you should set Maximum Concurrent Jobs = 20 everywhere.  Only if your schedule tries to start more than two jobs at a time, or if there is some critical reason to severely limit the number of simultaneous jobs, should you then set one of those maximum's to something smaller.

Best regards,
Kern

On 03/07/2017 08:04 PM, Jan Stefanovic wrote:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 




------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford




_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Running 2 backup jobs simultaneously

Dimitri Maziuk
In reply to this post by Jan Stefanovic
On 03/08/2017 10:32 AM, Jan Stefanovic wrote:

> My boss really wants to backups finish before Monday morning!

Then are you sure your bottleneck is disk writes and that running two of
those in parallel will solve it?

--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

signature.asc (197 bytes) Download Attachment
Loading...