Running 2 backup jobs simultaneously

classic Classic list List threaded Threaded
16 messages Options
Reply | Threaded
Open this post in threaded view
|

Running 2 backup jobs simultaneously

Jan Stefanovic

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Dimitri Maziuk
On 03/07/2017 12:06 PM, Jan Stefanovic wrote:

> And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

> 10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

Note "Storage" above.

> So, pay attention when editing the configs and make sure you've enabled
> concurrency in 4 places:
> - Storage stanza in bacula-sd.conf
> - Device stanza in bacula-sd.conf
> - Storage stanza in bacula-dir.conf
> - Director stanza in bacula-dir.conf
>
> Specifically, "Storage" is in both config files.

--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

signature.asc (197 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Jan Stefanovic
In reply to this post by Jan Stefanovic

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Wanderlei Huttel
Bacula treats "Maximum Concurrent Job" by Resource.

Sou you need to change as your need

I suggest increase this value in Director, and Storage, and in the Client let only 2.

Be careful with possible bottlenecks of disk writes


Best regards

Wanderlei Hüttel

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Jan Stefanovic

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Mike Fröhner
In reply to this post by Jan Stefanovic
Actually as far as I know the director can just mount one volume from on pool simultaneously. If jobs use the same volume from the pool they would write and run at the same time. But in your case both jobs have different pools.
--
Diese Nachricht wurde von meinem Android Mobiltelefon mit GMX Mail gesendet.
Am 07.03.17, 20:04, Jan Stefanovic <[hidden email]> schrieb:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 

------------------------------------------------------------------------------ Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition. http://sdm.link/oxford_______________________________________________ Bacula-users mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/bacula-users

------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Josh Fisher
In reply to this post by Jan Stefanovic

On 3/7/2017 1:06 PM, Jan Stefanovic wrote:

>
> Good morning, Bacula gurus!
>
> I have another question:
>
> How do I run 2 backup jobs simultaneously?
>
> I have 2 pools :
>
> ITServersPool-A
>
> ITServersPool-B
>

If the two jobs write to volumes from different pools, then two volumes
must be mounted in order for those two jobs to run concurrently. In
order to mount two volumes, there must be at least two Device resources
in bacula-sd.conf. A Device resource can have only one volume at a time
mounted.

> And I’ve changed bacula-dir.conf: *Maximum Concurrent Jobs = 2*
>
> Now I’ve started 2 backup jobs manually for servers in each pool
>
> Zabbix server is a member of ITServersPool-A and OTRS is a member of
> ITServersPool-B
>
> However, I can see only 1 backup is running, while second backup is
> waiting.
>
> What’s the trick, please?
>
> Running Jobs:
>
> Console connected at 07-Mar-17 09:53
>
> JobId  Type Level     Files     Bytes Name              Status
>
> ======================================================================
>
> 10889  Back Incr          0         0 Zabbix             is running
>
> 10890  Back Incr          0         0 OTRS              is waiting on
> max Storage jobs
>
> ====
>
> Many thanks in advance, would appreciate any input from you guys!!!
>
> Thanks, take care
>
> Jan Stefanovic
>
> IT Systems Administrator
>
>
>
> ------------------------------------------------------------------------------
> Announcing the Oxford Dictionaries API! The API offers world-renowned
> dictionary content that is easy and intuitive to access. Sign up for an
> account today to start using our lexical data to power your apps and
> projects. Get started today and enter our developer competition.
> http://sdm.link/oxford
>
>
> _______________________________________________
> Bacula-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Jan Stefanovic
RE: If the two jobs write to volumes from different pools, then two volumes must be mounted in order for those two jobs to run concurrently. In order to mount two volumes, there must be at least two Device resources in bacula-sd.conf.
A Device resource can have only one volume at a time mounted.

Thanks Josh!!!

Going to try...


Thanks, take care

Jan Stefanovic
IT Systems Administrator

p | (604) 299-0458 x268
e | [hidden email]
u | www.tantalus.com


CONFIDENTIALITY NOTICE.  This documentation, including any attachments, transmitted by electronic mail is intended for the use of the individual to whom or the entity to which it is addressed, and may contain information which is proprietary, confidential, privileged and/or protected from disclosure by applicable laws. Confidentiality and privilege are not lost by this documentation having been sent to the wrong electronic mail address. If you are not the intended recipient (or the person responsible for delivering thereto) please immediately notify the sender and destroy this documentation and all copies (in any form and media); and note that any distribution, reproduction or other use of this documentation is strictly prohibited and may violate public and intellectual property laws.  Thank you.

-----Original Message-----
From: Josh Fisher [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 12:51 PM
To: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously


On 3/7/2017 1:06 PM, Jan Stefanovic wrote:

>
> Good morning, Bacula gurus!
>
> I have another question:
>
> How do I run 2 backup jobs simultaneously?
>
> I have 2 pools :
>
> ITServersPool-A
>
> ITServersPool-B
>

If the two jobs write to volumes from different pools, then two volumes must be mounted in order for those two jobs to run concurrently. In order to mount two volumes, there must be at least two Device resources in bacula-sd.conf. A Device resource can have only one volume at a time mounted.

> And I’ve changed bacula-dir.conf: *Maximum Concurrent Jobs = 2*
>
> Now I’ve started 2 backup jobs manually for servers in each pool
>
> Zabbix server is a member of ITServersPool-A and OTRS is a member of
> ITServersPool-B
>
> However, I can see only 1 backup is running, while second backup is
> waiting.
>
> What’s the trick, please?
>
> Running Jobs:
>
> Console connected at 07-Mar-17 09:53
>
> JobId  Type Level     Files     Bytes Name              Status
>
> ======================================================================
>
> 10889  Back Incr          0         0 Zabbix             is running
>
> 10890  Back Incr          0         0 OTRS              is waiting on
> max Storage jobs
>
> ====
>
> Many thanks in advance, would appreciate any input from you guys!!!
>
> Thanks, take care
>
> Jan Stefanovic
>
> IT Systems Administrator
>
>
>
> ----------------------------------------------------------------------
> -------- Announcing the Oxford Dictionaries API! The API offers
> world-renowned dictionary content that is easy and intuitive to
> access. Sign up for an account today to start using our lexical data
> to power your apps and projects. Get started today and enter our
> developer competition.
> http://sdm.link/oxford
>
>
> _______________________________________________
> Bacula-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned dictionary content that is easy and intuitive to access. Sign up for an account today to start using our lexical data to power your apps and projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Kern Sibbald
In reply to this post by Jan Stefanovic
Hello Jan,

This is not a good configuration.  In general, for your situation, you should set Maximum Concurrent Jobs = 20 everywhere.  Only if your schedule tries to start more than two jobs at a time, or if there is some critical reason to severely limit the number of simultaneous jobs, should you then set one of those maximum's to something smaller.

Best regards,
Kern

On 03/07/2017 08:04 PM, Jan Stefanovic wrote:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford


_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Jan Stefanovic

Thank you, Kern!!!

 

So I’ll change to Max jobs back to 20, but will that start 2 jobs simultaneously?

My boss really wants to backups finish before Monday morning!

Still don’t know what’s the trick.

 

BTW, I love your Bacula! Unbelievable stable and friendly… except for setting up 2 backups running at the same time! ; )

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Kern Sibbald [mailto:[hidden email]]
Sent: Wednesday, March 08, 2017 12:18 AM
To: Jan Stefanovic; Wanderlei Huttel; Dimitri Maziuk
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan,

This is not a good configuration.  In general, for your situation, you should set Maximum Concurrent Jobs = 20 everywhere.  Only if your schedule tries to start more than two jobs at a time, or if there is some critical reason to severely limit the number of simultaneous jobs, should you then set one of those maximum's to something smaller.

Best regards,
Kern

On 03/07/2017 08:04 PM, Jan Stefanovic wrote:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 




------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford




_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Kern Sibbald
Hello Jan,

No, just setting the maximum concurrent jobs will not start any jobs.

It is either you manually, with the bconsole run command, or more commonly the Schedule for your Job(s) that will determine when a job starts.  Basically just setup a Schedule where two jobs start either at the same time or within a few minutes of each other.

By the way, the older versions did not have Maximum Concurrent Jobs set to a big number because it was not in the initial feature set, but any current version such as 7.4.x will have default values that are somewhere between 20 and 100.

Normally a job, even a full, should run in a few hours.  If you find any that are taking more than about 10 hours, you have probably done something wrong or have a *very* big filesystem (probably more than 20 Million files).

Good luck,
Kern

On 03/08/2017 05:32 PM, Jan Stefanovic wrote:

Thank you, Kern!!!

 

So I’ll change to Max jobs back to 20, but will that start 2 jobs simultaneously?

My boss really wants to backups finish before Monday morning!

Still don’t know what’s the trick.

 

BTW, I love your Bacula! Unbelievable stable and friendly… except for setting up 2 backups running at the same time! ; )

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Kern Sibbald [[hidden email]]
Sent: Wednesday, March 08, 2017 12:18 AM
To: Jan Stefanovic; Wanderlei Huttel; Dimitri Maziuk
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan,

This is not a good configuration.  In general, for your situation, you should set Maximum Concurrent Jobs = 20 everywhere.  Only if your schedule tries to start more than two jobs at a time, or if there is some critical reason to severely limit the number of simultaneous jobs, should you then set one of those maximum's to something smaller.

Best regards,
Kern

On 03/07/2017 08:04 PM, Jan Stefanovic wrote:

thank you Wanderlei and Dimitry!!!

 

followed advice from both of you, changed Maximum Concurrent Jobs = 2 in configs:

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2

bacula-sd.conf:  Maximum Concurrent Jobs = 2   # Added by Jan to test 2 jobs

 

 

now second job is waiting for Storage “File”

 

Running Jobs:

Console connected at 07-Mar-17 10:56

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10891  Back Incr          0         0  Zabbix            is running

10892  Back Incr          0         0  OTRS              is waiting on Storage "File"

 

What’s the proper settings for Storage File, please?

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [[hidden email]]
Sent: Tuesday, March 07, 2017 10:58 AM
To: Jan Stefanovic
Cc: [hidden email]
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Bacula treats "Maximum Concurrent Job" by Resource.

 

Sou you need to change as your need

 

I suggest increase this value in Director, and Storage, and in the Client let only 2.

 

Be careful with possible bottlenecks of disk writes


 

Best regards

 

Wanderlei Hüttel

 

2017-03-07 15:47 GMT-03:00 Jan Stefanovic <[hidden email]>:

Hi Wanderlei,

 

checked for Max jobs, this is what I have in /etc/bacula

 

[root@bacula bacula]# grep "Maximum Concurrent Jobs" *.conf

bacula-dir.conf:  Maximum Concurrent Jobs = 2

bacula-fd.conf:  Maximum Concurrent Jobs = 20

bacula-sd.conf:  Maximum Concurrent Jobs = 20

 

Should I change bacula-fd.conf and bacula-sd.conf to Maximum Concurrent Jobs = 2?

 

or is there anything else I should change/add?

 

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Tuesday, March 07, 2017 10:31 AM
To: Jan Stefanovic
Subject: Re: [Bacula-users] Running 2 backup jobs simultaneously

 

Hello Jan

 

You need to configure "Maximum Concurrent Jobs" in these files/resources:

 

Maximum Concurrent Jobs = XXX

 

File: bacula-dir.conf

Resource:  Director, Storage, Client

 

File: bacula-sd.conf

Resource:  Storage, Device

 

File: bacula-fd.conf

Resource: FileDaemon


 

Best Regards

 

Wanderlei Hüttel

 

2017-03-07 15:06 GMT-03:00 Jan Stefanovic <[hidden email]>:

Good morning, Bacula gurus!

 

I have another question:

 

How do I run 2 backup jobs simultaneously?

 

I have 2 pools :

ITServersPool-A

ITServersPool-B

 

And I’ve changed bacula-dir.conf:  Maximum Concurrent Jobs = 2

 

Now I’ve started 2 backup jobs manually for servers in each pool

Zabbix server is a member of ITServersPool-A and OTRS is a member of ITServersPool-B

However, I can see only 1 backup is running, while second backup is waiting.

 

What’s the trick, please?

 

Running Jobs:

Console connected at 07-Mar-17 09:53

JobId  Type Level     Files     Bytes  Name              Status

======================================================================

10889  Back Incr          0         0  Zabbix             is running

10890  Back Incr          0         0  OTRS              is waiting on max Storage jobs

====

 

Many thanks in advance, would appreciate any input from you guys!!!

 

 

Thanks, take care

 

Jan Stefanovic

IT Systems Administrator

 


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 




------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford




_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 



------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Running 2 backup jobs simultaneously

Dimitri Maziuk
In reply to this post by Jan Stefanovic
On 03/08/2017 10:32 AM, Jan Stefanovic wrote:

> My boss really wants to backups finish before Monday morning!

Then are you sure your bottleneck is disk writes and that running two of
those in parallel will solve it?

--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu


------------------------------------------------------------------------------
Announcing the Oxford Dictionaries API! The API offers world-renowned
dictionary content that is easy and intuitive to access. Sign up for an
account today to start using our lexical data to power your apps and
projects. Get started today and enter our developer competition.
http://sdm.link/oxford
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

signature.asc (197 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Could not stat "/mnt/nas1stuff/": ERR=Host is down

Ian Douglas
In reply to this post by Kern Sibbald
Hi all

Lately I've been getting errors like

  Could not stat "/mnt/nas1stuff/": ERR=Host is down

where I'm trying to back up files from a NAS box (FreeNAS), and the target
folder is mounted on this box, as was recommended to me on this list.

So the folder does not get backed up.

If I run the job manually then it works.

Other succeeding jobs run right after the failed one work okay.

Oddly enough I tried from the command line and results were puzzling:

====================
~ $ ls /home/ian/nas1stuff/
ls: cannot access '/home/ian/nas1stuff/': Host is down
~ $ cd
~ $ cd /home/ian/nas1stuff/
~/nas1stuff $ ls /home/ian/nas1stuff/

and that worked... so why would I get a Host is down message?


So now trying to determine where the problem is...

1. Bacula ?
2. FreeNAS ?
3. something on my system doing the SMB stuff ?

Something else?

I don't know if it is related but lately I've noticed a lot of up/down traffic
between this box and the three NAS boxes... even when I'm not actually doing
anything on the NAS boxes. Am just worried it's some malware encrypting my
drives. This box is Linux, the three NAS boxes are FreeNAS (== FreeBSD based).

Any ideas as to where to look to solve the issue gratefully received. Google
was not helpful, unless I searched for the wrong things...

Thanks, Ian
--
[hidden email] http://www.zti.co.za
Zero 2 Infinity - The net.works
Phone +27-21-975-7273

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Could not stat "/mnt/nas1stuff/": ERR=Host is down

Ivan Adzhubey
Hi Ian,

Looks like your directory is set up to automount and Bacula does not know how
to handle it properly. You might need to write a small Bash script doing just
what you tried manually: "cd /home/ian/nas1stuff/; ls -lh" and then specify it
as RunBeforeJob in your director's config. Note, cd into automounted directory
followed by ls would "enable" the mount and make it visible to Bacula.

--Ivan

On Wednesday, June 7, 2017 3:50:30 PM EDT Ian Douglas wrote:

> Hi all
>
> Lately I've been getting errors like
>
>   Could not stat "/mnt/nas1stuff/": ERR=Host is down
>
> where I'm trying to back up files from a NAS box (FreeNAS), and the target
> folder is mounted on this box, as was recommended to me on this list.
>
> So the folder does not get backed up.
>
> If I run the job manually then it works.
>
> Other succeeding jobs run right after the failed one work okay.
>
> Oddly enough I tried from the command line and results were puzzling:
>
> ====================
> ~ $ ls /home/ian/nas1stuff/
> ls: cannot access '/home/ian/nas1stuff/': Host is down
> ~ $ cd
> ~ $ cd /home/ian/nas1stuff/
> ~/nas1stuff $ ls /home/ian/nas1stuff/
>
> and that worked... so why would I get a Host is down message?
>
>
> So now trying to determine where the problem is...
>
> 1. Bacula ?
> 2. FreeNAS ?
> 3. something on my system doing the SMB stuff ?
>
> Something else?
>
> I don't know if it is related but lately I've noticed a lot of up/down
> traffic between this box and the three NAS boxes... even when I'm not
> actually doing anything on the NAS boxes. Am just worried it's some malware
> encrypting my drives. This box is Linux, the three NAS boxes are FreeNAS
> (== FreeBSD based).
>
> Any ideas as to where to look to solve the issue gratefully received. Google
> was not helpful, unless I searched for the wrong things...
>
> Thanks, Ian



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Could not stat "/mnt/nas1stuff/": ERR=Host is down

Martin Simmons
In reply to this post by Ian Douglas
>>>>> On Wed, 07 Jun 2017 21:50:30 +0200, Ian Douglas said:
>
> Hi all
>
> Lately I've been getting errors like
>
>   Could not stat "/mnt/nas1stuff/": ERR=Host is down
>
> where I'm trying to back up files from a NAS box (FreeNAS), and the target
> folder is mounted on this box, as was recommended to me on this list.
>
> So the folder does not get backed up.
>
> If I run the job manually then it works.
>
> Other succeeding jobs run right after the failed one work okay.
>
> Oddly enough I tried from the command line and results were puzzling:
>
> ====================
> ~ $ ls /home/ian/nas1stuff/
> ls: cannot access '/home/ian/nas1stuff/': Host is down
> ~ $ cd
> ~ $ cd /home/ian/nas1stuff/
> ~/nas1stuff $ ls /home/ian/nas1stuff/
>
> and that worked... so why would I get a Host is down message?

It could be too slow rather than down.  Does a second use of "ls
/home/ian/nas1stuff/" succeed, without the "cd /home/ian/nas1stuff/"?


> So now trying to determine where the problem is...
>
> 1. Bacula ?

Unlikely since you can demonstrate it with cd and ls.


> 2. FreeNAS ?
> 3. something on my system doing the SMB stuff ?

Both possible.

Have you checked the syslogs?


> I don't know if it is related but lately I've noticed a lot of up/down traffic
> between this box and the three NAS boxes... even when I'm not actually doing
> anything on the NAS boxes. Am just worried it's some malware encrypting my
> drives. This box is Linux, the three NAS boxes are FreeNAS (== FreeBSD based).

You could use tcpdump or Wireshark to see what kind of traffic is being sent.

See also
https://askubuntu.com/questions/910058/updates-broke-cifs-smb-mounts-in-16-04#920279

__Martin

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|

Re: Could not stat "/mnt/nas1stuff/": ERR=Host is down

Josh Fisher
In reply to this post by Ian Douglas

On 6/7/2017 3:50 PM, Ian Douglas wrote:

> Hi all
>
> Lately I've been getting errors like
>
>    Could not stat "/mnt/nas1stuff/": ERR=Host is down
>
> where I'm trying to back up files from a NAS box (FreeNAS), and the target
> folder is mounted on this box, as was recommended to me on this list.
>
> So the folder does not get backed up.
>
> If I run the job manually then it works.
>
> Other succeeding jobs run right after the failed one work okay.
>
> Oddly enough I tried from the command line and results were puzzling:
>
> ====================
> ~ $ ls /home/ian/nas1stuff/
> ls: cannot access '/home/ian/nas1stuff/': Host is down
> ~ $ cd
> ~ $ cd /home/ian/nas1stuff/
> ~/nas1stuff $ ls /home/ian/nas1stuff/
>
> and that worked... so why would I get a Host is down message?

The host was only down for the first ls command. I suspect that the
FreeNAS box was not busy and went into sleep/suspend power saving mode.
When NFS on the Bacula box sent packets to the FreeNAS box as a result
of the ls command reading the directory, it caused the FreeNAS box to
resume from sleep/suspend. The FreeNAS box took too long to wake up and
respond, so NFS assumed 'host is down'.

Another possibility is that DNS resolution on the Bacula box has the
incorrect search order, etc. and is causing the NFS timeout.

Another possibility is that you are automounting the NFS share and a too
short timeout is specified for the autofs map for that mountpoint.


>
>
> So now trying to determine where the problem is...
>
> 1. Bacula ?
> 2. FreeNAS ?
> 3. something on my system doing the SMB stuff ?
>
> Something else?
>
> I don't know if it is related but lately I've noticed a lot of up/down traffic
> between this box and the three NAS boxes... even when I'm not actually doing
> anything on the NAS boxes. Am just worried it's some malware encrypting my
> drives. This box is Linux, the three NAS boxes are FreeNAS (== FreeBSD based).
>
> Any ideas as to where to look to solve the issue gratefully received. Google
> was not helpful, unless I searched for the wrong things...
>
> Thanks, Ian


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users