Forcing Single File Per Job in Rotation

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Forcing Single File Per Job in Rotation

Jim Richardson

Et Al.

 

I want to have one job per file.  I am successfully able to accomplish this by using the UseVolumeOnce = yes, Recycle = no, and the Volume Retention = 2 days or 14 days.  My files Label Format = "${Client}-Weekly-${JobId}-${Year}.${Month}.${Day}.bak". 

 

Everything works as expected until one of the volume gets recycled.

 

I see this information in the log:

Recycled volume "hrms-fd-Daily-131-2017.4.29.bak" on file device "FileChgr1-Dev1" (/backup/bacula/filebackup01), all previous data lost

 

Job: Job:                    D2D-L360SPR01-Application.2017-05-16_19.00.01_00

Volume name(s):         hrms-fd-Daily-131-2017.4.29.bak

 

So in this case the Volume label and the data it contains does not match.  I have read through the manual and searched on the subject, but can’t find a clear answer to my problem.  It looks like the Recycle = no option in the pool would solve the problem, but adding it didn’t seem to stop the behavior. 

 

Thank you in advance.

 

Jim Richardson

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Wanderlei Huttel
Hello Jim

If you want to recycle the volumes do not use the Labels so detailed.
Or you you want the Labels more detailed, you could use an Admin Job with some shell script and delete the volumes.



Best regards

Wanderlei Hüttel

2017-05-22 17:11 GMT-03:00 Jim Richardson <[hidden email]>:

Et Al.

 

I want to have one job per file.  I am successfully able to accomplish this by using the UseVolumeOnce = yes, Recycle = no, and the Volume Retention = 2 days or 14 days.  My files Label Format = "${Client}-Weekly-${JobId}-${Year}.${Month}.${Day}.bak". 

 

Everything works as expected until one of the volume gets recycled.

 

I see this information in the log:

Recycled volume "hrms-fd-Daily-131-2017.4.29.bak" on file device "FileChgr1-Dev1" (/backup/bacula/filebackup01), all previous data lost

 

Job: Job:                    D2D-L360SPR01-Application.2017-05-16_19.00.01_00

Volume name(s):         hrms-fd-Daily-131-2017.4.29.bak

 

So in this case the Volume label and the data it contains does not match.  I have read through the manual and searched on the subject, but can’t find a clear answer to my problem.  It looks like the Recycle = no option in the pool would solve the problem, but adding it didn’t seem to stop the behavior. 

 

Thank you in advance.

 

Jim Richardson

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Jim Richardson

Wanderlei,

 

I want the detailed volume labels, I don’t want to recycle then, I want them overwritten, purged, or whatever the terminology is.  I do want to keep the weekly volumes for 14 days and the daily volumes for 2 days.

 

Jim Richardson

CISSP CISA


SecurIT360

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Monday, May 22, 2017 5:40 PM
To: Jim Richardson <[hidden email]>
Cc: [hidden email]
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

Hello Jim

 

If you want to recycle the volumes do not use the Labels so detailed.

Or you you want the Labels more detailed, you could use an Admin Job with some shell script and delete the volumes.

 

 

 

Best regards

 

Wanderlei Hüttel

 

2017-05-22 17:11 GMT-03:00 Jim Richardson <[hidden email]>:

Et Al.

 

I want to have one job per file.  I am successfully able to accomplish this by using the UseVolumeOnce = yes, Recycle = no, and the Volume Retention = 2 days or 14 days.  My files Label Format = "${Client}-Weekly-${JobId}-${Year}.${Month}.${Day}.bak". 

 

Everything works as expected until one of the volume gets recycled.

 

I see this information in the log:

Recycled volume "hrms-fd-Daily-131-2017.4.29.bak" on file device "FileChgr1-Dev1" (/backup/bacula/filebackup01), all previous data lost

 

Job: Job:                    D2D-L360SPR01-Application.2017-05-16_19.00.01_00

Volume name(s):         hrms-fd-Daily-131-2017.4.29.bak

 

So in this case the Volume label and the data it contains does not match.  I have read through the manual and searched on the subject, but can’t find a clear answer to my problem.  It looks like the Recycle = no option in the pool would solve the problem, but adding it didn’t seem to stop the behavior. 

 

Thank you in advance.

 

Jim Richardson

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Wanderlei Huttel
Hello Jim

I have a script in my github that can help you a create a new one to use in an Admin job and delete the expired volumes.


Best Regards

Wanderlei Hüttel

2017-05-22 19:45 GMT-03:00 Jim Richardson <[hidden email]>:

Wanderlei,

 

I want the detailed volume labels, I don’t want to recycle then, I want them overwritten, purged, or whatever the terminology is.  I do want to keep the weekly volumes for 14 days and the daily volumes for 2 days.

 

Jim Richardson

CISSP CISA


SecurIT360

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Monday, May 22, 2017 5:40 PM
To: Jim Richardson <[hidden email]>
Cc: [hidden email]
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

Hello Jim

 

If you want to recycle the volumes do not use the Labels so detailed.

Or you you want the Labels more detailed, you could use an Admin Job with some shell script and delete the volumes.

 

 

 

Best regards

 

Wanderlei Hüttel

 

2017-05-22 17:11 GMT-03:00 Jim Richardson <[hidden email]>:

Et Al.

 

I want to have one job per file.  I am successfully able to accomplish this by using the UseVolumeOnce = yes, Recycle = no, and the Volume Retention = 2 days or 14 days.  My files Label Format = "${Client}-Weekly-${JobId}-${Year}.${Month}.${Day}.bak". 

 

Everything works as expected until one of the volume gets recycled.

 

I see this information in the log:

Recycled volume "hrms-fd-Daily-131-2017.4.29.bak" on file device "FileChgr1-Dev1" (/backup/bacula/filebackup01), all previous data lost

 

Job: Job:                    D2D-L360SPR01-Application.2017-05-16_19.00.01_00

Volume name(s):         hrms-fd-Daily-131-2017.4.29.bak

 

So in this case the Volume label and the data it contains does not match.  I have read through the manual and searched on the subject, but can’t find a clear answer to my problem.  It looks like the Recycle = no option in the pool would solve the problem, but adding it didn’t seem to stop the behavior. 

 

Thank you in advance.

 

Jim Richardson

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Jim Richardson

Wanderlei,

 

Thank you.  This is good work.  But, I would certainly hope that there is a Bacula supported method to accomplish this.  If not, I will use your method.

 

Jim Richardson

 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Monday, May 22, 2017 5:57 PM
To: Jim Richardson <[hidden email]>
Cc: [hidden email]
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

Hello Jim

 

I have a script in my github that can help you a create a new one to use in an Admin job and delete the expired volumes.


 

Best Regards

 

Wanderlei Hüttel

 

2017-05-22 19:45 GMT-03:00 Jim Richardson <[hidden email]>:

Wanderlei,

 

I want the detailed volume labels, I don’t want to recycle then, I want them overwritten, purged, or whatever the terminology is.  I do want to keep the weekly volumes for 14 days and the daily volumes for 2 days.

 

Jim Richardson 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Monday, May 22, 2017 5:40 PM
To: Jim Richardson <[hidden email]>
Cc: [hidden email]
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

Hello Jim

 

If you want to recycle the volumes do not use the Labels so detailed.

Or you you want the Labels more detailed, you could use an Admin Job with some shell script and delete the volumes.

 

 

 

Best regards

 

Wanderlei Hüttel

 

2017-05-22 17:11 GMT-03:00 Jim Richardson <[hidden email]>:

Et Al.

 

I want to have one job per file.  I am successfully able to accomplish this by using the UseVolumeOnce = yes, Recycle = no, and the Volume Retention = 2 days or 14 days.  My files Label Format = "${Client}-Weekly-${JobId}-${Year}.${Month}.${Day}.bak". 

 

Everything works as expected until one of the volume gets recycled.

 

I see this information in the log:

Recycled volume "hrms-fd-Daily-131-2017.4.29.bak" on file device "FileChgr1-Dev1" (/backup/bacula/filebackup01), all previous data lost

 

Job: Job:                    D2D-L360SPR01-Application.2017-05-16_19.00.01_00

Volume name(s):         hrms-fd-Daily-131-2017.4.29.bak

 

So in this case the Volume label and the data it contains does not match.  I have read through the manual and searched on the subject, but can’t find a clear answer to my problem.  It looks like the Recycle = no option in the pool would solve the problem, but adding it didn’t seem to stop the behavior. 

 

Thank you in advance.

 

Jim Richardson

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Kern Sibbald



On 05/23/2017 01:09 AM, Jim Richardson wrote:

Wanderlei,

 

Thank you.  This is good work.


But, I would certainly hope that there is a Bacula supported method to accomplish this.

Turn on recycling, then Bacula will probably do what you want.

If not, I will use your method.

 

Jim Richardson

 

From: Wanderlei Huttel [[hidden email]]
Sent: Monday, May 22, 2017 5:57 PM
To: Jim Richardson [hidden email]
Cc: [hidden email]
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

Hello Jim

 

I have a script in my github that can help you a create a new one to use in an Admin job and delete the expired volumes.


 

Best Regards

 

Wanderlei Hüttel

 

2017-05-22 19:45 GMT-03:00 Jim Richardson <[hidden email]>:

Wanderlei,

 

I want the detailed volume labels, I don’t want to recycle then, I want them overwritten, purged, or whatever the terminology is.  I do want to keep the weekly volumes for 14 days and the daily volumes for 2 days.

 

Jim Richardson 

From: Wanderlei Huttel [mailto:[hidden email]]
Sent: Monday, May 22, 2017 5:40 PM
To: Jim Richardson <[hidden email]>
Cc: [hidden email]
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

Hello Jim

 

If you want to recycle the volumes do not use the Labels so detailed.

Or you you want the Labels more detailed, you could use an Admin Job with some shell script and delete the volumes.

 

 

 

Best regards

 

Wanderlei Hüttel

 

2017-05-22 17:11 GMT-03:00 Jim Richardson <[hidden email]>:

Et Al.

 

I want to have one job per file.  I am successfully able to accomplish this by using the UseVolumeOnce = yes, Recycle = no, and the Volume Retention = 2 days or 14 days.  My files Label Format = "${Client}-Weekly-${JobId}-${Year}.${Month}.${Day}.bak". 

 

Everything works as expected until one of the volume gets recycled.

 

I see this information in the log:

Recycled volume "hrms-fd-Daily-131-2017.4.29.bak" on file device "FileChgr1-Dev1" (/backup/bacula/filebackup01), all previous data lost

 

Job: Job:                    D2D-L360SPR01-Application.2017-05-16_19.00.01_00

Volume name(s):         hrms-fd-Daily-131-2017.4.29.bak

 

So in this case the Volume label and the data it contains does not match.  I have read through the manual and searched on the subject, but can’t find a clear answer to my problem.  It looks like the Recycle = no option in the pool would solve the problem, but adding it didn’t seem to stop the behavior. 

 

Thank you in advance.

 

Jim Richardson

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users

 

 



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot


_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Dan Langille
In reply to this post by Jim Richardson
On May 22, 2017, at 6:45 PM, Jim Richardson <[hidden email]> wrote:

Wanderlei,
 
I want the detailed volume labels, I don’t want to recycle then, I want them overwritten, purged, or whatever the terminology is.  I do want to keep the weekly volumes for 14 days and the daily volumes for 2 days.

I know you want the detailed volume labels.

Why?

Bacula keeps track of what is where and when, so you don't have to.

-- 
Dan Langille - BSDCan / PGCon
[hidden email]




------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Forcing Single File Per Job in Rotation

Jim Richardson

I wanted to share the solution to Bacula cleaning up purged disk volumes. 

 

It can be found in the Bacula Systems “Best Practices for Disk Based Backup” guide under 1.4 Truncate Volume on Purge.  My only complaint about this is that I receive a message from the daemon letting me know that “No Volumes found to perform "truncate" command.” Which I would like not to receive.  Any suggestions on how to suppress that message would be appreciated.

 

Two configuration entries in your pool add Action On Purge = Truncate and in your catalog job add:

 

Job {

Name = CatalogBackup

...

RunScript {

RunsWhen=After

RunsOnClient=No

Console = "purge volume action=truncate allpools storage=<your file resource>"

}

}

 

 

Jim Richardson

CISSP CISA


SecurIT360

 

From: Dan Langille [mailto:[hidden email]]
Sent: Tuesday, May 23, 2017 5:55 PM
To: Jim Richardson <[hidden email]>
Cc: Wanderlei Huttel <[hidden email]>; bacula-users <[hidden email]>
Subject: Re: [Bacula-users] Forcing Single File Per Job in Rotation

 

On May 22, 2017, at 6:45 PM, Jim Richardson <[hidden email]> wrote:

 

Wanderlei,

 

I want the detailed volume labels, I don’t want to recycle then, I want them overwritten, purged, or whatever the terminology is.  I do want to keep the weekly volumes for 14 days and the daily volumes for 2 days.

 

I know you want the detailed volume labels.

 

Why?

 

Bacula keeps track of what is where and when, so you don't have to.

 

-- 
Dan Langille - BSDCan / PGCon
[hidden email]

 

 

CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and privileged information, and unauthorized disclosure or use is prohibited. If you received this email in error, please notify the sender and delete this email from your system. Thank you.
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Bacula-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/bacula-users
Loading...