A few days ago I recorded this demonstration showing the Simpana 10 Linux FS iDA interactive installation on Ubuntu 14.04 Server LTS. Hope you enjoy.
I just installed Ubuntu 14.04 Server tonight and tested the installation process of TvHeadend per my other notes and it works fine.
Ironically enough so far I really like Ubuntu 14.04 Server, so I will leave it running for a bit and see how much I do like it after a few days and/or weeks.
I was hoping to install rtorrent and rutorrent on Debian 7.5 Wheezy, however it appears although I was referencing the page here, it appears to not work that simply.
i.e. Appears the installation of the two packages below causes some messed up packaging conflict and it seems to be in some sort of dead lock. I couldn’t get past it so I had to give up for now.
Problem packages causing packaging conflict is these;
Will give it another go in a few weeks time. I’ll also continue to do a bit of research to see if anyone has had success with this and how they did it.
It would appear that my Realtek RTL2838 DVB-T tuner has failed. I can no longer get it to record any more using TvHeadEnd. I noticed I hadn’t got any recordings the past few days and I’ve just checked all the connections. At this stage I think it’s safe to conclude that it’s gone.
It certainly didn’t last very long. I might end up getting another one, however not in a big rush. I need to do some other work with the hardware, so I might move onto that project in the meantime.
I note that dmesg output is showing the following, which based on some of the word is related to the hardware failure of the device.
[ 5520.964222] kdvb-ad-0-fe-0 D ffff88011d96eb20 0 2406 2 0x00000000 [ 5520.964226] ffff88011ce17d08 0000000000000046 ffff88011ce17cf8 ffff880127c54580 [ 5520.964230] ffff88011ce17fd8 ffff88011ce17fd8 ffff88011ce17fd8 0000000000014580 [ 5520.964233] ffff880121f29770 ffff88011cf05dc0 0000000000000286 ffff88011ce17d90 [ 5520.964237] Call Trace: [ 5520.964242] [
] ? dvb_usb_data_complete_204+0x20/0x20 [dvb_usb_v2] [ 5520.964246] [ ] schedule+0x29/0x70 [ 5520.964250] [ ] wait_schedule+0xe/0x20 [dvb_usb_v2] [ 5520.964254] [ ] __wait_on_bit+0x5f/0x90 [ 5520.964258] [ ] ? dvb_usb_data_complete_204+0x20/0x20 [dvb_usb_v2] [ 5520.964261] [ ] out_of_line_wait_on_bit+0x7c/0x90 [ 5520.964265] [ ] ? wake_atomic_t_function+0x40/0x40 [ 5520.964270] [ ] dvb_usb_fe_sleep+0x114/0x1b0 [dvb_usb_v2] [ 5520.964277] [ ] dvb_frontend_thread+0x177/0x780 [dvb_core] [ 5520.964281] [ ] ? add_wait_queue+0x60/0x60 [ 5520.964288] [ ] ? dvb_frontend_ioctl+0x160/0x160 [dvb_core] [ 5520.964291] [ ] kthread+0xc0/0xd0 [ 5520.964295] [ ] ? flush_kthread_worker+0xb0/0xb0 [ 5520.964299] [ ] ret_from_fork+0x7c/0xb0 [ 5520.964303] [ ] ? flush_kthread_worker+0xb0/0xb0
This week I setup an old Dell Optiplex 755 tower with Ubuntu 12.04.4, TvHeadEnd and Realtek RTL2832U USB tuner to perform some DVB-T recordings. The installation I performed of TvHeadEnd is the exact same one I documented some months back when I used the same USB tuner on a Raspberry Pi. You can read about it here.
The installation was flawless and simple as you’d expect. The system has been running a few days now and capturing what I want. It also allows me to point VLC client on other machines at the system to network stream any of the DVB-T channels the tuner can tune against (also shown in the previous post linked above).
Thinking of buying another tuner to be honest, so I can record from 2 different channels that don’t share the same stream/multiplex id.
I was asked to write up a MySQL related post on how to backup MySQL with the Simpana 10 MySQL iDA and how to configure a test machine.
I am currently working on this and should be posting it in the next month, so keep an eye out. It will follow along the same lines as the PostgreSQL one I posted earlier. As seen here.
I am going to assume that this is a test deployment and as such will expect that you have installed your CentOS 5.10 x64 Linux the way you want it, and I will follow on from that point on what I needed to perform to get the distribution release of PostgreSQL to work with Simpana 10 PostgreSQL iDA to perform a backup. Of course some assumed knowledge present.
- Install the postgresql packages onto your CentOS client.
$ sudo yum install postgresql84 postgresql-server postgresql-devel
- Startup postgresql server for the first time, you need to run initdb switch instead of start for the first time only.
- $ sudo service postgresql initdb
- We should also enable the service to run at boot moving forward
$ sudo chkconfig postgresql on
- Before we change the authentication method below, we need to set a password that we know for the postgres user in the postgresql database. To perform this we need to change to the postgres user and connect to postgresql database and update the password for the user to something we know.
$ sudo su –
# su – postgres
- Now at the postgres prompt update the password for the postgres user, unless you want to make your own. Won’t discuss how, just going to show how to set postgresql user password. Be sure to remember what you set the password too, it will be required later on.
postgres=# ALTER USER postgres WITH PASSWORD ‘password’;
- Postgresql packages distributed with CentOS don’t use md5 password authentication, it defaults to peer/ident based authentication. In this example we will flip this to md5 based authentication, and we will touch on a peer/ident based authentication example in a later post. Perform the changes below to enable md5 authentication.
$ cd /var/lib/pgsql/data
$ sudo vi pg_hba.conf
Find the line at the bottom of the file that looks like the one below;
local all all ident
You need to change this to have md5 on the end, i.e. replace ident to be md5 instead. Save the changes.
- Now restart postgresql for the changes to take effect. (required)
$ sudo service postgresql stop
$ sudo service postgresql start
- Now you can test that this has worked by execution as root the command below, and when prompted for the postgres user password authenticate using the password set in step 6.
# psql -U postgres
If it worked, you will get the famous postgres=# prompt, in which you can enter q [enter] to quit it.
- Next up we now need to enable archive logs. We need to edit the postgres.conf file which on CentOS rpm based install is /var/lib/pgsql/data and the lines we need to add in the Archiving section is below;
archive_mode = on
archive_command = ‘cp %p /var/postgresql/archive/%f’
Save those additions and move on below.
- Make sure to create the folders/destination used in the archive_command above and ensure postgres user can write to it etc.
- Now restart postgresql for the changes to take effect. (required)
$ sudo service postgresql stop
$ sudo service postgresql start
- Install the Simpana PostgreSQL iDA.
- Once installed refresh the Simpana Console and attempt to create your PostgreSQL instance. See the dialog below for the values I used in this configuration. Of course the username is the postgres user and password we configured in step 6. Note the archive log directory is the one we used in the archive_command string at step 10 too.
- If everything goes to plan you should have your instance created and now you can do configuration against the DumpBaseBackupSet subclient and/or FSBasedBackupSet subclient. For the difference between what each does, I recommend you review the documentation. As each backupset has its own unique capabilities. See the bottom of the Backup documentation page for explanations.
- Assign a Storage Policy to each subclient and run a backup of each to confirm it works.
CommVault Documentation references:
Came across an interesting condition today, which took me a bit of testing to identify why the job would go into a pending state. This one relates to Simpana 10 on a Linux client where you have a File System iDA with a PrePost command being executed. In my test below the script is doing nothing special, it’s merely to have something to execute to show the behavior. I’ve provided it below purely for reference.
[root@jldb1 bin]# cat pre-scan.sh #!/bin/sh # test # echo $1 $2 $3 $4 $5 $6 $7 $8 $9 >> /root/pre-scan.log exit 0
Job goes pending and produced the following errors and output below;
JPR (Job Pending Record)
Error Code: [7:75] Description: Unable to run [/usr/local/bin/pre-scan.sh] on client.
Source: jwcs, Process: startPrePostCmd
3024 d88 03/27 18:16:26 21 Scheduler Set pending cause [Unable to run [/usr/local/bin/pre-scan.sh] on the client. ]::Client [jwcs] Application [startPrePostCmd] Message Id  RCID  ReservationId . Level  flags  id  overwrite  append  CustId. 3024 118c 03/27 18:16:26 21 Scheduler Phase [Failed] message received from jwcs.lab.heimic.net] Module [startPrePostCmd] Token [21:3:1] restartPhase  3024 118c 03/27 18:16:26 21 JobSvr Obj Phase [3-Pre Scan] for Backup Job Failed. Backup will continue with phase [Pre Scan].[startPrePostCmd.log – commserve]
4940 e4c 03/27 20:21:46 ### Init() - Initializing job control [token=21:3:7,cn=jwcs], serverName [jwcs.lab.heimic.net], ControlFlag , Job Id  4940 e4c 03/27 20:21:47 ### Cvcl::init() - CVCL: Running in FIPS Mode 4940 e4c 03/27 20:21:48 ### CVJobCtrlLog::registerProcess(): successfully created file [C:Program FilesCommVaultSimpanaBaseJobControl4.940] 4940 e4c 03/27 20:21:48 ### ::main() - jobId 21 - restoreTaskId = 0 4940 e4c 03/27 20:21:48 ### ::main() - jobId 21 - adminTaskId = 0 4940 e4c 03/27 20:21:48 ### ::getBackupCmdAndMachine() - jobId 21 - before construct application id 4940 e4c 03/27 20:21:49 ### ::getBackupCmdAndMachine() - appTypeId = 29 4940 e4c 03/27 20:21:49 ### ::getBackupCmdAndMachine() - jobId 21 - symbolic AppId = 2:20 4940 e4c 03/27 20:21:49 ### ::getBackupCmdAndMachine() - jobId 21 - prePostId = 1 4940 e4c 03/27 20:21:49 ### ::getBackupCmdAndMachine() - jobId 21 - preifind cmd = /usr/local/bin/pre-scan.sh 4940 e4c 03/27 20:21:49 ### ::main() - jobId 21 - commandPath = /usr/local/bin/pre-scan.sh 4940 e4c 03/27 20:21:49 21 ::main() - jobId 21 - before execute cmd 4940 e4c 03/27 20:21:49 21 ::main() - jobId 21 - Use Local System Acct. 4940 e4c 03/27 20:21:49 21 ::main() - jobId 21 - remoteexename = [/usr/local/bin/pre-scan.sh] 4940 e4c 03/27 20:21:49 21 ::main() - jobId 21 - args = [ -bkplevel 1 -attempt 7 -job 21] 4940 e4c 03/27 20:21:49 21 executePrePostCmd() - Attempting to execute remote command on client [jldb1].. 4940 e4c 03/27 20:21:49 21 executePrePostCmd() - jobId 21 - Received error text from server cvsession [Unknown Error] 4940 e4c 03/27 20:21:49 21 executePrePostCmd() - jobId 21 - Error  returned from executeRemoteCommand /usr/local/bin/pre-scan.sh 4940 e4c 03/27 20:21:49 21 EvEvent::setMsgEventArguments() - MsgId[0x0700004b], Arg =  4940 e4c 03/27 20:21:49 21 EvEvent::setMsgEventArguments() - MsgId[0x0700004b], Arg = [/usr/local/bin/pre-scan.sh] 4940 e4c 03/27 20:21:49 21 EvEvent::setMsgEventArguments() - MsgId[0x0700004b], Arg =  4940 e4c 03/27 20:21:49 21 EvEvent::setMsgEventArguments() - [MsgId[0x0700004b]:  Args Pushed,  Args expected. 4940 e4c 03/27 20:21:49 21 ::exitHere() - jobId 21 - Exiting due to failure. 4940 e4c 03/27 20:21:49 21 BKP CALLED COMPLETE (PHASE Status::FAIL), 21. Token [21:3:7] 4940 e4c 03/27 20:21:53 21 ::exitHere() - jobId 21 - startPrePostCmd Terminating Event. 4940 238c 03/27 20:21:53 21 CVJobCtrlLog::unregisterProcess(): successfully removed file [C:Program FilesCommVaultSimpanaBaseJobControl4.940][cvd.log – client]
30846 427e0940 03/27 20:21:50 ### [CVipcD] Requests from non-CS with hostname [jwcs.lab.heimic.net] and clientname [jwcs] to execute in user entered path are not allowed
I worked out this problem is caused by lack of value in regkey sCSGUID as found in the location below;
[root@jldb1 ]# cat /etc/CommVaultRegistry/Galaxy/Instance001/CommServe/.properties | more bCSConnectivityAvailable 1 sCSCLIENTNAME jwcs sCSGUID sCSHOSTNAME jwcs.lab.heimic.net sCSHOSTNAMEinCSDB jwcs.lab.heimic.net
sCSGUID should be populated and its lack of value causes this condition with pre-scan script execution.
Easiest method to recreate this regkey value is to do a local uninstall of the simpana services on the client. Revoke the client certificate in Simpana Console via Control Panel – Certificate Administration for the client in question. Followed by a reinstall.
Subclients that have no scripts being executed as part of the backup will run fine if this regkey value is missing. You will never see a problem until you add a script. In addition, clients that have a simpana firewall configuration will be broken and subclients without scripts will break too. As the regkey value is used for simpana firewall configuration exchange I believe based on my testing.
Hope you enjoy my post… drop me a comment if you like the content and/or it helps you.
Was reading twitter, as I would typically do when in transit. Came across a really good post on sudo and security. Highly recommend having a read.
Check it out here.
Some excellent information contained in the post. – Sudo (su “do”) allows a system administrator to delegate authority to give certain users (or groups of users) the ability to run some (or all) commands as root or another user while providing an audit trail of the commands and their arguments.