MythTV 0.22 on Ubuntu 9.04

December 3rd, 2009

I had a major issue at home with my MythTV backend server… and off course, right before I was implementing a decent backup strategy.

I wanted to move to a Raid5 solution to increase speed and disk capacity, but wanted to do an Ubuntu 9.04 reinstall, move all data and config over from the old single-disk install, and keep running on settings and recordings already in the database. At the same time I wanted to upgrade the backend to Ubuntu 9.10, and use the newer MythTV 0.22 packages.

My install went pretty fine, using software Raid 5 on 3 disks I still had lying around (WD Raid edition SATA2), formatting the 500GB usable space as an ext4 volume, and installation of MythTV and other related packages was done without any issues. I started copying from the old single-disk setup to the new soft-Raid volume, and was almost done migrating. The configuration of MythTV through mythtv-setup couldn’t find my Technotrend S-1500 DVB-S card I used for months now, without any issues on Ubuntu 9.04… so I needed to have a look at that… but I even didn’t get to that point!
All of a sudden, the session over ssh was having some big issues, not finding commands, giving errors etc… Returning to the console, a lot of raid error messages were displayed, so a reboot and recover/rebuild was needed… the machine didn’t take any commands anymore… even a ‘halt’ or ‘reboot’ didn’t work…
When powering down and back up, the machine hung at the kernel loading, giving me a serious error not retrieving md0 anymore… Panic!!!

I disconnected my original disk, booted a Live session of the Ubuntu Desktop 9.10 cd (ext4 is better supported in 9.10 than it is in 9.04), and tried almost everything I know and could find about retrieving data from a faulty software raid volume… to no result…
I decided to do a fresh install on ext3 instead of ext4 with the Ubuntu 9.04 distro, to resolve the card-support issues I was having with Ubuntu 9.10, which worked out pretty fine again.
Card was detected, and scanning gave the results I expected.

I hooked up the original single-disk install SATA drive, and wanted to start copying the database, recording and settings files, but I wasn’t able to mount any of the original partitions on the disk. After some looking around on the disk, I found all partitions vanished! The disk was empty! Even more panic!!!!

Testdisk, an open source partition and data recovering program, had me regain access and information of the recordings partition, and I immediately made a copy of the data to my backup-server, but still no /etc or /var/lib/mysql to be retrieved to get access to the original database and settings… So I need to start from scratch, and convert the old recordings to standard mpg or avi files, so I can at least play them without info etc… That’s not the end of the world!

Now, the MythTV 0.22 upgrade part was going to be the hardest…, or so I thought.
In Ubuntu 9.04, the 0.22 MythTV packages aren’t available through the normal repositories…
I searched in google, and eventually found a page on the MythBuntu site that describes the necessary steps and packages needed to upgrade a 9.04 (or even a 8.10) Ubuntu distro with the MythTV 0.22 release…
The MythTV backend server was easily upgraded through the use of the MythBuntu Repositories package
After installing this deb file through dpkg -i, going into aptitude and doing an update/upgrade, the MythTV packages were upgraded to 0.22 automatically.

I tried connecting with my 0.21 based frontend machines (which run Ubuntu 8.04 LTS), but found that the database structure was changed in such a way the 0.21 cannot contact and use the 0.22 database structure… An upgrade to 0.22 on these machines is needed as well.

I installed the same MythBuntu Repositories package package on these 2 machines, and found it could only install the already installed 0.21 version. I needed to upgrade the distro to 8.10 or higher… I decided to go all the way up to 9.10…

The standard AMD based pc which resides in my living room and is hooked onto the beamer, is the easiest… if anything goes wrong, I can just reinstall it with 9.10 from scratch…, so I started with this one before messing up the MythBuntu 8.04 installation on the AppleTV in the bedroom (which is a lot more work to do a complete (re)installation).
Though not supported, I changed over the /etc/apt/sources.list hardy listings to karmic, and did an apt-get update followed by an apt-get upgrade and an apt-get dist-upgrade… I met a lot of errors installing or configuring packages, and needed to uninstall a lot of packages through aptitude, but eventually using apt-get dselect-upgrade and another apt-get upgrade and dist-upgrade, the machine eventually ended up booting fine with Ubuntu 9.10.
I installed the MythTV 0.22 packages through aptitude and ended up configuring the connection to the newly installed database on the backend. Two minutes , and some screen adjustments later, I was looking at LiveTV through the new 0.22 MythTV release!

For the AppleTV, I will follow the same things, but I’m making a full rsync of the complete filesystem first. If anything goes wrong, I can just rsync it back over it, and have the machine working again…

Now I just need to convert all recordings to a viewable format (mpg or avi) and change all the filenames so I know what recording is in what file… that will take another weekend to do so, I think.

First impressions of 0.22: faster, slicker, … but I didn’t see that many adjustments or changes… (except from the new theme stuff, which was the biggest change announced off course)

Next on the list: BACKUPS!!!! I have a backupserver giving me 2,3TB through NFS of which still 1,2TB is free, why wouldn’t I use it??? :p

More to follow later…
At least now, I’m up to date again…

Arkeia free Enterprise Backup solution for Ubuntu

November 16th, 2009

According to this page found through this article Arkeia is providing a free license for their Enterprise grade Backup solution Arkeia Network Backup version 8.

The license includes 2 agent licenses for Windows, Mac OSX/BSD and Linux machines and the server software is included in the Ubuntu 8.04 repositories.

I’ll install it on my server for sure!!

Astaro Essential Firewall

November 16th, 2009

Astaro introduces an Essential Firewall Edition of the Astaro Security Gateway software firewall solution, which helps smaller businesses to secure their network, without having to pay lots of money.

As far as the news bulletin describes, the Essential version includes the normal networking stuff, including QoS, DNS Proxy, Statefull Packet Inspection, DHCP Server & Relay, and PPTP/L2TP vpn connectivity.

The software is available as an installation iso image, and a VMWare package.

The last one I will test this evening or tomorrow, so I can give you a detailed overview of the possibilities etc…

More info here.

VMWare Server weird behaviour

October 27th, 2009

I’m in the middle of migrating my VMWare Server machine to lower-power hardware, after one of the disks in the old machine has been giving me lots of filesystem troubles lately.

Now, I installed an MSI AMD AM3 socket based board with a single dual core X2 240 (which has a TDP of 65W)on it, and 2GB DDR3 for starters (will be upgraded to 4GB or more afterwards), instead of the old Intel Pentium D930 which has a TDP of 95W. Added that I’m using the Western Digital Green Power drives now, that lowers the power requirements even further…

Now, when migrating the VMWare Server guest machines (a Windows SBS 2003, and 2 Linux machines), I noticed a weird thing: The Processor Usage window displayed a whopping 113740.00MHz, which would mean I overclocked the (standard 2.8GHz) 113,74GHz!!!!

I don’t believe it… do you?
See for yourself!Screenshot-VMware Infrastructure Web Access - Mozilla Firefox

Ubuntu 9.10 and MythTV

October 12th, 2009

I’ve been running a beta version of Ubuntu 9.10 for over two weeks now, with mixed feelings.
Updater tool isn’t really consequent about updating my machine, making me check updates again after installing them over and over again.
The overall performance of the machine, bootup times etc are great, but when loading Gnome, it always freezes when gathering my deskbar icons and settings, so there must be something wrong.
FPM2, the password manager I love and use, doesn’t “copy” the passwords anymore, making me have to ‘edit’ the entry, let it display the password, select and Ctrl-Ins it to copy it and use it in another application…
Firefox is version 3.5 by default now, but Astaro pre 7.5 firewall Config GUI’s have an issue with their drag-’n-drop functionality with 3.5, so I needed to get it out and install 3.0 again, which ran quite OK.

Now the best part is: I just received a ‘partial upgrade’ notification, letting me know MythTV has an upgrade waiting to 0.22… Nice!!!

I’ll be testing it with my 0.21 backend, and maaaaaybe, if I feel very lucky and adventurous, I might install it on the backend machine I have running here too…
I’ll keep you posted on my findings and the new things I find in 0.22 that are really worth mentioning!.

Mythtv is still advancing, though it took a while before 0.22 really got usable, it seems, but hey! I’m patient, I know they’re working hard to make it the best Media Center Software solution there is.
Keep up the good work! MythTV rocks!

MythTV EPG updating

October 12th, 2009

I recently had a changeover to TV Vlaanderen, as you might have read in my other posts.
Not sure if it was related, but I had some issues watching and recording programs, while the DVB Broadcasted EPG function was on.
I searched around for a decent solution that could pull the EPG data from the web, and as the good old xmltv grabbers for Belgium don’t work anymore, or at least they didn’t in june/july because of the source website blocking the grabbers from getting the info from their webpages, I stumbled upon mc2xml.

I got it all to work thanks to a script, I can’t remember where I got it from. Normal decency obliges me to post back my additions or changes (if at all…, don’t remember that part anymore either), which you can find under the seperate page EPG configs and scripts in my pages section.

Good luck and if you have additions, changes, remarks, … please let me know so I can adjust or complete my configs and post them back for others to read here.

Android 1.6 update?

October 3rd, 2009

OK, I admit, I haven’t been following the latest news about the Android developments…
All of a sudden, about 10 minutes ago, I noticed a ‘system update’ message on my T-Mobile G1 phone (none-dev one)…
It looks like it’s fixing a couple of issues surrounding reboots when dialing 911 (Not needed in Europe, so not important).
It also marked that Google Maps Voice search is already here? OK, I don’t use (or didn’t until now) the voice search capabilities on my phone, but this definitely is something nice :D
Also, an updated Market will be a great change, but will have to check that and see what exactly has been changed…
More info about the Market Update can be found here.

The update took about 5 minutes, the reboot following was more painful… It took about 10 minutes to reboot my phone, but I guess a lot of underlying updating of databases and such will be the cause of that…
More news to come when I figure out all the nice new things, if I find them ;)

Update:
Not only the Market is updated, but the new 1.6 version gives Android basic VPN connectivity: PPTP, L2TP and L2TP/IPSec connections both on PSK and certificate base.

Now, one minor issue I need to report: since the update, my Edge/GPRS connection isn’t working at regular intervals… mostly exactly when I need it to be there…
Also my Wifi connection isn’t autoconnection that easily anymore… It is connecting, but I really often need to do it myself again…

I’m keeping an eye on it, and will test the VPN possibilities, but it looks very promising…

More info on the changes can be found here.

update2:
The GPRS/Edge issue is getting worse…
I’m actually even thinking of rolling back the update, that is: reinstalling with the original Firmware, doing the update to RC29, to RC30, to RC33 and then to 1.5 until it asks me to update again to 1.6…
This morning even the normal GSM connecting hang… I wasn’t able to receive calls, and when I tried to dial myself, the whole phone just hang, no response whatsoever. I needed to take out the battery and do a complete restart…
I’ll be looking for others this evening that have similar issues with the update to 1.6

In fact, it looks like Google/T-Mobile released the update a bit too soon… if you look at all the news around the 1.6 update… no one knew it was coming and several programs have issues because they weren’t ready for 1.6 yet… let’s hope Google/T-Mo sends out a fix real soon…

Virtual Desktop

September 17th, 2009

I have been playing with the idea for a long time now: No more noisy, power-hungry desktop on my desk at home… just a simple, noisless, thin client of some kind.

At one of our clients, we use Igel thinclients that connect to an Ubuntu Desktop -server, over XDMCP.
XDMCP is rather easy to configure and use, and allows full X over networks, so all processing is done on a central machine.
I have a VMWare Server 2.0 and a Citrix XenServer 5.5 machine running for other virtualized testing machines, so why not integrate the ‘Desktop server’ in the virtual setup, to even cut more power costs?

I used an old Wyse 9450XL I bought at the computer fair over half a year ago, formatted the seated 512MB IDE flash drive and ran Damn Small Linux on it, which can work both locally and through an XDMCP session on my Desktop server.

I’ll install FreeNX on the server side too, and compare the speed differences, but as far as I know and remember, DSL does not have the needed recent versions of several libs, so that might be an issue…
Well, we’ll see. For now I’m set.
Desktop ‘computer’ setup only takes about 20W instead of about 200W before with a fullblown PC.
Advantage of the FreeNX way is that remote sessions are also possible… Goodbye to slow VNC connections!

I’ll post some configs, like the gdm.conf on the server side, later.

MythTV and TV Vlaanderen – Success!

September 17th, 2009

I’ve been struggling through several setups to get TV Vlaanderen pay-channels on my MythTV setup.
Apparently, sometime last year they went from the old encryption system to Seca3, which isn’t easy to get up and running..
I tried the NewCS and Opensasc-ng way on an Ubuntu 8.04 using several guides, and had minor successes: The newcs seemed to work as it was reading my TVV smartcard located in the USB Smargo card reader, and OpenSasc-ng was configured to get the info out of the camserver, but I never succeeded to get the channels appearing in MythTV, leaving a ‘LAMc’ notification in the frontend, at best…

Finally, I tried with a TechnoTrend S-1500 with its CI, and without NewCS and OpenSasc-ng, the image appeared, no config needed, just plug the smartcard in the CAM that TV Vlaanderen delivered, and put it in the CI.

So, for all you out there struggling with the same issues: TechnoTrend S-1500 with CI does the job, no problems whatsoever.

Now I only need to get the EPG running, it seems that it is only getting partial data from the DVB-S stream…
Maybe mc2xml might work now?
Any help with it is welcome…

Super Storage – The Backblaze Pod

September 4th, 2009

Check the blog entry from backblaze. They decided to design their own storage machines which are far less expensive, compared to commercial available material.

This super massive machine looks very appealing to me.
They use a SATA multiplier backplane, which can host 5 SATA drives on a single SATA port.
I’m going to look for the materials, and try to build a 15 drive (strating with cheap 40 or 60GB drives for testing) machine myself…
Combine that with FreeNas and its ability to do iSCSI and NFS, and it would make a perfect VMWare/Citrix storage backend, no?