First a bit about the urban75 boards. Based in Brixton, London, UK, urban75 is one of the busiest, non-profit community sites around, featuring huge photography sections, bulletin boards, live chat, drug information, football, direct action info and more. The boards are entirely non-profit and carry no advertising. The site is primarily funded by donations from board users (there are no subscriptions).
As a result, we’re not running on particularly flashy hardware, upgrading the server using spare equipment our hosting provider has available.
vBulletin Days and Nightmares
We have been running vBulletin for almost a decade and it served us well for much of that time.
In August 2010 we upgraded to vBulletin 4. That upgrade was, frankly, a nightmare.
I spent many, many hours trying to optimise the database, tracing slow queries and following bug reports. I also ended up installing Sphinx search, even though vBulletin seemed very slow at handling the results it got back from Sphinx. At first there were many complaints, some about things which we could fix, and others about things which eventually people just got used to.
xenForo is announced
When xenForo was announced, several of the moderators on the boards went over to the community on xenforo.com and were impressed by what they saw.
I speculatively purchased a xenForo license when they first became available, thinking I could use it myself even if it turned out to be unsuitable for Urban75.
Following the purchase of the license, I installed a test copy on our little test server, and invited the moderators over for a look.
I think it’s fair to say everyone was blown away by the functionality and there was soon a consensus that we should look to move the main Urban75 boards to xenForo.
We weren’t going to go live with a pre-1.0 version so we waited. We invited a number of users over from the main boards to take a look at xenForo and feedback their thoughts. That lasted a couple of weeks with lots of positive feedback. When 1.0 was released I started further investigations into the migration, checking what functionality was missing and what add-ons would be useful.
Using Paul M’s vBulletin 4 Importer I ran through an import from a year-old backup of the main boards, importing around 9 million posts without a hitch. On our test server the import took just over 24 hours.
There was no way I was going to use the xenForo built-in search on that size of message base so I installed the Sphinx executable and mlx’s Sphinx Search Engine add-on, followed by a few hours configuring and indexing using Sphinx. Running some test searches showed results from the xenForo boards on the test server coming back much faster than they did on the vBulletin live server. Both were using Sphinx so that indicated something seriously bad was going on with vBulletin displaying search results.
I tried a few other extras, including Darkimmortal’s vB4 URL Redirection add-on, the Tapatalk and ForumRunner mobile add-ons, and the Stop Forum Spam and Multiple Account Detector add-ons.
Preparing for the Migration
Work got in the way of planning a full migration for a while, but eventually I put a stake in the ground, choosing the weekend of the anniversary of our vBulletin 4 upgrade. With the help of other moderators, we got a couple of styles sorted out, one very similar to the default xenForo style and another variation without avatars which had been a particular request.
In preparation, I installed the xenForo software on the live server under a different directory from the existing vBulletin, and did some of the config under a single Administrator user.
Here We Go!
The actual night of the migration arrived and I closed the vBulletin site at 23:59 on 5th August 2011. We have a small phpBB installation which we open for times when the main boards are down and I put a link to that on the “Site Closed” message.
First things first, a full MySQL dump of the vBulletin database and the embryonic xenForo database, just in case.
Then the first step of the migration, using the latest version of the vBulletin 4 importer.
The user importer fell over quite quickly, complaining about “Duplicate entry for key 2” for a user named “Ęllie”. Scratched by head for a few minutes before gently renaming the user and re-starting the import. A few minutes later I hit another user with the same issue, this time called “‘Mått”. Same fix for that one and the rest of the users imported fine.
I started the largest part of the import, copying the Threads and Posts at 01:55 on Saturday morning. By 02:30 it was obvious this was going to be a very long job so I went to bed hoping that the import might speed up while I was asleep. Rising at 06:30 I found that it hadn’t got any faster and that my original estimate of a much faster import on the live system was sadly wrong.
With me monitoring progress through the day, and updating the users via the phpBB boards and the “Site Closed” message, the posts finally finished importing at about 21:30. The importer then runs through a cache update for users and threads.
A dash through configuring Friendly URLs, moving the Sphinx config to index the xenForo boards instead of the vBulletin ones, checking basic user permissions and configuring a few more add-ons took me until 23:30 when we finally re-opened the boards.
So 23.5 hours start to finish for 10.3 million posts and I understand that we’re now the largest UK site running xenForo.
It took me a little while afterwards to get the vB4 Redirection working properly, and we’ve had a slow-query issue with another add-on which the author is hoping to fix. My thanks to Kier for helping track down where that query was coming from despite my still-frazzled support request.
The users seem generally pleased with the results, though there are a number of complaints about relatively minor pieces of functionality missing, dislike of change, dislike of the colours along with some genuine issues with useful functions missing that were previously available. Some of these are already addressed in xenForo 1.1, other might be later, and some may never get fixed.
From a tech admin point of view, xenForo is much lighter on the hardware, we’ve hit more than 800 users online already which is close to the highest we ever had under vBulletin and the only issue has been with the add-on I mentioned earlier.
My thanks to all the folks at xenForo for coming up with what has to be the neatest bit of forum software around. Also thanks to the authors of all the add-ons we’re using, and to all the xenForo community members for sharing their experiences and supporting such a great product.
It’s been a long journey, but we’ve reached our first xenForo milestone. May there be many more in the future!
Board Stats as of 8/8/2011
CPU: One core of 2.133GHz Xeon X3210
OS: Ubuntu Linux 10.10 virtual machine running on vSphere 4.1 host
Disks: Virtual disk stored on 3ware-controlled RAID1 pair of 250GB SATA drives
CPU: Intel Quad Core Q9300 @ 2.50GHz
OS: FreeBSD 7.2
Disks: Adaptec-controlled RAID1 pair of 150GB WD Raptor SATA drives
Thanks for the post, very interesting to read your experiences of migrating a large vBulletin installation to XenForo. My site is of a similar size to yours, although with a larger user base I believe (1500+ online on average, spiking to 4000+ on busy days) so it’s good to see a successful migration as I’m strongly considering moving to XenForo at some point.
Nice idea to setup a temporary phpBB forum during the migration. Did you import user accounts to it so people could login with their existing credentials or just ask your users to re-register?
How did you find configuring Sphinx for XenForo? Any gotchas or is it straight forward? I’m still using the built in vBulletin search, as well as Google search, but definitely considering switching to Sphinx.
…also, are you able to go into more details about the ‘useful functions missing’ from XenForo compared to vBulletin? Are they mostly admin/moderator related features or ones that users are missing?
There are a few:
Search within a thread – we have some very large threads
Summary of who posted on a thread – again useful for large threads
Ignore User – coming in v1.1 though
There are probably some more that haven’t sprung immediately to mind, and there were a lot of functions in vB4 that we didn’t use (albums, social groups). I think xenForo more than makes up for it in slickness, performance and general design.
We keep the phpBB separate so users have to re-register. Keeps things simple, and we opened them a while before so people could sort out their accounts. We had a couple of admins around to authorise accounts.
Sphinx was initially very complex under vBulletin as the official “beta” mod was useless.
I ended up using DigitalPoint’s version which was better.
Under xenForo it was much simpler, though that may be because I’d dealt with it before. I still haven’t got the metadata search working, but the search results come back so quickly now that I’ll live without that for a while.
What xenForo plug-in did you install that caused slow query issues?
It was ragtek’s Framework (needed for most of his add-ons) which was the problem. It carried on doing the same even when disabled, which was a surprise. Only uninstalling and removing the files made it better.
He’s looking at fixing the issue ( http://xenforo.com/community/threads/backward-compatability-breaks.13290/page-2 ) already.
I have 3 – 4 boards to convert to XenForo, but can’t until they get some basics implemented. Mostly a warning system. Once we’re there, I’ll be saying goodybe to vB.
vB was good, but I never even ugpraded to v4 – it was just such a shocking update with on real value. And they’re so behind the curve on the more ‘social’ side that forums clearly need. Like something as simple as a like button.
We also plan a migration. Test works good for now, but we will wait for 1.1.
I can’t see any vBulletin4 importer into my Importer!! is it a separate plugin?
It’s an add-on – http://xenforo.com/community/resources/vbulletin-4-to-xenforo-importer.256/
wow amazing story. So the last final conclusion Xenforo is more light than vBulletin, right ?
I’m sort of stuck right now myself–trying to convert a 7.5 million post vB3.7 board over to XF. My issues now are the long import time, and I really want to get Sphinx working on 1.1.3 rather than use ElasticSearch (which is a known memory hog). Have you ever upgraded your forum to the 1.1 series, and were you able to keep Sphinx? I have a set forum setup but have not had any luck. I had a thread reopened on XF’s own support forum so we could all figure out what needs to be done to make Sphinx work with 1.1.
my website http://aqarspot.com is in Arabic language do i have to make other steps
I’ve not tried an Arabic site but my understanding is that XenForo has good Right-to-Left language support so it should be possible.
There is a good Arabic language file available – https://xenforo.com/community/resources/xenforo-arabic-language.55/
Hey check this discord