Posts Tagged ‘ wordpress ’
I am testing the new Comics gone bad plugin here
The plugin basically downloads three images of different resolutions from the main server and embeds it in the site at various places. You can set the image size from admin panel and also embed the daily comics into the sidebar as a widget…
for more info and downloading the plugin visit http://wordpress.org/extend/plugins/comics-gone-bad/ 
This is actually where my basic goal ends for GSOC2010. I am trying not to get over excited and bite more than I can chew. I just had a brainstorm for 3-4 days on it and found out many issues(half of them arent mentioned here because I found solutions and am running out of time to fill in details). I can imagine how many issues I may face during the course of this project. If all goes well and I have time, I will surely work out ideas with my mentor and go beyond to #7 and #8. Here I will try and add move plugins too and may be work with the community on the documentation for plugins to support WPmove.
I think that the other project in the idea section will be of great help here. As we are making this for the novice user, we cant leave him getting frustrated seeing the “please wait” text or the huge list of actions going on like the plugins( I dont mean that the plugin progress text idea is boring or bad but a progress bar is cooler and also that plugins have very few steps and dont seem like the whole kernel at work)
In case of file transfers or total number of files to the number transferred and in case of multi user blogs, total blogs completed, posts out of the total posts undergoing replace and the whole WPmove net progress in steps with some way of giving weightage to the various steps involved.
The best thing about thinking of it this way is being able to let the user have checkpoints like in standard mission games. So that even if some process goes wrong, the user gets his progress from the last “SAVE”
(lol I know this sounds funny but acc to a TED talk anything can be made into a game and the users love it. I bet providing “steps to move” like checkpoints will promote users to save at a checkpoint and re-assume later thus lowering the server load use 
)
To minimise the server loads and avoid crashing, the whole replace in the database will be made one table at a time that too with php sleep function and in batches of few hundered entries.
I am looking for the phpclasses code which keeps track of the processes running at the server and cpu usage and if I find that it can be used without troubling the end user, I will use that to keep a check on the processes. Also the checklist model of file transfer would be great as it will help in allowing breaks wherever wanted and also not keep running and cause the server to get slow.
Another very important aspect is error handling. As this process involves a lot of data manipulation and handling, it needs to have all ways of handling various unexpected situations. During the course of the project, I will aim at always having a fallback plan-B for everything that can go wrong.
A checklist of files on Source Server(say Server A) will be made first.
XML-RPC can be used to maintain the list between the 2 installations
As the files get transferred, they can be striked off from the list.
FTP is a great option but there may be cases where the user permissions arent available and also where the user himself isnt sure about the FTP credentials. CURL and SST can be a good options too here…
After a little bit of research (I am making a plugin right now for a comics site to be able to allow download and embed for their daily comics update image episodes), I figured out that the existing HTTP_API can be of great use here to either download each file from a list generated at the Source Server ( Server A) to the Destination Server (Server B).
Possible issues here can be the directory permissions of teh destination server causing the copy impossible. To check if a file was copied correctly or not, we can use the md5 checksum method used by search engines for pages when they revisit them.( we will have a md5 sum on Server A before sending data and one on Server B after the data is recieved, if they match, the file can be striked off a checklist and regarded as downloaded) As this is being done from a list, this can be put up as a cron job or like a pauseable task through the browser of the user in cases of huge number of files.
There may be a lot of cases when the domain replace in the blog posts may result in an error. For example:- Say I run a blog and I want all my subscribers and visitors to know that the domain will be “changed from abc.tld to xyz.tld” and I write a post about it. After our simple replace will cause the post to show “changed from xyz.tld to xyz.tld” which is undesirable. Also people will want to change texts like “At ABC we believe in serving our customers” to “At XYZ we believe in serving our customers”(Note that the names ABC and XYZ arent domain names as they dont have the .tld extensions ) but not in cases where they write that “ABC was established in the year 2000″. We can skip the ABC name to XYZ name because thats just text to wordpress and we arent changing it so we arent answerable to the customer(though it wil be a good bonus if we made that replace for them). But in cases where wordpress had inserted a link or where a change is occuring because of the domain replace concept, there we do need the user’s permission atleast.
One potential solution that came up during chats with mentors is to change the urls of files directly to the new ones as there wont be any case where the user will need the old links unless he is using the old server and domain to host his files(we can have him decide that during the move) and to log the changes for the user to review and revert or may be better log the changes first and let him have a checkbox type interface where he can select where and where not to make the changes… There is just one small issue here that all the places where potential changes may occur are to be made must be tagged first so that we know the difference between “changed from abc.tld to xyz.tld” and “please visit us back at abc.tld for more info” from within the same post…
The main aim here is to search and replace the old domain name with the new one…
It seems that the simple Like %example.com% search and a replace but its lot more than that. One case as mentioned in the main idea text is the presence of serialized array in the tables. For that we can have a simple solution of
looking for serialized data first in the tables > unserialize them > making the replace in the resulting array> serialize > update
But this can be done easily only on tables… In sql files the solution will become a lot more complex as just finding serialized data will need matching. So here we can make another set of backup tables from the code and start the above process on them, say of the format [dbprefix]_wpmove_[originaltablename] but that will mean a live running site where data can be changed and it will vary from the backup table we have
So final idea sums up to
take backup> post a site down for maintainance message> look-up all occurrences of the domain in the db(except the posts table, will come to that in next point)> check if the data is serialized array>if yes follow the code section mentioned above>replace n update.
One very cool reply I got for the [wpurl] mail on wp-hackers was of Otto
function maybe_unserialize( $original ) {
if ( is_serialized( $original ) ) // don’t attempt to unserialize
{
$fixed = preg_replace_callback(
‘!(?<=^|;)s:(\d+)(?=:”(.*?)”;( ?:}|a:|s:|b:|i:|o:|N;))!s’,
‘serialize_fix_callback’,
$original );
return @unserialize( $fixed );
}
return $original;
}
this creates an array output even if we have a search and replace on the domain directly and the new domain has different characters.
try changing the count before the element data in serialized text and pass it thru this function
Move WordPress
Currently, if you want to move your WordPress install to a new host and keep the same domain, you only need to move all the files (WordPress Core, Themes, and Plugins), and then export/import the database. It’s pretty straight forward, but still more complex than many users are capable of.
However, if you want to change the domain (even without moving to a new host) you have to export the database, do some search and replace on the .sql file, and then re-import the updated database. Even then, if the new domain has a different number of characters in it than the old one did, you can run against problems if any of the places you replaced the name happened to be inside a serialized array (almost all the options, including things like widget settings, text widget text, etc).
The goal of this project would be to make a these kinds of transitions simple and smooth. If only the domain is changing, then when the user updates the WordPress URL we would update internal links in their posts, settings, image urls, etc. If they are moving to a new host, allowing them to install WordPress at their new host and enter their credentials for their old host (WordPress admin credentials as well as FTP credentials) and WordPress would simply import everything (posts, settings, uploads, theme, plugins, etc).
I talked to John James Jacoby ( jjj ) and John Godley (john__g) on IRC about this and came up with the following tentative points..
I will keep posting about each of them as a blog post and may be change the list too as I go deeper into the matter
I will surely keep blogging about other issues and future ideas I get on this project for the community as a resource and for next years or may be this yrs GSOC participants (If I dont get selected)
There is so less of me for everyone