There are many reasons to use master-slave replication including but not limited to:

1) Offload some of the queries from one server to another thus helping spread the load: One of the biggest advantages to have master-slave set up in MySQL is to be able to use master for all of the inserts and send some, if not all, select queries to a slave (or even a series of slaves). This will most probably speed up your application without having to diving into optimizing all the queries or buying more hardware-  This is especially handy if your using some off the shelf application such as WebEmpoweredChurch.com / Typo3,  Magento , WordPress, Drupal, etc . . .

2) Backups can hurt a DB server @ times.   Here @ Typo3USA – We always Do backups from slave.  Most techs simply just overlook this simple but highly effective advantage.   We have some databases that are quite large – super large and others that are just a few megs – to a few gigs.   Sadly – when the size of a database becomes a big deal is when it has grown to multiple gigs and mysqldump causes the site to lag when it locks tables.  For some sites, this could mean that site goes down for few secs to minutes. If you have slave, you just take slave out of rotation (we have built this into our backup scripts now) and run backups off the slave. You can even stop slave MySQL instance and copy the /etc/mysql/mysql or /var/lib/mysql  (or whatever your database directory ) folder instead of doing mysqldump…

Recently – we moved forward into using the R1Soft.com Backup System (in fact we also had a good hand with the Vine Staff and Ron Hall in building up their new website – check it out @ www.R1soft.com ) WE ABSOLUTELY LOVE THIS SYSTEM BECAUSE IT IS SO FAST IN ITS BACKUPS FOR MYSQL

Ok let us dive into how to setup master-slave replication under MySQL. There are many configuration changes you can do to optimize your MySQL set up. I will just touch on very basic ones to get the replication to work. Here are some assumptions:

Master server ip: 10.100.1.1
Slave server ip: 10.100.1.2
Slave username: slavemysqluser
Slave pw: slavepw
Your data directory is: /usr/local/mysql/var/

Put the following in your master my.cnf file under [mysqld] section:

# changes made to do master
server-id = 1
relay-log = /usr/local/mysql/var/mysql-relay-bin
relay-log-index = /usr/local/mysql/var/mysql-relay-bin.index
log-error = /usr/local/mysql/var/mysql.err
master-info-file = /usr/local/mysql/var/mysql-master.info
relay-log-info-file = /usr/local/mysql/var/mysql-relay-log.info
datadir = /usr/local/mysql/var
log-bin = /usr/local/mysql/var/mysql-bin
# end master

Copy the following to slave’s my.cnf under [mysqld] section:

# changes made to do slave
server-id = 2
relay-log = /usr/local/mysql/var/mysql-relay-bin
relay-log-index = /usr/local/mysql/var/mysql-relay-bin.index
log-error = /usr/local/mysql/var/mysql.err
master-info-file = /usr/local/mysql/var/mysql-master.info
relay-log-info-file = /usr/local/mysql/var/mysql-relay-log.info
datadir = /usr/local/mysql/var
# end slave setup

Create user on master:
mysql> grant replication slave on *.* to slavemysqluser@'10.100.1.2' identified by 'slavepw';

Do a dump of data to move to slave
mysqldump -u root --all-databases --single-transaction --master-data=1 > masterdump.sql

import dump on slave
mysql < masterdump.sql

After dump is imported go in to mysql client by typing mysql. Let us tell the slave which master to connect to and what login/password to use:
mysql> CHANGE MASTER TO MASTER_HOST='10.100.1.1', MASTER_USER='slaveuser', MASTER_PASSWORD='slavepw';

Let us start the slave:
mysql> start slave;

You can check the status of the slave by typing
mysql> show slave status\G

The last command will let you know how up to date the slave is from the master in seconds.  I have had many folks worry about this being behind the master – it is okay if it does not say ZERO right away – if you check it you should see the number going down over time until it finally catchs up with the master.

NOTE* if it shows NULL, – it could be that the slave has not started or that it has an error:  (if this is the case it should show up in Last_errno; and Last_error under the: show slave status\G )

We suggest a number of different tools as well for MySQL including:

Maatkit
Maatkit is a great set of tools for MySQL Performance Analyses and maintainence. Must know and have for any MySQL User.

mysqladmin
mysqladmin extended -i100 -r is very nice way to look how MySQL performance counters increment and it can tell you a lot about server run status.

mysqlreport
MySQL Report is a tool which would look at status variables same as mysqladmin extended but will group them together nicely and provide some hints on what are good and bad values.

mysqlsla
This is nice tool to analyze slow query log. It reads bunch of different log formats and has various stats, and it was there before mk-log-parser appeared.

innotop
Innotop is great top like tool for MySQL and is helpful even if you do not use Innodb tables. Very nice to watch what happens to server in the real time.

oprofile
oprofile is usually used for advanced MySQL tuning when the load is CPU bound – it will tell you where exactly inside MySQL or Kernel CPU time is spent.

iohist
iohist is a little tool to show histogram for IO response time. The main use for it is to see how response time is split for read and write request rather than seeing the average reported by iostat. These can be very different.

sysbench
sysbench is a tool to check performance of system and MySQL. Helpful to check different hardware and OS characteristic.

Recently, a friend of mine had an interesting experience – (he blogged about it – so guess I can share).

as Chuck Russel, Jason Reynolds, David Helbig, and Clif Guy discussed Internet Campus while enjoying a beautiful night on the beach just a couple hundred feet away in the beach parking lot, Jason’s car window was smashed and Clif’s briefcase/laptop bag was stolen containing his laptop, digital camera, web cam, cables, and all kinds of personal items.

Recently I purchased a Mac Powerbook Pro – and I absolutely love this machine…  I think I might need to start attending a 12 step program as I sleep with this thing, take it to church with me (ok so I use it while preaching…) and it has even made the occasional trip to the bathroom with me… it would be devastating for me to loose this or have it stolen.

I looked into purchasing the LoJack software until I read a quick tidbit on BitBud’s blog about encryption for our servers, files, laptops etc… as well as Adeona – a free Open Source LoJack software.

Adeona is the first Open Source system for tracking the location of your lost or stolen laptop that does not rely on a proprietary, central service.  Whats nice is its 3 primary properties:

• Private: Adeona uses state-of-the-art cryptographic mechanisms to ensure that the owner is the only party that can use the system to reveal the locations visited by a device.
• Reliable: Adeona uses a community-based remote storage facility, ensuring retrievability of recent location updates.
• Open source and free: Adeona’s software is licensed under GPLv2. While your locations are secret, the tracking system’s design is not.

The Mac OS X version also has an option to capture pictures of the laptop user or thief using the built-in iSight camera and the freeware tool isightcapture.

So what are you waiting for?   LoJack your hardware !

Recently Ian Beyer, Network Extraordinaire out @ Church of the Resurrection in Leewood KS and I had an interesting conversation about network topology and the naming convention of servers, routers, switches, and workstations.

Salvation-Topology

We are in the process of bringing on Phase 2 of the VineHosting Data Center, complete with our new R1Soft Bare Metal Restore Servers (another blog post perhaps) and our new Virtual Infrastucture.

Since we now have so many more servers than we did in the past – and we have exhausted all the cities Paul visited in the Bible, the names of the sacraments, etc…  I reached out and asked Ian what they were doing -

He got to joking a bit – saying they used all Dr. Seuss themes @ an old employer (not sure if he meant Sun Microsystems or Sprint…) anyhow – pretty funny stuff.   Imagine that – us having Thing 1 and Thing 2 …

I sat down and had to write up an assignment for my seminary class on the vocabulary of Salvation… and suddenly thought … WOW there it is…

The Servers Host name is Salvation:  its guest machines are:

conversion, substitution, reconciliation, propitiation, remission, imputation, adoption, justification, sanctification,  glorification and regeneration (thats the PXE Booter…)

Our R1Soft Servers are called Preservation and Redemption.

Now If I could only turn this in as an assignment instead of the long term paper… I would be happy as pie.

And of course – I still have all these other servers to do…

I guess I could use a few other examples – imagine getting a welcome email being told your on the purgatory server…

What are you using for a Naming Convention?

Recently, a friend of mine from Church of the Resurrection (Clif Guy) was blogging about the beginnings of the Internet Campus and how COR is looking to do this…
I began looking around @ the web and found the Internet Church (www.Lifechurch.tv) seems to be the ones doing this the best…

I believe many churches will soon be taking a turn towards the virtual. Who would have ever thought of virtual church, but it is becoming a reality in the 21st century. Yes – it is hard to touch, love, and hug – but in this day and age with text, voice, video chat and other social networking tools like twitter, facebook, youtube, etc – fellowship is just a click away…

Soon – You can worship from any remote location with just an internet hook-up and the web address of your own church… (are they ready ?)

Tags: InternetChurch, online church, Church 2.0

I was chatting the other night with @cyberentomology and he told me that they had stopped some of the p2p and napster stuff cold on their network @ COR.org

This got me thinking about how – so much bandwidth is used sharing files, videos, audio etc… during the average work day (can anyone say “Traffic Shaping” 3 times fast after having a moca-latte?)

Anyhow -I began to check a few of the church networks I help support on the side and wow – amazing what do I find – but tons of P2P stuff going on…

Imagine if the RIAA ever came to your church …

Just in time with my thinking / I find this article about Comcast now turning a 180 and declaring love for p2p

So – are you guys blocking this from your boarder?  @ your gateway ? or just allowing it to come in?