#1 2016-01-11 13:24:58

totte
Administrator
Registered: 2013-04-16
Posts: 1,137

Server migration, new address and look, July 2016

Progress
Working... [##################################################] 100 %
New addresses

Some of these are live, some aren't yet. Sometime after 20160713T1200Z all of the changes will have taken effect.

 
https://chakraos.org       ---> https://chakralinux.org
http://rsync.chakraos.org  ---> https://rsync.chakralinux.org
http://git.chakraos.org    ---> https://chakralinux.org/code (then: gitweb, now: cgit)
http://cgit.chakraos.org   ---> https://chakralinux.org/code (cgit)
git://git.chakraos.org     ---> git://git.chakralinux.org
rsync://rsync.chakraos.org ---> rsync://rsync.chakralinux.org
http://chakra-project.it   ---> https://it.chakralinux.org
http://chakraos.es         ---> https://es.chakralinux.org
Having issues logging in on any of the web applications or uploading to the wiki or CCR?

Send an e-mail to totte@chakralinux.org and we'll try to get it sorted out!

Updates

Hey folks!

This is a preliminary announcement and may be subject to change (i.e. postponed or cancelled) due to unforeseen circumstances. I will update this post as more information becomes available.

20160111T1223Z
At some point in February 2016 our current dedicated (i.e. physical) server will be replaced by a new one in a new data center located in Frankfurt, Germany. This  will result in new IP addresses, a hardware upgrade and other countermeasures against various attacks (UDP, TCP, SYN floods etc.). We have not yet received a specific date and time for the event.

20160226T1258Z
Preliminary date changed to March 2016.

20160317T1009Z
Preliminary date changed to April 2016.

20160628T0614Z
Preliminary date changed to 20160704-20160710.

20160702T2034Z
If everything goes according to the plan, there will be but a brief interruption on either Wednesday or Thursday when the actual switch happens. During Monday and Tuesday the new servers will be set up (configured, the operating system is already installed). On Wednesday there will be tests and scripts will be written to automate transfer of all the data from the old servers to the new ones. On Thursday the switch will happen. Friday will hopefully not be necessary but I took the day off just in case. Knock on wood.

20160705T2141Z
We've received the new servers (although they had to be reinstalled due to a minor issue), set DNS and rDNS records, e-mail settings, created user accounts, installed a bunch of packages and configured most of them, copied over all the current packages and releases (and miscellaneous stuff) that remains on the old server) as well as gotten "Let's Encrypt" TSL certificates (two of four, we need another two as it turns out).

Tomorrow we'll get the IRC bouncer running as well as git and gitolite, after which we deploy all the web applications. Then we set up the RDBMSs and write scripts to dump the data on the old servers and scp the dumps to the new server where it is imported. Once git and gitolite is running we'll send out a first notification with the few but important details needed to start using the new server for pushing code and uploading packages to.

Once we've finished the web applications and their scripts to almost-instantly be able to copy the data from the old servers to the new one, we'll send out a second notification about the switch most likely happening at a set time which will be given in UTC.

20160706T0952Z
Due to issues in the data center, our servers are currently not responding to connections. The technicians are aware of these problems and are doing everything they can to restore connection to the servers as soon as possible. Our work will continue once the connections have been restored.

20160707T1526Z
Connections restored and progress has been made. Three or four major tasks remain to carry out before moving all the data.

20160707T1901Z
Bouncer, gitolite, IRC bot are up and running. RDBMSs and web applications will be installed tomorrow.

20160708T1808Z
Minor issues have been dealt with and we will move the package repositories and source code repositories tomorrow at noon UTC. The Hispanophone and Italophone community websites, currently located at http://chakraos.es and http://chakra-project.it will be moved to https://es.chakralinux.org and https://it.chakralinux.org respectively. As indicated, they will now have TLS certificates to offer their users secure connections.

20160709T0843Z
We will set a time and date later today for when the websites will be moved.

20160709T1811Z
Source code repositories, package repositories, and releases have been moved to https://rsync.chakralinux.org. The package core/pacman-mirrorlist has been updated (and will be continuously updated during the following days if necessary) to reflect this change and all known mirror providers have been contacted by e-mail. The server rsync.chakraos.org will be kept up to date until and after the changes to the DNS record has propagated, meaning that even if one still attempts connecting via that domain name the packages should be no older than about an hour. Contributors will find more information in the mailing lists.

Currently the plan is to move the web applications to their new server (https://chakralinux.org) tomorrow and test them thoroughly before making them public. Once we feel somewhat confident about their state we'll update this post and spread the word on social networks in advance of the switch. The plan is to have all three of the websites (chakralinux.org, es.chakralinux.org, and it.chakralinux.org) ready at the same time.

20160711T1103Z
The websites chakralinux.org, es.chakralinux.org and it.chakralinux.org will be temporarily restricted (so you won't be able to browse the web interface for the git repositories which is at https://chakralinux.org/code) for the time being. If you ain't a contributor with shell access and need to clone a repository, you may run this for read-only access:

$ git clone git://git.chakralinux.org/REPOSITORYNAMEHERE.git

...where REPOSITORYNAMEHERE should be the name of the repository you are interested in.

20160711T1717Z
At 20160713T1200Z the current website at chakraos.org will be shut down and relocated to chakralinux.org.

20160713T1447Z
The website and all data has been moved. Note that chaser, ccr and aur2ccr will not work right now - a fix is underway. Only the fora for the Hispanophone and Italophone websites were set up for the time being. There are several broken links in their templates and that will be sorted out eventually. We've switched from our previous CA to letsencrypt.org and hopefully all redirects will work as intended. Please let us know if they don't.

20160714T0503Z
testing/ccr-4.0.5-1 and testing/python3-ccr-0.3.3-1 should be working properly. core/mirror-check has been removed, please view this page instead.

20160714T1202Z
The two servers that previously hosted the Hispanophone and Italophone community websites (chakraos.es and chakra-project.it respectively) have been shut down.

20160714T1505Z
The static pages ("Home"), news, CCR and forum got a new look. It's a work in progress which will at some point hopefully be applied to the wiki, bug tracker, source code browser etc. as well.

There was an issue with the CCR where one wasn't able to upload any packages, it should be resolved now.

The mirror http://free.nchc.org.tw/chakra/ are now mirroring our releases as well as packages. This means that its address in the mirrorlist has been updated (otherwise you'll get 404s).

The old dedicated server with all of its virtual servers has now been powered off.

Last edited by totte (2016-07-14 16:09:25)

Offline

#2 2016-07-19 14:52:14

ericjs
Member
From: Boston, MA
Registered: 2013-11-07
Posts: 350

Re: Server migration, new address and look, July 2016

So why was the domain name changed?

Offline

#3 2016-07-19 14:54:35

ericjs
Member
From: Boston, MA
Registered: 2013-11-07
Posts: 350

Re: Server migration, new address and look, July 2016

I like the look of the site, BTW. Very nice.

Offline

#4 2016-07-19 16:01:01

brikler
Member
From: deutschland
Registered: 2012-04-18
Posts: 624

Re: Server migration, new address and look, July 2016

ericjs wrote:

I like the look of the site, BTW. Very nice.

...and quicker as the old site smile

Offline

#5 2016-07-19 16:25:50

ugjka
Jr. Packager
From: Latvia
Registered: 2013-07-30
Posts: 285

Re: Server migration, new address and look, July 2016

needs more fancy css and javascript /s

Offline

#6 2016-07-20 09:04:13

totte
Administrator
Registered: 2013-04-16
Posts: 1,137

Re: Server migration, new address and look, July 2016

ericjs wrote:

So why was the domain name changed?

I'll copy and paste the reply I wrote to a similar question elsewhere:

totte wrote:

The short answer is that I had a deadline (which was generously extended when I ran into trouble!) and figured that setting up all the websites and others services with that domain would let me prepare most tasks in advance and do some testing - what with the necessary restructuring. In theory I thought it'd mean, like, less than an hour of downtime - as opposed to about 24 hours worldwide. We already owned that domain and used it to preview and test an upcoming version of the website.

If you click on that link in my first message it should redirect properly to the new address, as should any other using the old domain name (which will be kept). The foo@chakraos.org e-mail addresses will remain too, alongside the new foo@chakralinux.org such.

I contacted all the mirror providers regarding the change and had the third-party websites that I knew of updated as well (Bitbucket, GitHub, GitLab, Wikipedia, the KDE wikis, and so on...) so hopefully everything is as it should be.

So this "old" address to this very topic should still work: https://chakraos.org/forum/viewtopic.php?id=14538

Offline

#7 2016-07-20 14:49:08

ericjs
Member
From: Boston, MA
Registered: 2013-11-07
Posts: 350

Re: Server migration, new address and look, July 2016

Thanks for all your work!

Offline

#8 2016-08-05 19:58:07

ericjs
Member
From: Boston, MA
Registered: 2013-11-07
Posts: 350

Re: Server migration, new address and look, July 2016

BTW I just noticed that "Server migration in progress." is in the banner at the top of forum pages...I assume the migration is really done now, and this is just an oversight?

Offline

#9 2016-08-07 22:55:02

tetris4
Communicator
From: NL, CY
Registered: 2009-12-11
Posts: 5,162
Website

Re: Server migration, new address and look, July 2016

The main part is done, but there are still things that need fixing or adjustments.


You can help improve Chakra by getting involved or donating!

Offline

#10 2016-08-08 02:11:49

ericjs
Member
From: Boston, MA
Registered: 2013-11-07
Posts: 350

Re: Server migration, new address and look, July 2016

Ok. I was just making sure someone hadn't just forgot to take the blurb down, which would be easy enough to do. :^)

Offline

#11 2016-08-08 20:38:43

totte
Administrator
Registered: 2013-04-16
Posts: 1,137

Re: Server migration, new address and look, July 2016

ericjs wrote:

Thanks for all your work!

My pleasure!

ericjs wrote:

BTW I just noticed that "Server migration in progress." is in the banner at the top of forum pages...I assume the migration is really done now, and this is just an oversight?

tetris4 wrote:

The main part is done, but there are still things that need fixing or adjustments.

Actually the major holdup since a month back is that I expected everyone to chime in and verify that they are able to log in on the new file server and upload packages to it as well as push commits, but none have replied despite reminders. Aside from that I still need to set up the Review Board, the pastebin, the Hispanophone and Italophone news (blogs) and finally have our IRC bot report website events in the appropriate channels.

There was an "outage" by the end of July which caused a 502 error. It was resolved by Ram-Z since I was away at the time (I just got back home) and I'm investigating as to why it happened. To the best of my knowledge my calculations with regards to resource allocations were correct but it would seem that it hit a snag in the choice of method of communication between the CGI and reverse proxy server.

Offline

#12 2016-08-10 13:29:59

totte
Administrator
Registered: 2013-04-16
Posts: 1,137

Re: Server migration, new address and look, July 2016

There was another "outage" (for lack of a better name) today between (approximately) 0930-1200 UTC due to an issue with the file system that caused the disk to be mounted read-only. I'm posting it here because I consider it minor in duration and scope.

Offline

#13 2016-08-18 14:58:25

totte
Administrator
Registered: 2013-04-16
Posts: 1,137

Re: Server migration, new address and look, July 2016

There was another "outage" (for lack of a better name) today between (approximately) 1230-1330 UTC due to an issue with the file system that caused the disk to be mounted read-only. I'm posting it here because I consider it minor in duration and scope. I've asked our hosting provider for details as to why this happened again.

Offline

Board footer

Powered by FluxBB