Re: [kictanet] KeNIC's OFFICIAL COMMUNICATION ON .KE DOMAINS SERVICE DISRUPTION EXPERIENCED ON FRIDAY 19TH JANUARY 2018
Hey Elly, Just a correction, on a light note. It's Listers, as opposed to 'listeners'.. While we appreciate this communication, there are a few disturbing issues I take note of in the brief from Kenic, and a clarification would suffice:- 1. Why would a module upgrade be carried out on a live registry database, literally throwing the entire country .KE space into a spin, for almost two days..? Was an offline upgrade test run conducted..? 2. Why did it take two days for this communique to be released, albeit much late in the day as chaos reigned..? 3. Any disaster recovery strategies in place, to mitigate such..? Any timelines..? Were laid protocols followed in this strategy..? Do we have a failover in place for the Registry..? 4. Any assessment of the impact of this outage,on the .KE space, technically and economically..? I believe most if not all stakeholders would shudder at &take great exception at such light handling of a major registry outage that's currently the backbone of the entire country's digital framework, considering the chaos that ensued in the aftermath. I honestly suggest all protocol be now put forward by Kenic to ensure the .KE space is urgently certified as a national security infrastructure. Harry On 19 Jan 2018 18:26, "Senior System Administrator via kictanet" < kictanet@lists.kictanet.or.ke> wrote: Dear Listeners, Kindly find attached the official communication from KeNIC offering apology and explanation on the cause and status of the .KE domains services disruption. Thank you. Kind Regards, ................................................... Elly Kadenyo Senior System Administrator snrsysadmin@kenic.or.ke +254 0720062293 _______________________________________________ kictanet mailing list kictanet@lists.kictanet.or.ke https://lists.kictanet.or.ke/mailman/listinfo/kictanet Twitter: http://twitter.com/kictanet Facebook: https://www.facebook.com/KICTANet/ Unsubscribe or change your options at https://lists.kictanet.or.ke/ mailman/options/kictanet/harry26001%40gmail.com The Kenya ICT Action Network (KICTANet) is a multi-stakeholder platform for people and institutions interested and involved in ICT policy and regulation. The network aims to act as a catalyst for reform in the ICT sector in support of the national aim of ICT enabled growth and development. KICTANetiquette : Adhere to the same standards of acceptable behaviors online that you follow in real life: respect people's times and bandwidth, share knowledge, don't flame or abuse or personalize, respect privacy, do not spam, do not market your wares or qualifications.
Hi Harry, 1) The upgrade was by the developer on his software and it was done in the last quarter of last year. 2) KeNIC technical team was working with the developer to get real cause and restore services before communication. As you acknowledge, .KE is a key resource and its restoration in case of a down time is key and needs to be followed by an authentic communique. 3) KeNIC has a recovery fall back in case of a disaster. This case was peculiar because we were protecting client's transactions in the process of service restoration. 4) First and most important aspect is done - service restoration. Assessment comes after. Thank you. Kind Regards, ................................................... Elly Kadenyo Senior System Administrator snrsysadmin@kenic.or.ke +254 0720062293 From: "Harry Delano" <harry26001@gmail.com> To: "KICTAnet ICT Policy Discussions" <kictanet@lists.kictanet.or.ke> Cc: "Senior System Administrator" <snrsysadmin@kenic.or.ke> Sent: Saturday, January 20, 2018 3:58:24 PM Subject: Re: [kictanet] KeNIC's OFFICIAL COMMUNICATION ON .KE DOMAINS SERVICE DISRUPTION EXPERIENCED ON FRIDAY 19TH JANUARY 2018 Hey Elly, Just a correction, on a light note. It's Listers, as opposed to 'listeners'.. While we appreciate this communication, there are a few disturbing issues I take note of in the brief from Kenic, and a clarification would suffice:- 1. Why would a module upgrade be carried out on a live registry database, literally throwing the entire country .KE space into a spin, for almost two days..? Was an offline upgrade test run conducted..? 2. Why did it take two days for this communique to be released, albeit much late in the day as chaos reigned..? 3. Any disaster recovery strategies in place, to mitigate such..? Any timelines..? Were laid protocols followed in this strategy..? Do we have a failover in place for the Registry..? 4. Any assessment of the impact of this outage,on the .KE space, technically and economically..? I believe most if not all stakeholders would shudder at &take great exception at such light handling of a major registry outage that's currently the backbone of the entire country's digital framework, considering the chaos that ensued in the aftermath. I honestly suggest all protocol be now put forward by Kenic to ensure the .KE space is urgently certified as a national security infrastructure. Harry On 19 Jan 2018 18:26, "Senior System Administrator via kictanet" < kictanet@lists.kictanet.or.ke > wrote: Dear Listeners, Kindly find attached the official communication from KeNIC offering apology and explanation on the cause and status of the .KE domains services disruption. Thank you. Kind Regards, ................................................... Elly Kadenyo Senior System Administrator snrsysadmin@kenic.or.ke +254 0720062293 _______________________________________________ kictanet mailing list kictanet@lists.kictanet.or.ke https://lists.kictanet.or.ke/mailman/listinfo/kictanet Twitter: http://twitter.com/kictanet Facebook: https://www.facebook.com/KICTANet/ Unsubscribe or change your options at https://lists.kictanet.or.ke/mailman/options/kictanet/harry26001%40gmail.com The Kenya ICT Action Network (KICTANet) is a multi-stakeholder platform for people and institutions interested and involved in ICT policy and regulation. The network aims to act as a catalyst for reform in the ICT sector in support of the national aim of ICT enabled growth and development. KICTANetiquette : Adhere to the same standards of acceptable behaviors online that you follow in real life: respect people's times and bandwidth, share knowledge, don't flame or abuse or personalize, respect privacy, do not spam, do not market your wares or qualifications.
Thanks Elly, Please share back the pertinent lessons Kenic learnt from this episode going forward, particularly:- 1. It's impact assessment on the .KE space, especially economically/ Technical goodwill. 2. Elevation as a critical national security infrastructure 3. Mitigation measures and DR preparedness 4. Critical system upgrade/Change management process/Third party system handling policy.. Let's set up this Registry as a world class shining example.. Harry On 20 Jan 2018 21:41, "Senior System Administrator" <snrsysadmin@kenic.or.ke> wrote:
Hi Harry,
1) The upgrade was by the developer on his software and it was done in the last quarter of last year. 2) KeNIC technical team was working with the developer to get real cause and restore services before communication. As you acknowledge, .KE is a key resource and its restoration in case of a down time is key and needs to be followed by an authentic communique. 3) KeNIC has a recovery fall back in case of a disaster. This case was peculiar because we were protecting client's transactions in the process of service restoration. 4) First and most important aspect is done - service restoration. Assessment comes after.
Thank you.
Kind Regards, ...................................................
Elly Kadenyo Senior System Administrator snrsysadmin@kenic.or.ke +254 0720062293
------------------------------ *From: *"Harry Delano" <harry26001@gmail.com> *To: *"KICTAnet ICT Policy Discussions" <kictanet@lists.kictanet.or.ke> *Cc: *"Senior System Administrator" <snrsysadmin@kenic.or.ke> *Sent: *Saturday, January 20, 2018 3:58:24 PM *Subject: *Re: [kictanet] KeNIC's OFFICIAL COMMUNICATION ON .KE DOMAINS SERVICE DISRUPTION EXPERIENCED ON FRIDAY 19TH JANUARY 2018
Hey Elly,
Just a correction, on a light note. It's Listers, as opposed to 'listeners'..
While we appreciate this communication, there are a few disturbing issues I take note of in the brief from Kenic, and a clarification would suffice:-
1. Why would a module upgrade be carried out on a live registry database, literally throwing the entire country .KE space into a spin, for almost two days..? Was an offline upgrade test run conducted..?
2. Why did it take two days for this communique to be released, albeit much late in the day as chaos reigned..?
3. Any disaster recovery strategies in place, to mitigate such..? Any timelines..? Were laid protocols followed in this strategy..? Do we have a failover in place for the Registry..?
4. Any assessment of the impact of this outage,on the .KE space, technically and economically..?
I believe most if not all stakeholders would shudder at &take great exception at such light handling of a major registry outage that's currently the backbone of the entire country's digital framework, considering the chaos that ensued in the aftermath. I honestly suggest all protocol be now put forward by Kenic to ensure the .KE space is urgently certified as a national security infrastructure.
Harry
On 19 Jan 2018 18:26, "Senior System Administrator via kictanet" < kictanet@lists.kictanet.or.ke> wrote:
Dear Listeners,
Kindly find attached the official communication from KeNIC offering apology and explanation on the cause and status of the .KE domains services disruption.
Thank you.
Kind Regards, ...................................................
Elly Kadenyo Senior System Administrator snrsysadmin@kenic.or.ke +254 0720062293
_______________________________________________ kictanet mailing list kictanet@lists.kictanet.or.ke https://lists.kictanet.or.ke/mailman/listinfo/kictanet Twitter: http://twitter.com/kictanet Facebook: https://www.facebook.com/KICTANet/
Unsubscribe or change your options at https://lists.kictanet.or.ke/ mailman/options/kictanet/harry26001%40gmail.com
The Kenya ICT Action Network (KICTANet) is a multi-stakeholder platform for people and institutions interested and involved in ICT policy and regulation. The network aims to act as a catalyst for reform in the ICT sector in support of the national aim of ICT enabled growth and development.
KICTANetiquette : Adhere to the same standards of acceptable behaviors online that you follow in real life: respect people's times and bandwidth, share knowledge, don't flame or abuse or personalize, respect privacy, do not spam, do not market your wares or qualifications.
participants (2)
-
Harry Delano -
Senior System Administrator