Lab improvement tasks

Registered by Gema Gomez

This blueprint is created to as a way of tracking the work the Platform QA team is doing in the QA labs.

Blueprint information

Pete Graner
Larry E Works
Canonical CI Engineering
Series goal:
Accepted for raring
Good progress
Milestone target:
Started by
Gema Gomez

Related branches



Discuss what was done during Quantal and what we are aiming at doing during R.

- Migration from cobbler to MaaS of our testing infrastructure
- What new HW is to come?
- HW Reservation system


Work Items

Work items for ubuntu-13.04-month-1:
[larry-e-works] Research and order additional commercial grade desktop systems to support Product Strategy testing: DONE
[ricklfowler] Move PS Jenkins server from 1SS to Magners lab: DONE
[larry-e-works] Install and configure new disk drives in aldebaran ans wazn: DONE
[ricklfowler] Set up wi-fi access point for use within the lab (connected to the lab network infrastructure): DONE

Work items for ubuntu-13.04-month-2:
[ricklfowler] Assemble the commercial grade desktop systems for use Product Strategy. Label the systems, connect to the network, CDU and KVM and add the matching labels to both the CDU and the KVM via their respective web interfaces: DONE
[larry-e-works] Order and install port-multiplier e-SATA cards for aldebaran and magners-orchestra. Connect the 4 drive disk cabinets to the e-SATA cards and configure software RAID: DONE

Work items for ubuntu-13.04-month-3:
[larry-e-works] Create and add a Nagios test to check the status of the Jenkins master nodes to the Nagios servers in both labs: DONE
[larry-e-works] Create and add a Nagios check to monitor the input loads on the CDUs in both labs: DONE
[larry-e-works] Determine which CDUs have the environmental sensors connected then create and add a Nagios check to monitor the temperature within the lab: DONE
[ricklfowler] Determine the additional infrastructure hardware that will be needed for the expansion into Chimay: DONE

Work items for ubuntu-13.04-month-4:
[larry-e-works] Private instance: establish data and configuration back up policy, determine how often to back up Jenkins to ensure we can restore it safely and lose no work in the process: DONE
[larry-e-works] Document the backup policy/procedure: DONE
[larry-e-works] Update the QA Lab wiki page; include all laptop/desktop/netbook and server hardware: DONE
[ricklfowler] Install upgrade system boards in the Romley-EP platforms and install precise, quantal and raring to test for installation/reboot bug per E-mail from Leann: DONE
[ricklfowler] Install the infrastructure hardware (CDUs and network switches) in Chimay; connect Chimay to Magners Lab: DONE

Work items for ubuntu-13.04-month-5:
[ricklfowler] Add additional Pandaboards to the hardware pool for use by PS: DONE
[ricklfowler] Relocate 4 Pandaboards to 1SS and connect them to the lab infrastructure: DONE
[ricklfowler] Relocate onibi to Magners Lab and connect it to the lab infrastructure: DONE
[ricklfowler] Rack the three Romley EPs from Intel in the Magners Lab and connect to the lab infrastructure: DONE
[larry-e-works] Designate one of the Romley EP systems to be used as the PS build server (hostname will be kinnara). Install the base OS and turn over to PS for inclusion in their testing pool: DONE
[larry-e-works] Designate one additional desktop machine in the Magners Lab to be used as the PS autopilot CI/Autolanding system: DONE

Work items for ubuntu-13.04-month-6:
[doanac] Establish the workflow for creating jobs, removing jobs, modifying jobs. Make sure nobody adds new jobs to the production Jenkins without having tried it first and demonstrated it works in the pre-production environment. Use bazaar to store the jobs and jenkins configuration, people should submit to the branch and then you can catch up on the production servers for updating with the latest changes: POSTPONED
[ricklfowler] Prepare Nexus 7 hardware for QA testing environment: INPROGRESS
[larry-e-works] Coordinate with IS to ensure the public jenkins instance is being backed up: DONE
[larry-e-works] Test the backups (private), do a recovery trial and ensure the procedure is documented: DONE
[larry-e-works] Rebuild onibi as psoglav. Configure it to be used as the jenkins server for PS: DONE
[ricklfowler] Install additional HDDs in the two RoseCity platforms and rack them: DONE
[larry-e-works] Prepare the RoseCity platforms to be VM hosting servers; coordinate with PS to move several of their VMs to each system: POSTPONED

Work items for ubuntu-13.05:
[ricklfowler] Incorporate addition wireless access point into Chimay lab: DONE
[ricklfowler] Setup work bench for phone/tablet modifications: INPROGRESS
[ricklfowler] Add additional phones/tablets to the infrastructure for testing: DONE
[ricklfowler] Organize Magners and Chimay labs as new items are recieved: INPROGRESS
[ricklfowler] Add additional power supplies to HP MAAS/Landscape servers in 1SS: DONE
[ricklfowler] Redistribute power connectors at 1SS for redundancy following power feeder maintenance: DONE

Work items for ubuntu-13.06:
[ricklfowler] Rack and setup Calxeda ARM servers in QA lab: DONE
[ricklfowler] Decommission Panda build farm once Calxeda server is online: INPROGRESS
[ricklfowler] Setup Cisco router to replace routing functions of magners-orchestra: INPROGRESS
[ricklfowler] Replace defective RoseCity server and setup new one when received: DONE
[larry-e-works] Rack and setup Brickland server in 1SS: DONE

Work items for ubuntu-13.07:
[larry-e-works] Submit RT for electrical drop for the UPS; track progress: DONE
[larry-e-works] Trim down networks/vlans hosted through magners-orchestra: DONE
[ricklfowler] Work with electricians on location of electrical drop for UPS: DONE
[ricklfowler] Re-arrange lab in preparation of network changes: DONE

Work items for ubuntu-13.08:
[larry-e-works] Prepare UPS for rack mounting: DONE
[larry-e-works] Order replacement servers for primary jenkins instances: DONE
[ricklfowler] Rack replacement jenkins servers; install base OS: DONE
[ricklfowler] Rearrange power sources for Magners lab servers; Connect one CDU from rack one and one CDU from rack two to the UPS. Servers with redundant power supplies whould connect to an UPS powered CDU a non-UPS powered CDU. Servers with single power supplies should connect to an UPS powered CDU: DONE
[ricklfowler] Begin migrating Magners lab hardware from HP managed switch to Cisco 3750: DONE

Work items for ubuntu-13.09:
[larry-e-works] Complete migrating Magners lab desktops from VLAN4 and VLAN6 to VLAN2: DONE
[ricklfowler] Complete migrating Magners lab servers from HP managed switch to Cisco 3750: DONE
[larry-e-works] Migrate jenkins instances from m-o, psoglav and jiufeng to the new hardware: INPROGRESS
[ricklfowler] Move phones/tablets to the plexiglas stand. Ceiling mount the network camera in Chimay for optimal visibility on phone/tablet stand: TODO

This blueprint contains Public information 
Everyone can see this information.