Server QA workflow

Registered by Thierry Carrez

How to improve server QA in general. This will cover efforts such as daily triage, SRU tracking, ISO testing, apport hooks.

Blueprint information

Status:
Started
Approver:
Marjo F. Mercado
Priority:
Medium
Drafter:
C de-Avillez
Direction:
Approved
Assignee:
C de-Avillez
Definition:
Approved
Series goal:
Accepted for natty
Implementation:
Slow progress
Milestone target:
milestone icon ubuntu-11.04
Started by
Marjo F. Mercado

Related branches

Sprints

Whiteboard

# QA workflow redux
# Foundations bug triage overlap? -- apt, mdadm, dpkg, all critical to servers and needing more bug attention
# SRU tracking
# Daily triage
# ISO testcases review
# Apport hooks ? (should be reviewed and worked on on opportunity)
# Bug reporting guidelines and acknowledgements
# [smoser] QA ownership of Stable Release UEC Image Refresh
(frankly, I do not think QA should do image refreshes -- hggdh2)
# [smoser] QA ownership / running of EC2 test suite
# More Daily VCS ?

Work Items for natty-alpha-1:
[hggdh2]: propose temporary Hudson server: DONE
[hggdh2] Propose server testing plan: DONE
[hggdh2] Hudson temporary deployment on AWS (a small instance): DONE
[hggdh2] send a note to all QA pointing to the Hudson deployment, and ask for machines to be slaves: DONE
[zul] SRU tracking -- instruction writeup: POSTPONED
[zul] Daily VCS -- instruction writeup: POSTPONED
[hggdh2] SRU tracking -- verify what can be passed over to QA (zul, pedro_, hggdh2): POSTPONED
[zul] Daily VCS -- discuss with server team what, if any, QA can take over: POSTPONED
[hggdh2] Run EC2 test suite on natty-alpha-1 (ran EC2 tests on Maverick UEC): DONE
[hggdh2] Run ISO tests on natty-alpha1: DONE

Work Items for natty-alpha-2:
[hggdh2] QA take over of the EC2 test suite from smoser : DONE
zul] SRU tracking -- instruction writeup: DONE
[zul] Daily VCS -- instruction writeup: DONE
[hggdh2] SRU tracking -- verify what can be passed over to QA (zull, pedro_, hggdh2): DONE
[zul] Daily VCS -- discuss with server team what, if any, QA can take over: DONE
[hggdh2] ISO testcases review -- should be done together with the Natty automated server tests blueprint? (bug 712145
): DONE
[hggdh2] Run EC2 test suite on natty-alpha-2 (smoser and andre ran it, alpha2 X upgrade caused X to fail on my laptop): DONE
[hggdh2] Run ISO tests on natty-alpha2: DONE

Work Items for natty-alpha-3:
[hggdh2] Run EC2 test suite on natty-alpha-3 (performed by smoser): DONE
[hggdh2] Run ISO tests on natty-alpha3: DONE

Work Items for ubuntu-11.04-beta-1:
[hggdh2] Run EC2 test suite on ubuntu-11.04-beta-1: TODO
[hggdh2] Run ISO tests on ubuntu-11.04-beta-1: TODO

Work Items for ubuntu-11.04:
[hggdh2] Run EC2 test suite on ubuntu-11.04-RC: TODO
[hggdh2] Run ISO tests on ubuntu-11.04-RC: TODO
[hggdh2] Run EC2 test suite on ubuntu-11.04 final: TODO
[hggdh2] Run ISO tests on ubuntu-11.04 final: TODO

(?)

Work Items