Enable lightweight HTTP access for android.git.linaro.org
For a while now, our automated build service on ci.linaro.org has been using lightweight ("non-smart") HTTP access to clone off git.linaro.org. We should make that happen for android.
Blueprint information
- Status:
- Complete
- Approver:
- Данило Шеган
- Priority:
- High
- Drafter:
- Данило Шеган
- Direction:
- Approved
- Assignee:
- Данило Шеган
- Definition:
- Approved
- Series goal:
- None
- Implementation:
- Implemented
- Milestone target:
- 2012.11
- Started by
- Данило Шеган
- Completed by
- Данило Шеган
Related branches
Related bugs
Sprints
Whiteboard
Meta:
Headline: Allow non-smart HTTP access on android.
Acceptance: There is http://
[2012-09-24 danilo] We might even want to go and rewrite manifest files for publishing, since significant load is coming from people doing their first-time builds by following our "rebuild" instructions. We should look for git://android.
[2012-09-27 danilo] Set up test builds on https:/
[2012-10-26 danilo] First build gone through, but still moving this to 2012.11 (as per postmortem call).
[2012-11-13 danilo] Builds working with custom build scripts which rewrite the manifests: lp:~danilo/linaro-android-build-tools/no-seed
[2012-11-13 danilo] Seeded builds (2.5h) are still much faster than non-seeded (last one took 3.5h), though a proxy should solve that.
[2012-11-22 danilo] Setting up android.
[2012-11-27 danilo] rt#664 has been resolved, we've got support for URL rewriting (it's not perfect: apache directory index rendering makes it go to the internal URL /git-http), but at least it works. Uncompressing entire pack files does not help with memory usage in smart HTTP, or progress bars with non-smart HTTP git access, and results in huge disk space usage (eg. 870MB kernel repo ended up being 34GB when kept uncompressed).
[2012-11-29 danilo] First builds using http_proxy at ci.linaro.org (now configured to keep a cache of 30GB) have been done. repo sync time is down from 41min with squid cache unpopulated (https:/
Work Items
Work items:
Set up lightweight HTTP /git-ro serving under android.
Set up gerrit hooks for running git update-server-info (rt #657): DONE
Compare how android builds using lightweight HTTP git access work with and without the seed: DONE
Experiment with pack size for better git pull/clone output over lightweight http: DONE
Switch to use http://
Ensure all manifest files we publish are making use of http://
Set up http proxy on android-